The decrease in sperm counts is speeding up. It seems that this is an effect of environmental pollution and can lead in the long to the extinction of humankind.
You can refer also to the Guns, germs and steel book by Jared Diamond. There are possible reasons described why populations can get extinct.
