There are many things in our modern world that are toxic to sperm. This includes tobacco, alcohol, marijuana, some unregulated supplements, certain prescription medications, and environmental chemicals. Treatment for cancer (chemotherapy or radiation) is often bad for sperm. In recent years, use of testosterone has become one of the most common causes for poor sperm counts. Use of testosterone shuts down sperm production.