Polycyclic aromatic hydrocarbons (PAHs) are widespread environmental pollutants that have adverse effects on the male reproductive function. Many studies have confirmed that PAHs preferentially accumulate in mitochondria DNA relative to nuclear DNA and disrupt mitochondrial functions. However, it is rare whether exposure to PAHs is associated with mitochondrial damage and dysfunction in sperm. To evaluate the effects of PAHs on sperm mitochondria, we measured mitochondrial membrane potential (MMP), mitochondrial DNA copy number (mtDNAcn) and mtDNA integrity in 666 individuals from the Male Reproductive Health in Chongqing College Students (MARHCS) study. PAHs exposure was estimated by measuring eight urinary PAH metabolites (1-OHNap, 2-OHNap, 1-OHPhe, 2-OHPhe, 3-OHPhe, 4-OHPhe, 2-OHFlu and 1-OHPyr). The subjects were divided into low, median and high exposure groups using the tertile levels of urinary PAH metabolites. In univariate analyses, the results showed that increased levels of 2-OHPhe, 3-OHPhe, ∑Phe metabolites and 2-OHFlu were found to be associated with decreased sperm mtDNAcn. After adjusting for potential confounders, significantly negative associations of these metabolites remained (p = 0.039, 0.012, 0.01, 0.035, respectively). Each 1 μg/g creatinine increase in 2-OHPhe, 3-OHPhe, ∑Phe metabolites and 2-OHFlu was associated with a decrease in sperm mtDNAcn of 9.427%, 11.488%, 9.635% and 11.692%, respectively. There were no significant associations between urinary PAH metabolites and sperm MMP or mtDNA integrity. The results indicated that the low exposure levels of PAHs can cause abnormities in sperm mitochondria.