Lysine-specific histone demethylase 2 (Kdm2a) is a regulatory factor of histone modifications that participates in gametogenesis and embryonic development. The mis-regulation of Kdm2a can lead to aberrant gene expression, thereby contributing to abnormal cell proliferation, differentiation, apoptosis, and tumorigenesis. However, due to the potential confounding effects that are secondary to the loss of Kdm2a function from the soma in existing whole-animal mutants, the in vivo function of Kdm2a in spermatogenesis for male fertility remains unknown. Herein, we focus on exploring the spatiotemporal expression profile and biological functions of Kdm2a in the spermatogenesis and fertility of male mice. A testis-specific knockout Kdm2a model (Kdm2a cKO) was established by using the Stra8-Cre/loxP recombinase system to explore the roles of Kdm2a in male fertility. Our results showed that Kdm2a was ubiquitously expressed and dynamically distributed in multiple tissues and cell types in the testis of mice. Surprisingly, Kdm2a-deficient adult males were completely fertile and comparable with their control (Kdm2a) counterparts. Despite the significantly reduced total number of sperm and density of seminiferous tubules in Kdm2a cKO testis accompanied by the degeneration of spermatogenesis, the fertilization ability and embryonic developmental competence of the Kdm2a cKO were comparable with those of their control littermates, suggesting that Kdm2a disruption did not markedly affect male fertility, at least during younger ages. Furthermore, Kdm2a homozygous mutants exhibited a lower total number and motility of sperm than the control group and showed notably affected serum 17β-estradiol concentration. Interestingly, the transcriptome sequencing revealed that the loss of Kdm2a remarkably upregulated the expression level of Kdm2b. This effect, in turn, may induce compensative effects in the case of Kdm2a deficiency to maintain normal male reproduction. Together, our results reveal that Kdm2a shows spatiotemporal expression during testicular development and that its loss is insufficient to compromise the production of spermatozoa completely. The homologous Kdm2b gene might compensate for the loss of Kdm2a. Our work provides a novel Kdm2a cKO mouse allowing for the efficient deletion of Kdm2a in a testis-specific manner, and further investigated the biological function of Kdm2a and the compensatory effects of Kdm2b. Our study will advance our understanding of underlying mechanisms in spermatogenesis and male fertility.