Non-obstructive azoospermia, the absence of sperm in the ejaculate due to disturbed spermatogenesis, represents the most severe form of male infertility. De novo microdeletions of the Y-chromosomal AZFa region are one of few well-established genetic causes for NOA and are routinely analysed in the diagnostic workup of affected men. So far, it is unclear which of the three genes located in the AZFa chromosomal region is indispensible for germ cell maturation. Here we present four different likely pathogenic loss-of-function variants in the AZFa gene DDX3Y identified by analysing exome sequencing data of more than 1,600 infertile men. Three of the patients underwent testicular sperm extraction and revealed the typical AZFa testicular Sertoli cell-only phenotype. One of the variants was proven to be de novo. Consequently, DDX3Y represents the AZFa key spermatogenic factor and screening for variants in DDX3Y should be included in the diagnostic workflow.