Entire or partial deletions of the male-specific Y chromosome are associated with tumorigenesis, but whether any male-specific genes located on this chromosome play a tumor-suppressive role is unknown. Here, we report that the histone H3 lysine 4 (H3K4) demethylase JARID1D (also called KDM5D and SMCY), a male-specific protein, represses gene expression programs associated with cell invasiveness and suppresses the invasion of prostate cancer cells in vitro and in vivo. We found that JARID1D specifically repressed the invasion-associated genes MMP1, MMP2, MMP3, MMP7, and Slug by demethylating trimethyl H3K4, a gene-activating mark, at their promoters. Our additional results demonstrated that JARID1D levels were highly downregulated in metastatic prostate tumors compared with normal prostate tissues and primary prostate tumors. Furthermore, the JARID1D gene was frequently deleted in metastatic prostate tumors, and low JARID1D levels were associated with poor prognosis in prostate cancer patients. Taken together, these findings provide the first evidence that an epigenetic modifier expressed on the Y chromosome functions as an anti-invasion factor to suppress the progression of prostate cancer. Our results also highlight a preclinical rationale for using JARID1D as a prognostic marker in advanced prostate cancer.