The sex chromosomes are enriched with germline genes that are activated during the late stages of spermatogenesis. Due to meiotic sex chromosome inactivation (MSCI), these sex chromosome-linked genes must escape silencing for activation in spermatids, thereby ensuring their functions for male reproduction. RNF8, a DNA damage response protein, and SCML2, a germline-specific Polycomb protein, are two major, known regulators of this process. Here, we show that RNF8 and SCML2 cooperate to regulate ubiquitination during meiosis, an early step to establish active histone modifications for subsequent gene activation. Double mutants of Rnf8 and Scml2 revealed that RNF8-dependent monoubiquitination of histone H2A at Lysine 119 (H2AK119ub) is deubiquitinated by SCML2, demonstrating interplay between RNF8 and SCML2 in ubiquitin regulation. Additionally, we identify distinct functions of RNF8 and SCML2 in the regulation of ubiquitination: SCML2 deubiquitinates RNF8-independent H2AK119ub but does not deubiquitinate RNF8-dependent polyubiquitination. RNF8-dependent polyubiquitination is required for the establishment of H3K27 acetylation, a marker of active enhancers, while persistent H2AK119ub inhibits establishment of H3K27 acetylation. Following the deposition of H3K27 acetylation, H3K4 dimethylation is established as an active mark on poised promoters. Together, we propose a model whereby regulation of ubiquitin leads to the organization of poised enhancers and promoters during meiosis, which induce subsequent gene activation from the otherwise silent sex chromosomes in postmeiotic spermatids.