Subnuclear compartmentalization has been proposed to play an important role in gene regulation by segregating active and inactive parts of the genome in distinct physical and biochemical environments. During X chromosome inactivation (XCI), the noncoding Xist RNA coats the X chromosome, triggers gene silencing and forms a dense body of heterochromatin from which the transcription machinery appears to be excluded. Phase separation has been proposed to be involved in XCI, and might explain the exclusion of the transcription machinery by preventing its diffusion into the Xist-coated territory. Here, using quantitative fluorescence microscopy and single-particle tracking, we show that RNA polymerase II (RNAPII) freely accesses the Xist territory during the initiation of XCI. Instead, the apparent depletion of RNAPII is due to the loss of its chromatin stably bound fraction. These findings indicate that initial exclusion of RNAPII from the inactive X reflects the absence of actively transcribing RNAPII, rather than a consequence of putative physical compartmentalization of the inactive X heterochromatin domain.