Neurodevelopmental disorders (NDDs), including intellectual disability (ID) and autism spectrum disorders (ASD), are a large group of disorders in which early insults during brain development result in a wide and heterogeneous spectrum of clinical diagnoses. Mutations in genes coding for chromatin remodelers are overrepresented in NDD cohorts, pointing towards epigenetics as a convergent pathogenic pathway between these disorders. In this review we detail the role of NDD-associated chromatin remodelers during the developmental continuum of progenitor expansion, differentiation, cell-type specification, migration and maturation. We discuss how defects in chromatin remodelling during these early developmental time points compound over time and result in impaired brain circuit establishment. In particular, we focus on their role in the three largest cell populations: glutamatergic neurons, GABAergic neurons, and glia cells. An in-depth understanding of the spatiotemporal role of chromatin remodelers during neurodevelopment can contribute to the identification of molecular targets for treatment strategies.