Nuclear factors regulate the development of complex tissues by promoting the formation of one cell lineage over another. The cofactor FOG1 interacts with transcription factors GATA1 and GATA2 to control erythroid and megakaryocyte (MK) differentiation. In contrast, FOG1 antagonizes the ability of GATA factors to promote mast cell (MC) development. Normal FOG1 function in late-stage erythroid cells and MK requires interaction with the chromatin remodeling complex NuRD. Here, we report that mice in which the FOG1/NuRD interaction is disrupted (Fog(ki/ki)) produce MK-erythroid progenitors that give rise to significantly fewer and less mature MK and erythroid colonies in vitro while retaining multilineage capacity, capable of generating MCs and other myeloid lineage cells. Gene expression profiling of Fog(ki/ki) MK-erythroid progenitors revealed inappropriate expression of several MC-specific genes. Strikingly, aberrant MC gene expression persisted in mature Fog(ki/ki) MK and erythroid progeny. Using a GATA1-dependent committed erythroid cell line, select MC genes were found to be occupied by NuRD, suggesting a direct mechanism of repression. Together, these observations suggest that a simple heritable silencing mechanism is insufficient to permanently repress MC genes. Instead, the continuous presence of GATA1, FOG1, and NuRD is required to maintain lineage fidelity throughout MK-erythroid ontogeny.