Congenital hypopituitarism is a genetically heterogeneous condition that is part of a spectrum disorder that can include holoprosencephaly. Heterozygous mutations in SIX3 cause variable holoprosencephaly in humans and mice. We identified two children with neonatal hypopituitarism and thin pituitary stalk who were doubly heterozygous for rare, likely deleterious variants in the transcription factors SIX3 and POU1F1. We used genetically engineered mice to understand the disease pathophysiology. Pou1f1 loss-of-function heterozygotes are unaffected; Six3 heterozygotes have pituitary gland dysmorphology and incompletely ossified palate; and the Six3+/-; Pou1f1+/dw double heterozygote mice have a pronounced phenotype, including pituitary growth through the palate. The interaction of Pou1f1 and Six3 in mice supports the possibility of digenic pituitary disease in children. Disruption of Six3 expression in the oral ectoderm completely ablated anterior pituitary development, and deletion of Six3 in the neural ectoderm blocked the development of the pituitary stalk and both anterior and posterior pituitary lobes. Six3 is required in both oral and neural ectodermal tissues for the activation of signaling pathways and transcription factors necessary for pituitary cell fate. These studies clarify the mechanism of SIX3 action in pituitary development and provide support for a digenic basis for hypopituitarism.