The evolutionarily highly conserved neuropeptide oxytocin is a key mediator of social and emotional behavior in mammals, including humans. A common variant (rs53576) in the oxytocin receptor gene (OXTR) has been implicated in social-behavioral phenotypes, such as maternal sensitivity and empathy, and with neuropsychiatric disorders associated with social impairment, but the intermediate neural mechanisms are unknown. Here, we used multimodal neuroimaging in a large sample of healthy human subjects to identify structural and functional alterations in OXTR risk allele carriers and their link to temperament. Activation and interregional coupling of the amygdala during the processing of emotionally salient social cues was significantly affected by genotype. In addition, evidence for structural alterations in key oxytocinergic regions emerged, particularly in the hypothalamus. These neural characteristics predicted lower levels of reward dependence, specifically in male risk allele carriers. Our findings identify sex-dependent mechanisms impacting the structure and function of hypothalamic-limbic circuits that are of potential clinical and translational significance.