Adolescence is a transitional period of physical and behavioral development between childhood and adulthood. Puberty is a distinct period of sexual maturation that occurs during adolescence. Since the advent of magnetic resonance imaging (MRI), human studies have largely examined neurodevelopment in the context of age. A breadth of animal findings suggest that sex hormones continue to influence the brain beyond the prenatal period, with both organizational and activational effects occurring during puberty. Given the animal evidence, human MRI research has also set out to determine how puberty may influence otherwise known patterns of age-related neurodevelopment. Here we review structural-based MRI studies and show that pubertal maturation is a key variable to consider in elucidating sex- and individual- based differences in patterns of human brain development. We also highlight the continuing challenges faced, as well as future considerations, for this vital avenue of research.