Telomere length (TL) is an important cellular marker of biological aging impacting the brain and heart. However, how it is related to the brain (e.g., cognitive function and neuroanatomic architecture), and how these relationships may vary by sex and reproductive status, is not well established. Here we assessed the association between leukocyte TL and memory circuitry regional brain volumes and memory performance in early midlife, in relation to sex and reproductive status. Participants (N = 198; 95 females, 103 males; ages 45-55) underwent structural MRI and neuropsychological assessments of verbal, associative, and working memory. Overall, shorter TL was associated with smaller white matter volume in the parahippocampal gyrus and dorsolateral prefrontal cortex. In males, shorter TL was associated with worse working memory performance and corresponding smaller white matter volumes in the parahippocampal gyrus, anterior cingulate cortex, and dorsolateral prefrontal cortex. In females, the impact of cellular aging was revealed over the menopausal transition. In postmenopausal females, shorter TL was associated with poor associative memory performance and smaller grey matter volume in the right hippocampus. In contrast, TL was not related to memory performance or grey and white matter volumes in any memory circuitry region in pre/perimenopausal females. Results demonstrated that shorter TL is associated with worse memory function and smaller volume in memory circuitry regions in early midlife, an association that differs by sex and reproductive status. Taken together, TL may serve as an early indicator of sex-dependent brain abnormalities in early midlife.