Gender disparities in academic promotion and leadership are well documented. Scholarly impact is essential for promotion. The Hirsch-index (h-index) is a measure of impact using number of publications and citations. We sought to (i) evaluate breast surgery fellowship faculty in North America by academic rank and research impact using the h-index, (ii) determine whether there is a gender difference in scholarly productivity, and (iii) determine the relationship between academic rank, h-index, and gender. A retrospective cross-sectional study of h-index and academic rank disparity in breast surgery faculty by gender was performed. We reviewed the faculty of Society of Surgical Oncology-accredited breast surgery fellowships in February 2019. Rank, gender, academic appointment, years in practice, program directorship, National Cancer Institute-designated cancer center association, size of the program, and h-index (via Scopus) were recorded. Univariate and multiple linear regression analyses were performed. Fifty-two programs were identified, and 209 faculty had an h-index. Of them, 69.9% were women and 30.1% were men. h-index increased with academic rank although there was considerable overlap between ranks. Women were underrepresented at the professor level (46.4%), but accounted for the majority of assistant professors (91.5%,  < 0.001), and program directors (70.7%). Men professors had a significantly higher mean h-index than women professors,  < 0.001. However, women associate professors had a higher mean h-index than men, but this did not reach significance. Mean h-index increased with increasing rank among breast surgery faculty for both genders. Average h-index was significantly higher for men professors compared to women professors. No significant gender difference in h-index was found for assistant professors. For associate professors, h-index for women was higher than for men. Women are underrepresented at higher academic ranks despite forming the majority of breast surgical teaching faculty.