Breast cancer is the fifth-ranked cancer globally. Despite early diagnosis and advances in treatment, breast cancer mortality is increasing. This meta-analysis aims to examine all possible prognostic factors that improve/deteriorate breast cancer-specific survival. MEDLINE, PubMed, ScienceDirect, Ovid, and Google Scholar were systematically searched until September 16, 2023. The retrieved studies from 1995 to 2022 accumulated 1,386,663 cases from 30 countries. A total of 13 out of 22 prognostic factors were significantly associated with breast cancer-specific survival. A random-effects model provided a pooled estimate of the top five poorest prognostic factors, including Stage 4 (HR = 12.12; 95% CI: 5.70, 25.76), followed by Stage 3 (HR = 3.42, 95% CI: 2.51, 4.67), a comorbidity index ≥ 3 (HR = 3.29; 95% CI: 4.52, 7.35), the poor differentiation of cancer cell histology (HR = 2.43; 95% CI: 1.79, 3.30), and undifferentiated cancer cell histology (HR = 2.24; 95% CI: 1.66, 3.01). Other survival-reducing factors include positive nodes, age, race, HER2-receptor positivity, and overweight/obesity. The top five best prognostic factors include different types of mastectomies and breast-conserving therapies (HR = 0.56; 95% CI: 0.44, 0.70), medullary histology (HR = 0.62; 95% CI: 0.53, 0.72), higher education (HR = 0.72; 95% CI: 0.68, 0.77), and a positive estrogen receptor status (HR = 0.78; 95% CI: 0.65, 0.94). Heterogeneity was observed in most studies. Data from developing countries are still scarce.