Ranking departments of family medicine: the eye of the beholder?

BACKGROUND AND OBJECTIVES

During each of the past several years, a nationally circulated periodical (US News & World Report) has provided a ranking of medical schools and their respective specialty departments. In contrast to the method used to rank medical schools, medical specialties, including family medicine, are ranked based solely on ratings by deans and senior faculty at peer schools. This study's purpose was to explore how closely this expert opinion-based process matches actual objective and quantifiable data about departmental performance.

METHODS

Available quantifiable data in the following categories were obtained: administration, academic productivity, and medical student and resident education. Based on their ranking in a category, each department was awarded one to five stars depending on the quintile they achieved (except for the dichotomous variable pertaining to the presence of a postresidency fellowship). Five stars indicate a ranking in the highest quintile.

RESULTS

In regards to success in administration, research, and residency education and production of family physicians, the departments, on average, were rated 3.4, 4.2, and 3.6 stars, respectively. Overall, half of the departments consistently ranked in the top quartile, as indicated by an average score of 4.0 to 5.0 stars.

CONCLUSIONS

Many of the departments rated highly in the US News & World Report rankings of the departments of family medicine rated very high in the areas of administration, research, and education as determined by quantifiable information. In contrast, several highly ranked departments were not rated favorably in areas usually associated with excellence in academics.