Acad Med. 2024 Sep 1;99(9):1007-1015. doi: 10.1097/ACM.0000000000005690. Epub 2024 Mar 14.
To determine whether students' self-reported race/ethnicity and sex were associated with grades earned in 7 core clerkships. A person-centered approach was used to group students based on observed clerkship grade patterns. Predictors of group membership and predictive bias by race/ethnicity and sex were investigated.
Using data from 6 medical student cohorts at Johns Hopkins University School of Medicine (JHUSOM), latent class analysis was used to classify students based on clerkship grades. Multinomial logistic regression was employed to investigate if preclerkship measures and student demographic characteristics predicted clerkship performance-level groups. Marginal effects for United States Medical Licensing Exam (USMLE) Step 1 scores were obtained to assess the predictive validity of the test on group membership by race/ethnicity and sex. Predictive bias was examined by comparing multinomial logistic regression prediction errors across racial/ethnic groups.
Three clerkship performance-level groups emerged from the data: low, middle, and high. Significant predictors of group membership were race/ethnicity, sex, and USMLE Step 1 scores. Black or African American students were more likely (odds ratio [OR] = 4.26) to be low performers than White students. Black or African American (OR = 0.08) and Asian students (OR = 0.41) were less likely to be high performers than White students. Female students (OR = 2.51) were more likely to be high performers than male students. Patterns of prediction errors observed across racial/ethnic groups showed predictive bias when using USMLE Step 1 scores to predict clerkship performance-level groups.
Disparities in clerkship grades associated with race/ethnicity were found among JHUSOM students, which persisted after controlling for USMLE Step 1 scores, sex, and other preclerkship performance measures. Differential predictive validity of USMLE Step 1 exam scores and systematic error predictions by race/ethnicity show predictive bias when using USMLE Step 1 scores to predict clerkship performance across racial/ethnic groups.
确定学生自我报告的种族/族裔和性别是否与 7 项核心实习成绩相关。采用以个体为中心的方法根据观察到的实习成绩模式对学生进行分组。研究了种族/族裔和性别对群体成员的预测作用和预测偏差。
利用约翰霍普金斯大学医学院(JHUSOM)6 个医学生队列的数据,采用潜在类别分析根据实习成绩对学生进行分组。采用多项逻辑回归调查了预实习措施和学生人口统计学特征是否可以预测实习成绩水平组。通过获得美国医师执照考试(USMLE)第 1 步成绩的边际效应,评估该考试对种族/族裔和性别的群体成员的预测有效性。通过比较不同种族/族裔群体的多项逻辑回归预测误差,检查了预测偏差。
从数据中出现了三个实习成绩水平组:低、中、高。群体成员的显著预测因素是种族/族裔、性别和 USMLE 第 1 步成绩。与白人学生相比,黑人或非裔美国学生更有可能(优势比[OR] = 4.26)成为低绩效者。黑人或非裔美国学生(OR = 0.08)和亚裔学生(OR = 0.41)成为高绩效者的可能性低于白人学生。与男性学生相比,女性学生(OR = 2.51)更有可能成为高绩效者。在使用 USMLE 第 1 步成绩预测实习成绩水平组时,观察到的跨种族/族裔群体的预测误差模式表明存在预测偏差。
在 JHUSOM 学生中发现了与种族/族裔相关的实习成绩差异,在控制了 USMLE 第 1 步成绩、性别和其他预实习成绩措施后,这些差异仍然存在。USMLE 第 1 步考试成绩的差异预测有效性和按种族/族裔系统预测错误表明,在使用 USMLE 第 1 步成绩预测跨种族/族裔群体的实习成绩时存在预测偏差。