M.J. Cullen is senior director of assessment, evaluation, and research for graduate medical education, University of Minnesota Medical School, Minneapolis, Minnesota; ORCID: https://orcid.org/0000-0002-4755-4276 .
C. Zhang was a graduate student, Industrial/Organizational Psychology Program, University of Minnesota-Twin Cities, Minneapolis, Minnesota, at the time of the study. The author is now a research scientist, Amazon, Alexandria, Virginia; ORCID: http://orcid.org/0000-0001-6975-5653 .
Acad Med. 2022 Oct 1;97(10):1494-1503. doi: 10.1097/ACM.0000000000004756. Epub 2022 Sep 23.
To determine whether overall situational judgment test (SJT) scores are associated with programs' clinical competency committee (CCC) ratings of trainee professionalism, any concerning behavior, and concerning behavior requiring active remediation at 2 time periods.
In fall 2019, trainees from 17 U.S. programs (16 residency, 1 fellowship) took an online 15-scenario SJT developed to measure 7 dimensions of professionalism. CCC midyear and year-end (6 months and 1 year following SJT completion, respectively) professionalism scores and concern ratings were gathered for academic year 2019-2020. Analyses were conducted to determine whether overall SJT scores related to overall professionalism ratings, trainees displaying any concerns, and trainees requiring active remediation at both time periods.
Overall SJT scores correlated positively with midyear and year-end overall professionalism ratings ( r = .21 and .14, P < .001 and = .03, respectively). Holding gender and race/ethnicity constant, a 1 standard deviation (SD) increase in overall SJT score was associated with a .20 SD increase in overall professionalism ratings at midyear ( P = .005) and a .22 SD increase at year-end ( P = .001). Holding gender and race/ethnicity constant, a 1 SD increase in overall SJT score decreased the odds of a trainee displaying any concerns by 37% (odds ratio [OR] 95% confidence interval [CI]: [.44, .87], P = .006) at midyear and 34% (OR 95% CI: [.46, .95], P = .025) at year-end and decreased the odds of a trainee requiring active remediation by 51% (OR 95% CI: [.25, .90], P = .02) at midyear.
Overall SJT scores correlated positively with midyear and year-end overall professionalism ratings and were associated with whether trainees exhibited any concerning behavior at midyear and year-end and whether trainees needed active remediation at midyear. Future research should investigate whether other potential professionalism measures are associated with concerning trainee behavior.
确定总体情境判断测试（SJT）分数是否与项目临床能力委员会（CCC）对学员专业精神的评分、任何关注行为以及在两个时间段需要积极纠正的关注行为有关。
2019 年秋季，来自 17 个美国项目（16 个住院医师培训项目，1 个专科医师培训项目）的学员参加了一项在线的 15 情景 SJT，旨在衡量专业精神的 7 个维度。在 2019-2020 学年，收集了 CCC 年中和年终（分别为 SJT 完成后 6 个月和 1 年）的专业精神评分和关注评级。进行了分析，以确定总体 SJT 分数是否与总体专业精神评分、表现出任何关注的学员以及在两个时间段都需要积极纠正的学员相关。
总体 SJT 分数与年中和年终的总体专业精神评分呈正相关（r=.21 和.14，P <.001 和=.03）。在控制性别和种族/民族不变的情况下，总体 SJT 分数增加 1 个标准差与年中总体专业精神评分增加 0.20 个标准差相关（P=.005），与年终增加 0.22 个标准差相关（P=.001）。在控制性别和种族/民族不变的情况下，总体 SJT 分数增加 1 个标准差使学员表现出任何关注的可能性降低 37%（优势比[OR]95%置信区间[CI]：[.44，.87]，P=.006）在年中，降低 34%（OR 95% CI：[.46，.95]，P=.025）在年终，并使需要积极纠正的学员的可能性降低 51%（OR 95% CI：[.25，.90]，P=.02）在年中。
总体 SJT 分数与年中和年终的总体专业精神评分呈正相关，与学员在年中和年终是否表现出任何关注行为以及学员在年中是否需要积极纠正有关。未来的研究应该调查其他潜在的专业精神衡量标准是否与关注学员的行为有关。
