University of California, San Francisco, Department of Emergency Medicine, San Francisco, California.
West J Emerg Med. 2023 Feb 27;24(2):259-263. doi: 10.5811/westjem.2022.12.56137.
The Standardized Letter of Evaluation (SLOE) is an emergency medicine (EM)-specific assessment designed to help EM residency programs differentiate applicants. We became interested in SLOE-narrative language referencing personality when we observed less enthusiasm for applicants described as "quiet" in their SLOEs. In this study our objective was to compare how quiet-labeled, EM-bound applicants were ranked compared to their non-quiet peers in the global assessment (GA) and anticipated rank list (ARL) categories in the SLOE.
We conducted a planned subgroup analysis of a retrospective cohort study of all core EM clerkship SLOEs submitted to one, four-year academic EM residency program in the 2016-2017 recruitment cycle. We compared SLOEs of applicants who were described as "quiet," "shy," and/or "reserved" - collectively referred to as "quiet" - to SLOEs from all other applicants, referred to as "non-quiet." We compared frequencies of quiet to non-quiet students in GA and ARL categories using chi-square goodness-of-fit tests with a rejection criteria (alpha) of 0.05.
We reviewed 1,582 SLOEs from 696 applicants. Of these, 120 SLOEs described quiet applicants. The distributions of quiet and non-quiet applicants across GA and ARL categories were significantly different (P < 0.001). Quiet applicants were less likely than non-quiet applicants to be ranked in the top 10% and top one-third GA categories combined (31% vs 60%) and more likely to be in the middle one-third category (58% vs 32%). For ARL, quiet applicants were also less likely to be ranked in the top 10% and top one-third categories combined (33% vs 58%) and more likely to be in the middle one-third category (50% vs 31%).
Emergency medicine-bound students described as quiet in their SLOEs were less likely to be ranked in the top GA and ARL categories compared to non-quiet students. More research is needed to determine the cause of these ranking disparities and address potential biases in teaching and assessment practices.
标准化评估信函(SLOE)是一种专为急诊医学(EM)设计的评估工具,旨在帮助 EM 住院医师项目区分申请人。当我们观察到 SLOE 中对被描述为“安静”的申请人的兴趣降低时,我们开始关注 SLOE 中提到个性的叙事语言。在这项研究中,我们的目的是比较在 SLOE 的整体评估(GA)和预期排名列表(ARL)类别中,被标记为“安静”的 EM 定向申请人与非安静同行的排名。
我们对一个为期四年的学术 EM 住院医师项目在 2016-2017 年招生周期中提交的所有核心 EM 实习 SLOE 进行了回顾性队列研究的计划亚组分析。我们将被描述为“安静”、“害羞”和/或“内敛”的申请人(统称为“安静”)的 SLOE 与所有其他申请人(称为“非安静”)的 SLOE 进行了比较。我们使用卡方拟合优度检验比较 GA 和 ARL 类别中安静和非安静学生的频率,拒绝标准(alpha)为 0.05。
我们审查了 696 名申请人的 1582 份 SLOE。其中,120 份 SLOE 描述了安静的申请人。GA 和 ARL 类别中安静和非安静申请人的分布差异显著(P < 0.001)。与非安静申请人相比,安静申请人被列入 GA 前 10%和前三分之一的综合排名的可能性较小(31%对 60%),而被列入中间三分之一的可能性较大(58%对 32%)。对于 ARL,安静申请人也不太可能被列入前 10%和前三分之一的综合排名(33%对 58%),而更有可能被列入中间三分之一的排名(50%对 31%)。
与非安静申请人相比,在 SLOE 中被描述为安静的 EM 定向学生在 GA 和 ARL 排名较高的类别中排名较低。需要进一步研究确定这些排名差异的原因,并解决教学和评估实践中的潜在偏见。