Kim Dennis Y, Gifford Edward, Nguyen Andrew, Moazzez Ashkan, Plurad David, Keeley Jessica, Pham Xuan-Binh, Bricker Scott, Bongard Fred, Hari Danielle, de Virgilio Christian
Department of Surgery, Harbor-UCLA Medical Center, Torrance, California.
Department of Surgery, Harbor-UCLA Medical Center, Torrance, California.
J Surg Educ. 2015 Nov-Dec;72(6):e172-6. doi: 10.1016/j.jsurg.2015.08.006. Epub 2015 Sep 14.
Surgical residents' ability to screen general surgery (GS) applicants has not been previously investigated. The objective of this study was to compare surgical residents' evaluation of Electronic Residency Application Service (ERAS) applicants to that of faculty using a standardized assessment instrument.
A prospective analysis of ERAS applications using a standardized assessment tool.
A university-affiliated, academic, county GS residency program.
Before the interview day, 51 ERAS (2013-2014) applications were reviewed by 10 different assessors (6 GS faculty, including the program director, and 4 GS residents), who evaluated applicants on 10 characteristics (subjective and objective) using a 5-point Likert scale, a total score, and a Global Rating Scale that ranked candidates into deciles.
There were a total of 510 assessments. In 8 of 10 individual domains the interrater reliability (IRR) between residents and faculty was good. The IRRs of the total score and global score were excellent. The Spearman ρ between the total score and final rank list were similar for faculty (-0.558) and residents (-0.592).
The excellent IRR score between the total and global scores of faculty and residents demonstrates the reliability of GS residents in evaluating ERAS applications. The low correlations between the total score and final rank are consistent with those in previous studies, in which the interview has been demonstrated to be the most important factor in determining final selection.
此前尚未对外科住院医师筛选普通外科（GS）申请者的能力进行研究。本研究的目的是使用标准化评估工具，比较外科住院医师与教员对电子住院医师申请服务（ERAS）申请者的评估。
使用标准化评估工具对ERAS申请进行前瞻性分析。
一所大学附属的学术性县级GS住院医师培训项目。
在面试日之前，10位不同的评估者（6名GS教员，包括项目主任，以及4名GS住院医师）对51份ERAS（2013 - 2014年）申请进行了评审，他们使用5点李克特量表、总分以及将候选人排名为十分位数的总体评分量表，对申请者的10项特征（主观和客观）进行评估。
总共进行了510次评估。在10个单独领域中的8个，住院医师与教员之间的评分者间信度（IRR）良好。总分和总体评分的IRR极佳。教员（-0.558）和住院医师（-0.592）的总分与最终排名列表之间的斯皮尔曼ρ相似。
教员和住院医师的总分与总体评分之间的IRR得分极佳，证明了GS住院医师在评估ERAS申请方面的可靠性。总分与最终排名之间的低相关性与先前的研究一致，在先前研究中，面试已被证明是决定最终选拔的最重要因素。
