Elfenbein Dawn M, Sippel Rebecca S, McDonald Robert, Watson Tammy, Scarborough John E, Migaly John
Department of Surgery, University of Wisconsin, 600 Highland Ave, Madison WI 53792.
Department of Surgery, University of Wisconsin, 600 Highland Ave, Madison WI 53792.
Am J Surg. 2015 Jun;209(6):1095-101. doi: 10.1016/j.amjsurg.2014.08.042. Epub 2015 Jan 22.
The American Board of Surgery In-Training Examination (ABSITE) offers annual assessment of resident medical knowledge. We sought to determine if ongoing end-of-rotation evaluations by faculty of residents' medical knowledge correlate with ABSITE performance.
Retrospective cross-sectional study was conducted over 3 years at 2 institutions. Faculty rated residents' clinical knowledge as part of a global summative evaluation. The intraclass correlation coefficient and convergent validity between faculty evaluations and ABSITE performance were assessed.
A total of 1,562 faculty evaluations were completed for about 147 residents. There was poor agreement among faculty for each resident, with intraclass correlation coefficients of less than 0.2. Spearman's correlation coefficient was calculated for evaluations and ABSITE scores and were found to be weakly correlative at one institution and not correlated at all at the other. Finally, evaluations across quartiles of resident ABSITE scores were examined and show no correlation.
Faculty evaluations of resident medical knowledge correlate poorly with resident ABSITE performance, and should not be used as an ongoing predictive tool.
美国外科委员会住院医师培训考试（ABSITE）每年对住院医师的医学知识进行评估。我们试图确定教员对住院医师医学知识的持续轮转结束评估是否与ABSITE考试成绩相关。
在两家机构进行了为期3年的回顾性横断面研究。教员将住院医师的临床知识作为整体总结性评估的一部分进行评分。评估了教员评估与ABSITE考试成绩之间的组内相关系数和收敛效度。
共完成了约147名住院医师的1562份教员评估。教员对每位住院医师的评估一致性较差，组内相关系数小于0.2。计算了评估与ABSITE考试分数之间的斯皮尔曼相关系数，发现在一个机构中相关性较弱，在另一个机构中则完全不相关。最后，对住院医师ABSITE考试分数四分位数的评估进行了检查，未显示出相关性。
教员对住院医师医学知识的评估与住院医师ABSITE考试成绩相关性较差，不应作为一种持续的预测工具。
