Anton Nicholas E, Anderson-Montoya Brittany, Holmstrom Amy, Obuseh Marian, Yan Yichuan, Miller Payton M, Li Wendy S, AbuHasan Qais, Yu Denny, Stefanidis Dimitrios
Department of Surgery, Indiana University School of Medicine, Indianapolis, IN 46202 USA.
Teladoc Health Inc., Harrison, NY USA.
Global Surg Educ. 2025;4(1):79. doi: 10.1007/s44186-025-00390-6. Epub 2025 Sep 13.
The purpose of this study was to identify specific simulated scenarios and events for surgeons that discretely and effectively measure non-technical skills (NTS) constructs and appropriately measure NTS using specific behavioral anchors.
Over the course of two rounds, experts in NTS accumulated a comprehensive list of simulated scenarios used at our institution to evaluate NTS. Utilizing a survey, experts were able to review scenarios, events, and behavioral anchors to evaluate their agreement with the appropriateness of the events and effectiveness of the anchors. Coefficient of variation (CV) was used to evaluate agreement between raters. The highest rated events were identified.
The CV between raters was moderate, and further inspection revealed that 86% of event ratings had discordance within ± 1 point. The highest rated events in terms of appropriateness and behavioral anchor effectiveness evaluated surgeons' leadership and communication.
In this study, experts identified three simulated events that isolate and discretely evaluate specific NTS among surgeons. In the future, these scenarios can be used to effectively evaluate surgeons' NTS.
The online version contains supplementary material available at 10.1007/s44186-025-00390-6.
本研究的目的是为外科医生确定特定的模拟场景和事件，以离散且有效地测量非技术技能（NTS）结构，并使用特定行为锚点适当地测量NTS。
在两轮过程中，NTS专家积累了我们机构用于评估NTS的模拟场景的综合列表。通过一项调查，专家们能够审查场景、事件和行为锚点，以评估他们对事件适当性和锚点有效性的认同程度。变异系数（CV）用于评估评分者之间的一致性。确定了评分最高的事件。
评分者之间的CV为中等，进一步检查发现86%的事件评分在±1分范围内存在不一致。在适当性和行为锚点有效性方面评分最高的事件评估了外科医生的领导能力和沟通能力。
在本研究中，专家们确定了三个模拟事件，用于隔离和离散评估外科医生中的特定NTS。未来，这些场景可用于有效评估外科医生的NTS。
在线版本包含可在10.1007/s44186-025-00390-6获取的补充材料。
