Gardner Aimee K, Abdelfattah Kareem
Department of Surgery, School of Health Professions, Baylor College of Medicine, Houston, Texas, USA.
Department of Surgery, UT Southwestern Medical Center, Dallas, Texas, USA.
BMJ Simul Technol Enhanc Learn. 2019 Dec 24;6(1):31-34. doi: 10.1136/bmjstel-2018-000411. eCollection 2020.
Our study explores the extent to which teams are accurate assessors of their own performance and teamwork, and how simulation can help this critical skill develop over time.
Surgery residents in teams of three completed five daily simulations. After each scenario, each team reviewed their performance and jointly completed a scenario-specific team performance evaluation and a 17-item Communication and Teamwork Skills tool. Videos were rated to obtain discrepancy values. Paired-samples t-tests and mean comparisons were used to examine changes in team self-assessment accuracy and comparisons between high-performing and low-performing teams.
Resident (n=30) teams rated team performance higher than faculty across the first 3 days (p<0.01), but provided similar ratings thereafter. Agreement of team performance from day 1 to 5 significantly improved (p<0.001). Teams rated their teamwork higher than faculty across all days (p<0.01). Top performing teams provided more accurate self-assessments for both teamwork (average discrepancy 8% vs 39%) and team performance (average discrepancy 12% vs 23%).
Teams that continue to work together over time may become more accurate judges of their own performance, but do not become more accurate assessors of teamwork competencies.
我们的研究探讨了团队对自身表现和团队协作的评估准确性，以及模拟如何随着时间的推移帮助培养这项关键技能。
由三名外科住院医师组成的团队完成了为期五天的模拟。每个场景结束后，每个团队回顾其表现，并共同完成特定场景的团队表现评估以及一份包含17个项目的沟通与团队协作技能工具。对视频进行评分以获得差异值。使用配对样本t检验和均值比较来检验团队自我评估准确性的变化以及高绩效团队和低绩效团队之间的比较。
住院医师（n = 30）团队在前三天对团队表现的评分高于教员（p < 0.01），但此后提供了相似的评分。从第１天到第5天，团队表现的一致性显著提高（p < 0.001）。在所有天数中，团队对其团队协作的评分都高于教员（p < 0.01）。表现最佳的团队对团队协作（平均差异8%对39%）和团队表现（平均差异12%对23%）提供了更准确的自我评估。
随着时间的推移持续合作的团队可能会成为对自身表现更准确的评判者，但不会成为对团队协作能力更准确的评估者。
