Katz Guy, Miloslavsky Eli M, Fernandes Ana D, Bolster Marcy B
Massachusetts General Hospital, Boston.
ACR Open Rheumatol. 2024 Mar;6(3):139-144. doi: 10.1002/acr2.11638. Epub 2023 Dec 28.
Feedback from fellows-in-training (FITs) is important for faculty development and to enrich clinical teaching. We sought to evaluate the effectiveness of traditional online evaluations and a novel compiled verbal feedback mechanism.
An annual feedback system was implemented in our rheumatology division in which FITs provided verbal feedback on all faculty to a facilitator who compiled, deidentified, and shared the feedback with individual faculty members. FITs also completed standard online annual evaluations of faculty. FITs and faculty completed surveys assessing the perceived effectiveness and confidentiality of each feedback mechanism.
Thirteen of 15 eligible faculty and all 4 eligible FITs completed both surveys. Responses by FITs and faculty regarding the quality of online evaluations were generally unfavorable or neutral. Faculty responses regarding compiled verbal feedback were more favorable in all questions and significantly more favorable with respect to the feedback's ability to explain strengths (54% favorable for online evaluations vs 100% for compiled verbal feedback), the feedback's specificity (0% vs 54%), and the feedback's actionable nature (15% vs 62%). All FITs' responses regarding quality of compiled verbal feedback were favorable. FITs had concerns regarding confidentiality with both online evaluations (0% favorable) and compiled verbal feedback (25% favorable), though FITs had less concern for future faculty interactions with compiled verbal feedback (100% favorable) than with online evaluations (0% favorable).
Compiled verbal feedback by FITs produced more actionable and effective feedback for faculty, with less concerns regarding future faculty interactions compared with traditional online evaluations. Further study of this method across different programs and institutions is warranted.
培训学员(FITs)的反馈对于教师发展和丰富临床教学很重要。我们试图评估传统在线评估和一种新型汇总口头反馈机制的有效性。
我们的风湿病科实施了年度反馈系统,其中FITs向一名协调员提供对所有教师的口头反馈,该协调员汇总、去除身份识别信息并与每位教师分享反馈。FITs还完成了对教师的标准年度在线评估。FITs和教师完成了评估每种反馈机制的感知有效性和保密性的调查。
15名符合条件的教师中有13名以及所有4名符合条件的FITs完成了两项调查。FITs和教师对在线评估质量的反馈总体上是负面或中性的。教师对汇总口头反馈的反馈在所有问题上都更积极,在反馈解释优点的能力方面(在线评估为54%积极,汇总口头反馈为100%)、反馈的具体性方面(0%对54%)以及反馈的可操作性方面(15%对62%)明显更积极。所有FITs对汇总口头反馈质量的反馈都是积极的。FITs对在线评估(0%积极)和汇总口头反馈(25%积极)的保密性都有担忧,不过与在线评估(0%积极)相比,FITs对未来教师与汇总口头反馈的互动的担忧较少(100%积极)。
与传统在线评估相比,FITs的汇总口头反馈为教师提供了更具可操作性和有效性的反馈,对未来教师互动的担忧也更少。有必要在不同项目和机构中对这种方法进行进一步研究。