在毕业后医学教育环境中实施标准化多源反馈计划的可行性。
Feasibility of implementing a standardized multisource feedback program in the graduate medical education environment.
作者信息
Richmond Margaret, Canavan Colleen, Holtman Matthew C, Katsufrakis Peter J
出版信息
J Grad Med Educ. 2011 Dec;3(4):511-6. doi: 10.4300/JGME-D-10-00088.1.
BACKGROUND
Multisource feedback (MSF) is emerging as a central assessment method for several medical education competencies. Planning and resource requirements for a successful implementation can be significant. Our goal is to examine barriers and challenges to a successful multisite MSF implementation, and identify the benefits of MSF as perceived by participants.
METHODS
We analyzed the 2007-2008 field trial implementation of the Assessment of Professional Behaviors, an MSF program of the National Board of Medical Examiners, conducted with 8 residency and fellowship programs at 4 institutions. We use a multimethod analysis that draws on quantitative process indicators and qualitative participant experience data. Process indicators include program attrition, completion of implementation milestones, number of participants at each site, number of MSF surveys assigned and completed, and adherence to an experimental rater training protocol. Qualitative data include communications with each program and semistructured interviews conducted with key field trial staff to elicit their experiences with implementation.
RESULTS
Several implementation challenges are identified, including communication gaps and difficulty scheduling implementation and training workshops. Participant interviews indicate several program changes that should enhance feasibility, including increasing communication and streamlining the training process.
CONCLUSIONS
Multisource feedback is a complex educational intervention that has the potential to provide users with a better understanding of performance expectations in the graduate medical education environment. Standardization of the implementation processes and tools should reduce the burden on program administrators and participants. Further study is warranted to broaden our understanding of the resource requirements for a successful MSF implementation and to show how outcomes change as MSF gains broader acceptance.
背景
多源反馈（MSF）正逐渐成为评估多种医学教育能力的核心方法。成功实施该方法所需的规划和资源可能相当可观。我们的目标是研究成功进行多地点MSF实施的障碍和挑战，并确定参与者所感受到的MSF的益处。
方法
我们分析了2007 - 2008年专业行为评估的现场试验实施情况，该评估是美国医学考试委员会的一项MSF计划，在4所机构的8个住院医师培训和专科培训项目中进行。我们采用了一种多方法分析，利用定量过程指标和定性的参与者经验数据。过程指标包括项目损耗、实施里程碑的完成情况、每个地点的参与者数量、分配和完成的MSF调查问卷数量，以及对实验评分员培训协议的遵守情况。定性数据包括与每个项目的沟通以及与关键现场试验工作人员进行的半结构化访谈，以了解他们的实施经验。
结果
确定了几个实施挑战，包括沟通差距以及安排实施和培训工作坊的困难。参与者访谈表明了一些应能提高可行性的项目变更，包括加强沟通和简化培训过程。
结论
多源反馈是一种复杂的教育干预措施，有可能让使用者更好地理解毕业后医学教育环境中的绩效期望。实施过程和工具的标准化应减轻项目管理人员和参与者的负担。有必要进行进一步研究，以拓宽我们对成功实施MSF所需资源的理解，并展示随着MSF获得更广泛认可，结果会如何变化。
Zotero 插件