Buléon Clément, Mattatia Laurent, Minehart Rebecca D, Rudolph Jenny W, Lois Fernande J, Guillouet Erwan, Philippon Anne-Laure, Brissaud Olivier, Lefevre-Scelles Antoine, Benhamou Dan, Lecomte François, Group The SoFraSimS Assessment With Simulation, Bellot Anne, Crublé Isabelle, Philippot Guillaume, Vanderlinden Thierry, Batrancourt Sébastien, Boithias-Guerot Claire, Bréaud Jean, de Vries Philine, Sibert Louis, Sécheresse Thierry, Boulant Virginie, Delamarre Louis, Grillet Laurent, Jund Marianne, Mathurin Christophe, Berthod Jacques, Debien Blaise, Gacia Olivier, Der Sahakian Guillaume, Boet Sylvain, Oriot Denis, Chabot Jean-Michel
Department of Anesthesiology, Intensive Care and Perioperative Medicine, Caen Normandy University Hospital, 6th Floor, Caen, France.
Medical School, University of Caen Normandy, Caen, France.
Adv Simul (Lond). 2022 Dec 28;7(1):42. doi: 10.1186/s41077-022-00238-9.
Healthcare curricula need summative assessments relevant to and representative of clinical situations to best select and train learners. Simulation provides multiple benefits with a growing literature base proving its utility for training in a formative context. Advancing to the next step, "the use of simulation for summative assessment" requires rigorous and evidence-based development because any summative assessment is high stakes for participants, trainers, and programs. The first step of this process is to identify the baseline from which we can start.
First, using a modified nominal group technique, a task force of 34 panelists defined topics to clarify the why, how, what, when, and who for using simulation-based summative assessment (SBSA). Second, each topic was explored by a group of panelists based on state-of-the-art literature reviews technique with a snowball method to identify further references. Our goal was to identify current knowledge and potential recommendations for future directions. Results were cross-checked among groups and reviewed by an independent expert committee.
Seven topics were selected by the task force: "What can be assessed in simulation?", "Assessment tools for SBSA", "Consequences of undergoing the SBSA process", "Scenarios for SBSA", "Debriefing, video, and research for SBSA", "Trainers for SBSA", and "Implementation of SBSA in healthcare". Together, these seven explorations provide an overview of what is known and can be done with relative certainty, and what is unknown and probably needs further investigation. Based on this work, we highlighted the trustworthiness of different summative assessment-related conclusions, the remaining important problems and questions, and their consequences for participants and institutions of how SBSA is conducted.
Our results identified among the seven topics one area with robust evidence in the literature ("What can be assessed in simulation?"), three areas with evidence that require guidance by expert opinion ("Assessment tools for SBSA", "Scenarios for SBSA", "Implementation of SBSA in healthcare"), and three areas with weak or emerging evidence ("Consequences of undergoing the SBSA process", "Debriefing for SBSA", "Trainers for SBSA"). Using SBSA holds much promise, with increasing demand for this application. Due to the important stakes involved, it must be rigorously conducted and supervised. Guidelines for good practice should be formalized to help with conduct and implementation. We believe this baseline can direct future investigation and the development of guidelines.
医疗保健课程需要与临床情况相关且具有代表性的总结性评估，以便最好地选拔和培训学习者。模拟具有多种益处，越来越多的文献证明了其在形成性背景下的培训效用。进入下一步，即“将模拟用于总结性评估”需要严格且基于证据的开发，因为任何总结性评估对参与者、培训人员和项目来说都是高风险的。这个过程的第一步是确定我们可以开始的基线。
首先，使用改良的名义小组技术，一个由34名小组成员组成的特别工作组确定了一些主题，以阐明使用基于模拟的总结性评估（SBSA）的原因、方式、内容、时间和人员。其次，一组小组成员基于最新的文献综述技术并采用滚雪球法对每个主题进行探讨，以确定更多参考文献。我们的目标是确定当前的知识以及对未来方向的潜在建议。各小组之间对结果进行了交叉核对，并由一个独立的专家委员会进行了审查。
特别工作组选定了七个主题：“在模拟中可以评估什么？”“SBSA的评估工具”“经历SBSA过程的后果”“SBSA的场景”“SBSA的总结汇报、视频和研究”“SBSA的培训人员”以及“SBSA在医疗保健中的实施”。这七项探索共同提供了一个概述，即已知的、可以相对确定地完成的内容，以及未知的、可能需要进一步研究的内容。基于这项工作，我们强调了不同总结性评估相关结论的可信度、剩余的重要问题以及它们对SBSA实施方式的参与者和机构的影响。
我们的结果在这七个主题中确定了一个在文献中有充分证据的领域（“在模拟中可以评估什么？”），三个有证据但需要专家意见指导的领域（“SBSA的评估工具”“SBSA的场景”“SBSA在医疗保健中的实施”），以及三个证据薄弱或刚刚出现的领域（“经历SBSA过程的后果”“SBSA的总结汇报”“SBSA的培训人员”）。使用SBSA前景广阔，对这种应用的需求也在增加。由于涉及重大利害关系，必须严格进行和监督。应制定良好实践指南以帮助实施和执行。我们相信这个基线可以指导未来的研究和指南的制定。
