Department of Cardiopulmonary Science, LSU Health New Orleans School of Allied Health Professions, 1900 Gravier Street, New Orleans, Louisiana 70112, USA.
Department of Social Medicine, Federal University of Espirito Santo, Vitoria, ES 29043-900, Brazil.
J Am Med Inform Assoc. 2018 Oct 1;25(10):1284-1291. doi: 10.1093/jamia/ocy113.
The Objective Structured Assessment of Debriefing (OSAD) is an evidence-based, 8-item tool that uses a behaviorally anchored rating scale in paper-based form to evaluate the quality of debriefing in medical education. The objective of this project was twofold: 1) to create an easy-to-use electronic format of the OSAD (eOSAD) in order to streamline data entry; and 2) to pilot its use on videoed debriefings.
The eOSAD was developed in collaboration with the LSU Health New Orleans Epidemiology Data Center using SurveyGizmo (Widgix Software, LLC, Boulder, CO, USA) software. The eOSAD was then piloted by 2 trained evaluators who rated 37 videos of faculty teams conducting pre-briefing and debriefing after a high-fidelity trauma simulation. Inter-rater reliability was assessed, and evaluators' qualitative feedback was obtained.
Inter-rater reliability was good [prebrief, intraclass correlation coefficient, ICC = 0.955 (95% CI, 0.912-0.977), P < .001; debrief, ICC = 0.853 (95% CI, 0.713-0.924), P < .001]. Qualitative feedback from evaluators found that the eOSAD was easy to complete, simple to read and add comments, and reliably stored data that were readily retrievable, enabling the smooth dissemination of information collected.
The eOSAD features a secure login, sharable internet access link for distant evaluators, and the immediate exporting of data into a secure database for future analysis. It provided convenience for end-users, produced reliable assessments among independent evaluators, and eliminated multiple sources of possible data corruption.
The eOSAD tool format advances the post debriefing evaluation of videoed inter-professional team training in high-fidelity simulation.
客观结构化讨论评估（OSAD）是一种基于证据的 8 项工具，它采用纸笔形式的行为锚定评分量表，评估医学教育中的讨论质量。该项目的目的有两个：1）创建 OSAD 的易用电子格式（eOSAD），以简化数据录入；2）在视频讨论中试用。
eOSAD 由 LSU 健康新奥尔良流行病学数据中心与 SurveyGizmo（Widgix Software，LLC，美国科罗拉多州博尔德）软件合作开发。然后，由 2 名经过培训的评估员对 37 个教师团队在高保真度创伤模拟后进行预讨论和讨论的视频进行试点评估。评估了组内相关系数（ICC）的信度，并获得了评估员的定性反馈。
ICC 评估者间信度良好[预讨论，ICC = 0.955（95%CI，0.912-0.977），P<0.001；讨论，ICC = 0.853（95%CI，0.713-0.924），P<0.001]。评估员的定性反馈发现，eOSAD 易于完成、易于阅读和添加评论、可靠地存储数据，且易于检索，从而顺利传播了收集到的信息。
eOSAD 具有安全登录、为远程评估员提供共享互联网访问链接，以及将数据立即导出到安全数据库以进行未来分析的功能。它为最终用户提供了便利，在独立评估员之间产生了可靠的评估结果，并消除了数据损坏的多个潜在来源。
eOSAD 工具格式推进了高保真模拟中的视频跨专业团队培训后的讨论评估。
