University of Erfurt, Educational Research and Methodology, Erfurt, Germany.
University of Erfurt, Educational Research and Methodology, Erfurt, Germany.
Patient Educ Couns. 2022 May;105(5):1283-1289. doi: 10.1016/j.pec.2021.08.020. Epub 2021 Aug 24.
We developed and evaluated the Video-Based Assessment of Medical Communication Competence (VA-MeCo), a construct-driven situational judgement test measuring medical students' communication competence in patient encounters.
In the construction phase, we conducted two expert studies (n = 6, n = 13) to ensure curricular and content validity and sufficient expert agreement on the answer key. In the evaluation phase, we conducted a cognitive pre-test (n = 12) and a pilot study (n = 117) with medical students to evaluate test usability and acceptance, item statistics and test reliability depending on the applied scoring method (raw consensus vs. pairwise comparison scoring).
The results of the expert interviews indicated good curricular and content validity. Expert agreement on the answer key was high (ICCs> .86). The pilot study showed favourable usability and acceptance by students. Irrespective of the scoring method, reliability for the complete test (Cronbach's α >.93) and its subscales (α >.83) was high.
There is promising evidence that medical communication competence can be validly and reliably measured using a construct-driven and video-based situational judgement test.
Video-based SJTs allow efficient online assessment of medical communication competence and are well accepted by students and educators.
我们开发并评估了基于视频的医学沟通能力评估（VA-MeCo），这是一种基于结构的情景判断测试，用于衡量医学生在医患互动中的沟通能力。
在构建阶段，我们进行了两项专家研究（n=6，n=13），以确保课程和内容的有效性以及答案关键项上足够的专家一致性。在评估阶段，我们对医学生进行了认知预测试（n=12）和试点研究（n=117），以评估测试的可用性和可接受性、项目统计数据以及根据应用的评分方法（原始共识与成对比较评分）的测试可靠性。
专家访谈的结果表明课程和内容具有良好的有效性。答案关键项的专家一致性很高（ICC>.86）。试点研究表明学生对其具有良好的可用性和接受度。无论采用哪种评分方法，整个测试（Cronbach's α>.93）及其子量表（α>.83）的可靠性都很高。
有有希望的证据表明，使用基于结构和基于视频的情景判断测试可以有效地、可靠地衡量医学沟通能力。
基于视频的 SJTs 允许对医学沟通能力进行高效的在线评估，并且受到学生和教育者的欢迎。
