Radiology Department, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital, Chinese Academy of Medical Science and Peking Union Medical College, Shuai Fu Yuan 1#, Dongcheng Dist, Beijing, 100730, China.
Medical Research Center, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital, Chinese Academy of Medical Science and Peking Union Medical College, Beijing, China.
BMC Med Educ. 2023 Aug 18;23(1):586. doi: 10.1186/s12909-023-04582-w.
Effective communication is a crucial component of radiology resident training, and many different aspects need to be explored when teaching and evaluating communication skills. To ensure that radiology residents' communication skill levels can be measured accurately, a standardized evaluation tool has been introduced. In twenty hospitals in Beijing, simulation videos have been developed as a way to assess the communication skills of radiology residents during their certification exams, to minimize evaluating biases. This study aims to assess the performance of a simulation video model in evaluating communications skills compared to the standard patient model.
This is a retrospective observational study. The performance of standard patient and simulation video models was evaluated through an eight-year examination of communication skills in radiology residents. From 2014 to 2021, communications skill tests were administered to 1003 radiology residents in 20 hospitals in Beijing. The standardized patient (SP) model was applied in 2014, and simulation videos were used from 2015 to 2021. The difficulty and discrimination radio of the tests were evaluated. The subjective survey for candidates on two models of communication skills evaluation was performed and analyzed.
The simulation video model evaluation demonstrated stable difficulty (ranging from 0.92 to 0.98) and discrimination ratio (ranging from 0.37 to 0.49), except for minor exceptions of discrimination in 2019 (0.58) and 2020 (0.20). Furthermore, the Kruskal-Wallis H test revealed no significant differences in average scores between 2016 (93.9 ± 4.6) and 2018 (94.5 ± 4.2), 2016 and 2019 (97.3 ± 3.9), 2017 (97.0 ± 5.6) and 2019, 2017 and 2020 (97.7 ± 4.7), as well as 2019 and 2020 exams (all p ≥ 0.05). In addition, candidates who responded to the survey preferred the simulation video model (with a 77.2% response rate), with 62.7% choosing it over the SP model for communication skills evaluation.
The simulation video demonstrated a stable and better acceptable construct for assessing radiology residents' communication skills.
有效的沟通是放射科住院医师培训的一个关键组成部分，在教授和评估沟通技巧时需要探索许多不同的方面。为了确保准确衡量放射科住院医师的沟通技巧水平，已经引入了一种标准化的评估工具。在北京的二十家医院中，已经开发出模拟视频，作为评估放射科住院医师在认证考试中沟通技巧的一种方式，以最大程度地减少评估偏差。本研究旨在评估模拟视频模型在评估沟通技巧方面与标准患者模型相比的表现。
这是一项回顾性观察研究。通过对 2014 年至 2021 年在北京 20 家医院进行的放射科住院医师 8 年的沟通技能考试，评估标准患者和模拟视频模型的表现。2014 年采用标准患者（SP）模型，2015 年至 2021 年采用模拟视频。评估了测试的难度和辨别率。对两种沟通技巧评估模型的候选人进行了主观调查，并进行了分析。
模拟视频模型评估显示出稳定的难度（范围从 0.92 到 0.98）和辨别率（范围从 0.37 到 0.49），除了 2019 年（0.58）和 2020 年（0.20）的辨别率略有差异。此外，Kruskal-Wallis H 检验显示，2016 年（93.9±4.6）和 2018 年（94.5±4.2）、2016 年和 2019 年（97.3±3.9）、2017 年（97.0±5.6）和 2019 年、2017 年和 2020 年（97.7±4.7）以及 2019 年和 2020 年考试之间的平均分数没有显著差异（均 p≥0.05）。此外，对调查做出回应的候选人更喜欢模拟视频模型（响应率为 77.2%），有 62.7%的人选择该模型进行沟通技巧评估，而不是标准患者模型。
模拟视频在评估放射科住院医师的沟通技能方面表现出稳定且更易于接受的结构。
