From the Departments of Surgery (Deban, Beckett, Razek, Khwaja), Critical Care Medicine (Khwaja) and Nephrology (Iqbal), McGill University Health Centre; Faculty of Medicine Molson Informatics Unit (Posel, Fleiszer), McGill University, Montréal, Que.
Can J Surg. 2023 Apr 21;66(2):E212-E218. doi: 10.1503/cjs.003121. Print 2023 Mar-Apr.
Virtual patient simulations are interactive, computer-based cases. We designed scenarios based on the McGill Simulation Complexity Score (MSCS), a previously described objective complexity score. We aimed to establish validity of the MSCS and introduce a novel learning tool in trauma education at our institution.
After design of an easy and difficult patient scenario, we randomized medical students and residents to each perform 1 of the 2 scenarios. We conducted a 2-way analysis of variance of training level (medical student, resident) and scenario complexity (easy, difficult) to assess their effects on virtual time, the number of steps taken in the scenario, beneficial and harmful actions, and the ratio of beneficial over harmful actions.
Virtual patient scenarios were successfully designed using the MSCS. Twenty-four medical students and 12 residents participated in the easy scenario (MSCS = 3), and 27 medical students and 12 residents did the difficult scenario (MSCS = 18). Though beneficial actions were similar between students and residents, sudents performed more harmful actions, particularly when the scenario was difficult. One virtual patient died in the easy scenario and 3 died in the difficult one (all medical students). Performance varied with level of complexity and there was significant interaction between level of training and number of steps, as well as with number of harmful actions. Decreasing performance with increasing level of complexity, as defined by the MSCS, suggests this score can accurately quantify difficulty.
We established validity of the MSCS and showed its successful application on virtual patient scenario design.
虚拟患者模拟是一种互动式的基于计算机的病例。我们基于之前描述的客观复杂程度评分——麦吉尔模拟复杂度评分(MSCS)来设计场景。我们旨在确定 MSCS 的有效性,并在我们的机构中引入一种新的创伤教育学习工具。
在设计了一个简单和困难的患者场景后,我们随机分配医学生和住院医师进行每个场景的操作。我们进行了一个双向方差分析,以评估培训水平(医学生、住院医师)和场景复杂度(简单、困难)对虚拟时间、场景中采取的步骤数量、有益和有害操作以及有益操作与有害操作的比例的影响。
我们成功地使用 MSCS 设计了虚拟患者场景。24 名医学生和 12 名住院医师参加了简单场景(MSCS = 3),27 名医学生和 12 名住院医师参加了困难场景(MSCS = 18)。尽管学生和住院医师的有益操作相似,但学生的有害操作更多,尤其是在场景困难时。在简单场景中有一名虚拟患者死亡,而在困难场景中有 3 名患者死亡(均为医学生)。表现随复杂性的增加而变化,并且在培训水平和步骤数量之间以及在有害操作数量之间存在显著的相互作用。MSCS 定义的复杂性水平越高,表现越差,这表明该评分可以准确地量化难度。
我们确定了 MSCS 的有效性,并展示了其在虚拟患者场景设计中的成功应用。