Talmi Liron, Nabecker Sabine, Piquette Dominique, Mema Briseida
Department of Critical Care Medicine, Hospital for Sick Children, Toronto, Ontario, Canada.
Department of Anesthesiology and Pain Medicine, Sinai Health System, Toronto, Ontario, Canada.
ATS Sch. 2024 Jan 30;5(1):174-183. doi: 10.34197/ats-scholar.2023-0097IN. eCollection 2024 Mar.
Virtual reality (VR) simulators have revolutionized training in bronchoscopy, offering unrestricted availability in a low-stakes learning environment and frequent assessments represented by automatic scoring. The VR assessments can be used to monitor and support learners' progression. How trainees perceive these assessments needs to be clarified.
The objective of this study was to examine what assessments learners select to document and receive feedback on and what influences their decisions.
We used a sequential explanatory mixed methods strategy. All participants were pediatric critical care medicine trainees requiring competency in bronchoscopy skills. During independent simulation practice, we collected the number of learning-focused practice attempts (scores not recorded), assessment-focused practice (scores recorded and reviewed by the instructor for feedback), and the amount of time each attempt lasted. After simulation training, we conducted interviews to explore learners' perceptions of assessment.
There was no significant difference in the number of attempts for each practice type. The average time per learning-focused attempt was almost three times longer than the assessment-focused attempt (mean [standard deviation] 16 ± 1 min vs. 6 ± 3 min, respectively; < 0.05). Learners perceived documentation of their scores as high stakes and only recorded their better scores. Learners felt safer experimenting if their assessments were not recorded.
During independent practice, learners took advantage of automatic assessments generated by the VR simulator to monitor their progression. However, the recording of scores from the simulation program to document learners' trajectory to a set goal was perceived as high stakes, discouraging learners from seeking supervisor feedback.
虚拟现实(VR)模拟器彻底改变了支气管镜检查培训方式,在低风险学习环境中提供不受限制的可用性,并通过自动评分进行频繁评估。VR评估可用于监测和支持学习者的进步。学员如何看待这些评估尚需明确。
本研究的目的是调查学习者选择记录哪些评估并获得反馈,以及哪些因素影响他们的决策。
我们采用了顺序解释性混合方法策略。所有参与者均为需要具备支气管镜检查技能的儿科重症医学实习生。在独立模拟练习期间,我们收集了以学习为重点的练习尝试次数(分数未记录)、以评估为重点的练习(分数记录并由教员审核以提供反馈)以及每次尝试持续的时间。模拟训练后,我们进行了访谈以探索学习者对评估的看法。
每种练习类型的尝试次数没有显著差异。每次以学习为重点的尝试平均时间几乎是以评估为重点的尝试的三倍(分别为平均[标准差]16±1分钟和6±3分钟;<0.05)。学习者将他们分数的记录视为高风险,只记录了他们较好的分数。学习者觉得如果他们的评估不被记录,进行实验会更安全。
在独立练习期间,学习者利用VR模拟器生成的自动评估来监测自己的进步。然而,将模拟程序中的分数记录下来以记录学习者朝着设定目标的轨迹被视为高风险,这使得学习者不愿寻求主管的反馈。