Copenhagen Academy for Medical Education and Simulation (CAMES), Rigshospitalet, Copenhagen, Denmark.
Urological Research Unit, Copenhagen University Hospital - Rigshospitalet, Copenhagen, Denmark.
Scand J Urol. 2021 Oct;55(5):399-403. doi: 10.1080/21681805.2021.1960599. Epub 2021 Aug 2.
The growing use of simulation-based training makes it necessary to develop efficient training programs in order to ensure optimal use of time and resources. Our aim was to develop and gather validity evidence for a simulation-based test in ureteronephroscopy and set a pass/fail standard for the test that will allow future mastery learning.
This study is a validation study. A test in ureteronephroscopy and stone removal on the URO Mentor™ virtual reality simulator (3D Systems, USA) was developed by two experienced urologists in order to ensure . Participants with different experience completed three standardized tasks on the simulator and simulator-generated metrics were used as outcome parameters to minimize bias and ensure a fair .
Twenty novices, 15 intermediates, and 8 experienced urologists were included in the study. Validity evidence for and was questionable with weak and mostly insignificant correlations across all four metrics (Cronbach's alpha = 0.14, = 0.15) and across the three modules (Cronbach's alpha = 0.41 ( = 0.02), 0.35 ( = 0.06), 0.10 ( = 0.35), and 0.30 ( = 0.09) for each metric, respectively). It was not possible to establish a pass/fail score for the simulation test with meaningful .
Our study showed that automatically generated simulator metrics cannot be used as a valid way of assessing competence in ureteronephroscopy. Virtual-reality simulator training could still be a valuable and patient-safe way to practice these skills, but an experienced supervisor is needed to determine when the trainee is ready to continue to supervised practice on patients.
随着基于模拟的培训的应用日益广泛，有必要开发高效的培训计划，以确保最佳利用时间和资源。我们的目标是开发和收集基于模拟的输尿管镜检查测试的有效性证据，并为该测试设定一个通过/失败标准，以便未来进行掌握学习。
本研究是一项验证性研究。两位经验丰富的泌尿科医生开发了一种基于 URO Mentor™虚拟现实模拟器（美国 3D Systems）的输尿管镜检查和取石测试，以确保. 具有不同经验的参与者在模拟器上完成三个标准化任务，模拟器生成的指标用作输出参数，以最大程度地减少偏差并确保公平.
共有 20 名新手、15 名中级和 8 名经验丰富的泌尿科医生参加了这项研究。在所有四个指标（Cronbach's alpha = 0.14， = 0.15）和三个模块（Cronbach's alpha = 0.41（ = 0.02）、0.35（ = 0.06）、0.10（ = 0.35）和 0.30（ = 0.09）中，所有四个指标和三个模块的有效性证据均存在疑问，相关性较弱且大多无统计学意义），以及在三个模块（每个指标的 Cronbach's alpha 值分别为 0.41（ = 0.02）、0.35（ = 0.06）、0.10（ = 0.35）和 0.30（ = 0.09）），均存在疑问。无法为该模拟测试建立有意义的通过/失败分数。
我们的研究表明，自动生成的模拟器指标不能作为评估输尿管镜检查能力的有效方法。虚拟现实模拟器培训仍然是一种有价值且安全的练习这些技能的方法，但需要有经验的主管来确定学员何时准备好继续在患者身上进行监督实践。
