Copenhagen Academy for Medical Education and Simulation (CAMES), Copenhagen, Denmark.
Department of Surgery, Herlev/Gentofte Hospital, Herlev, Denmark.
J Endourol. 2021 Aug;35(8):1265-1272. doi: 10.1089/end.2020.0986. Epub 2021 Mar 10.
To investigate validity evidence for a simulator-based test in robot-assisted radical prostatectomy (RARP). The test consisted of three modules on the RobotiX Mentor VR-simulator: and . Validity evidence was investigated by using Messick's framework by including doctors with different RARP experience: novices (who had assisted for RARP), intermediates (robotic surgeons, but not RARP surgeons), or experienced (RARP surgeons). The simulator metrics were analyzed, and Cronbach's alpha and generalizability theory were used to explore reliability. Intergroup comparisons were done with mixed-model, repeated measurement analysis of variance and the correlation between the number of robotic procedures and the mean test score were examined. A pass/fail score was established by using the contrasting groups' method. Ten novices, 11 intermediates, and 6 experienced RARP surgeons were included. Six metrics could discriminate between groups and showed acceptable internal consistency reliability, Cronbach's alpha = 0.49, < 0.001. Test-retest reliability was 0.75, 0.85, and 0.90 for one, two, and three repetitions of tests, respectively. Six metrics were combined into a simulator score that could discriminate between all three groups, = 0.002, < 0.001, and = 0.029 for novices intermediates, novices experienced, and intermediates experienced, respectively. Total number of robotic operations and the mean score of the three repetitions were significantly correlated, Pearson's = 0.74, < 0.001. This study provides validity evidence for a simulator-based test in RARP. We determined a pass/fail level that can be used to ensure competency before proceeding to supervised clinical training.
研究机器人辅助根治性前列腺切除术（RARP）中基于模拟器的测试的有效性证据。该测试由 RobotiX Mentor VR 模拟器上的三个模块组成： 和 。通过使用 Messick 框架，包括具有不同 RARP 经验的医生，包括新手（曾协助过 RARP）、中级（机器人外科医生，但不是 RARP 外科医生）或经验丰富的医生（RARP 外科医生），研究了有效性证据。分析了模拟器指标，并使用 Cronbach 的 alpha 和概化理论来探索可靠性。使用混合模型、重复测量方差分析进行组间比较，并检查机器人手术次数与平均测试分数之间的相关性。使用对比组的方法建立通过/失败分数。纳入 10 名新手、11 名中级和 6 名经验丰富的 RARP 外科医生。六个指标可以区分组间，表现出可接受的内部一致性可靠性，Cronbach 的 alpha = 0.49， < 0.001。测试-重测信度分别为 1、2 和 3 次测试的 0.75、0.85 和 0.90。六个指标组合成一个模拟器得分，可以区分所有三组， = 0.002， < 0.001 和 = 0.029 用于新手 中级、新手 经验丰富和中级 经验丰富，分别。总机器人手术次数和三次重复的平均分数显着相关，Pearson's = 0.74， < 0.001。本研究为 RARP 中基于模拟器的测试提供了有效性证据。我们确定了一个通过/失败的水平，可以在进行监督临床培训之前确保胜任力。
