ORSI Academy, Melle, Belgium; Department of Urology, OLV, Aalst, Belgium; Department of Urology, University of Modena and Reggio Emilia, Modena, Italy.
ORSI Academy, Melle, Belgium; Department of Urology, OLV, Aalst, Belgium; Department of Urology, University of Modena and Reggio Emilia, Modena, Italy.
J Surg Res. 2022 Sep;277:224-234. doi: 10.1016/j.jss.2022.02.056. Epub 2022 Apr 30.
The introduction of robot-assisted surgical devices requires the application of objective performance metrics to verify performance levels.
To develop and validate (face, content, response process, and construct) the performance metrics for a robotic dissection task using a chicken model.
In a procedure characterization, we developed the performance metrics (i.e., procedure steps, errors, and critical errors) for a robotic dissection task, using a chicken model. In a modified Delphi panel, 14 experts from four European Union countries agreed on the steps, errors, and critical errors (CEs) of the task. Six experienced surgeons and eight novice urology surgeons performed the robotic dissection task twice on the chicken model. In the Delphi meeting, 100% consensus was reached on five procedure steps, 15 errors and two CEs. Novice surgeons took 20 min to complete the task on trial 1 and 14 min during trial two, whereas experts took 8.2 min and 6.5 min. On average, the Expert Group completed the task 56% faster than the Novice Group and made 46% fewer performance errors.
Sensitivity and specificity for procedure errors and time were excellent to good (i.e., 1.0-0.91) but poor (i.e., 0.5) for step metrics. The mean interrater reliability for the assessments by two robotic surgeons was 0.91 (Expert Group inter-rater reliability = 0.92 and Novice Group = 0.9).
We report evidence which supports the demonstration of face, content, and construct validity for a standard and replicable basic robotic dissection task on the chicken model.
机器人辅助手术设备的引入需要应用客观的性能指标来验证性能水平。
开发和验证（面向、内容、响应过程和结构）使用鸡模型的机器人解剖任务的性能指标。
在程序特征描述中，我们使用鸡模型为机器人解剖任务开发了性能指标（即程序步骤、错误和关键错误）。在一个修改后的 Delphi 小组中，来自四个欧盟国家的 14 名专家就任务的步骤、错误和关键错误（CEs）达成一致。六名经验丰富的外科医生和八名新手泌尿科医生在鸡模型上两次执行机器人解剖任务。在 Delphi 会议上，就五个程序步骤、15 个错误和两个 CEs 达成了 100%的共识。新手外科医生在第一次尝试中需要 20 分钟完成任务，第二次尝试中需要 14 分钟，而专家需要 8.2 分钟和 6.5 分钟。平均而言，专家组完成任务的速度比新手组快 56%，并且性能错误减少了 46%。
程序错误和时间的敏感性和特异性为优秀至良好（即 1.0-0.91），但步骤指标较差（即 0.5）。两名机器人外科医生评估的平均组内可靠性为 0.91（专家组内可靠性=0.92，新手组=0.9）。
我们报告的证据支持在鸡模型上展示标准且可重复的基本机器人解剖任务的面向、内容和结构有效性。
