Andersen Daniel S, Cabrera Maria E, Rojas-Muñoz Edgar J, Popescu Voicu S, Gonzalez Glebys T, Mullis Brian, Marley Sherri, Zarzaur Ben L, Wachs Juan P
From the Departments of Computer Science (D.S.A., V.S.P.) and Industrial Engineering (M.E.C., E.J.R.M., G.T.G., J.P.W.), Purdue University, West Lafayette; and Indiana University, School of Medicine (B.M., S.M., B.L.Z.), Bloomington, IN.
Simul Healthc. 2019 Feb;14(1):59-66. doi: 10.1097/SIH.0000000000000334.
INTRODUCTION: Surgical telementoring connects expert mentors with trainees performing urgent care in austere environments. However, such environments impose unreliable network quality, with significant latency and low bandwidth. We have developed an augmented reality telementoring system that includes future step visualization of the medical procedure. Pregenerated video instructions of the procedure are dynamically overlaid onto the trainee's view of the operating field when the network connection with a mentor is unreliable. METHODS: Our future step visualization uses a tablet suspended above the patient's body, through which the trainee views the operating field. Before trainee use, an expert records a "future library" of step-by-step video footage of the operation. Videos are displayed to the trainee as semitransparent graphical overlays. We conducted a study where participants completed a cricothyroidotomy under telementored guidance. Participants used one of two telementoring conditions: conventional telestrator or our system with future step visualization. During the operation, the connection between trainee and mentor was bandwidth throttled. Recorded metrics were idle time ratio, recall error, and task performance. RESULTS: Participants in the future step visualization condition had 48% smaller idle time ratio (14.5% vs. 27.9%, P < 0.001), 26% less recall error (119 vs. 161, P = 0.042), and 10% higher task performance scores (rater 1 = 90.83 vs. 81.88, P = 0.008; rater 2 = 88.54 vs. 79.17, P = 0.042) than participants in the telestrator condition. CONCLUSIONS: Future step visualization in surgical telementoring is an important fallback mechanism when trainee/mentor network connection is poor, and it is a key step towards semiautonomous and then completely mentor-free medical assistance systems.
引言:手术远程指导可将专家导师与在艰苦环境中进行紧急护理的学员联系起来。然而,此类环境的网络质量不可靠,存在显著延迟且带宽较低。我们开发了一种增强现实远程指导系统,该系统包括医疗程序的未来步骤可视化。当与导师的网络连接不可靠时,预先生成的程序视频指令会动态叠加到学员对手术区域的视野上。 方法:我们的未来步骤可视化使用悬挂在患者身体上方的平板电脑,学员通过它查看手术区域。在学员使用之前,专家会录制手术的分步视频“未来库”。视频以半透明图形叠加的形式显示给学员。我们进行了一项研究,让参与者在远程指导下完成环甲膜切开术。参与者使用两种远程指导条件之一:传统的电子绘图板或我们具有未来步骤可视化的系统。在手术过程中,学员与导师之间的连接进行了带宽限制。记录的指标有空闲时间比率、回忆错误和任务表现。 结果:未来步骤可视化条件下的参与者的空闲时间比率小48%(14.5%对27.9%,P<0.001),回忆错误少26%(119对161,P = 0.042),任务表现得分高10%(评分者1 = 90.83对81.88,P = 0.008;评分者2 = 88.54对79.17,P = 0.042),高于电子绘图板条件下的参与者。 结论:当学员/导师网络连接不佳时,手术远程指导中的未来步骤可视化是一种重要的备用机制,并且是迈向半自主进而完全无需导师的医疗辅助系统的关键一步。
Simul Healthc. 2019-2
Stud Health Technol Inform. 2016
Mil Med. 2019-3-1
Medicina (B Aires). 2013
Stud Health Technol Inform. 2004
JMIR Biomed Eng. 2023-3-24
Korean J Med Educ. 2024-3
JMIR Mhealth Uhealth. 2023-4-18
Surg Innov. 2023-6
Sensors (Basel). 2022-6-17