Andersen Dan, Popescu Voicu, Cabrera Maria Eugenia, Shanghavi Aditya, Mullis Brian, Marley Sherri, Gomez Gerardo, Wachs Juan P
Department of Computer Science, Purdue University, 305 North University Street, West Lafayette, IN 47907.
School of Industrial Engineering, Purdue University, 315 North Grant Street, West Lafayette, IN 47907.
Mil Med. 2017 Mar;182(S1):310-315. doi: 10.7205/MILMED-D-16-00051.
Telementoring can improve treatment of combat trauma injuries by connecting remote experienced surgeons with local less-experienced surgeons in an austere environment. Current surgical telementoring systems force the local surgeon to regularly shift focus away from the operating field to receive expert guidance, which can lead to surgery delays or even errors. The System for Telementoring with Augmented Reality (STAR) integrates expert-created annotations directly into the local surgeon's field of view. The local surgeon views the operating field by looking at a tablet display suspended between the patient and the surgeon that captures video of the surgical field. The remote surgeon remotely adds graphical annotations to the video. The annotations are sent back and displayed to the local surgeon while being automatically anchored to the operating field elements they describe. A technical evaluation demonstrates that STAR robustly anchors annotations despite tablet repositioning and occlusions. In a user study, participants used either STAR or a conventional telementoring system to precisely mark locations on a surgical simulator under a remote surgeon's guidance. Participants who used STAR completed the task with fewer focus shifts and with greater accuracy. The STAR reduces the local surgeon's need to shift attention during surgery, allowing him or her to continuously work while looking "through" the tablet screen.
远程指导可以通过在艰苦环境中将经验丰富的远程外科医生与经验较少的当地外科医生联系起来,改善战斗创伤损伤的治疗。当前的手术远程指导系统迫使当地外科医生定期将注意力从手术区域转移开,以接受专家指导,这可能导致手术延迟甚至失误。增强现实远程指导系统(STAR)将专家创建的注释直接集成到当地外科医生的视野中。当地外科医生通过查看悬挂在患者和外科医生之间的平板电脑显示屏来观察手术区域,该显示屏捕捉手术区域的视频。远程外科医生远程为视频添加图形注释。注释被发送回并显示给当地外科医生,同时自动锚定到它们所描述的手术区域元素上。一项技术评估表明,尽管平板电脑重新定位和出现遮挡,STAR仍能牢固地锚定注释。在一项用户研究中,参与者在远程外科医生的指导下,使用STAR或传统的远程指导系统在手术模拟器上精确标记位置。使用STAR的参与者完成任务时注意力转移较少,准确性更高。STAR减少了当地外科医生在手术期间转移注意力的需要,使他或她能够一边看着平板电脑屏幕一边持续工作。
Mil Med. 2019-3-1
Stud Health Technol Inform. 2016
JMIR Biomed Eng. 2023-3-24
JMIR Mhealth Uhealth. 2023-4-18
Sensors (Basel). 2022-6-17
Bioengineering (Basel). 2022-5-13