Kalbas Yannik, Jung Hoijoon, Ricklin John, Jin Ge, Li Mingjian, Rauer Thomas, Dehghani Shervin, Navab Nassir, Kim Jinman, Pape Hans-Christoph, Heining Sandro-Michael
Department of Trauma Surgery and Harald-Tscherne Laboratory, University Hospital Zurich, Ramistr. 100, 8091 Zurich, Switzerland.
School of Computer Science, University of Sydney, Camperdown, NSW 2006, Australia.
J Imaging. 2023 Feb 23;9(3):56. doi: 10.3390/jimaging9030056.
The "Remote Interactive Surgery Platform" (RISP) is an augmented reality (AR)-based platform for surgical telementoring. It builds upon recent advances of mixed reality head-mounted displays (MR-HMD) and associated immersive visualization technologies to assist the surgeon during an operation. It enables an interactive, real-time collaboration with a remote consultant by sharing the operating surgeon's field of view through the Microsoft (MS) HoloLens2 (HL2). Development of the RISP started during the Medical Augmented Reality Summer School 2021 and is currently still ongoing. It currently includes features such as three-dimensional annotations, bidirectional voice communication and interactive windows to display radiographs within the sterile field. This manuscript provides an overview of the RISP and preliminary results regarding its annotation accuracy and user experience measured with ten participants.
“远程交互式手术平台”(RISP)是一个基于增强现实(AR)的手术远程指导平台。它基于混合现实头戴式显示器(MR-HMD)和相关沉浸式可视化技术的最新进展构建,以在手术过程中协助外科医生。它通过微软(MS)HoloLens2(HL2)共享手术医生的视野,实现与远程顾问的交互式实时协作。RISP的开发始于2021年医学增强现实暑期学校,目前仍在进行中。它目前包括三维标注、双向语音通信和在无菌区域内显示X光片的交互式窗口等功能。本文提供了RISP的概述以及用十名参与者测量的其标注准确性和用户体验的初步结果。