Fida Benish, Cutolo Fabrizio, di Franco Gregorio, Ferrari Mauro, Ferrari Vincenzo
Department of Information Engineering, University of Pisa, Pisa, Italy.
Department of Translational Research and New Technologies in Medicine and Surgery, EndoCAS Center, University of Pisa, Pisa, Italy.
Updates Surg. 2018 Sep;70(3):389-400. doi: 10.1007/s13304-018-0567-8. Epub 2018 Jul 13.
Augmented reality (AR) has been successfully providing surgeons an extensive visual information of surgical anatomy to assist them throughout the procedure. AR allows surgeons to view surgical field through the superimposed 3D virtual model of anatomical details. However, open surgery presents new challenges. This study provides a comprehensive overview of the available literature regarding the use of AR in open surgery, both in clinical and simulated settings. In this way, we aim to analyze the current trends and solutions to help developers and end/users discuss and understand benefits and shortcomings of these systems in open surgery. We performed a PubMed search of the available literature updated to January 2018 using the terms (1) "augmented reality" AND "open surgery", (2) "augmented reality" AND "surgery" NOT "laparoscopic" NOT "laparoscope" NOT "robotic", (3) "mixed reality" AND "open surgery", (4) "mixed reality" AND "surgery" NOT "laparoscopic" NOT "laparoscope" NOT "robotic". The aspects evaluated were the following: real data source, virtual data source, visualization processing modality, tracking modality, registration technique, and AR display type. The initial search yielded 502 studies. After removing the duplicates and by reading abstracts, a total of 13 relevant studies were chosen. In 1 out of 13 studies, in vitro experiments were performed, while the rest of the studies were carried out in a clinical setting including pancreatic, hepatobiliary, and urogenital surgeries. AR system in open surgery appears as a versatile and reliable tool in the operating room. However, some technological limitations need to be addressed before implementing it into the routine practice.
增强现实(AR)已成功为外科医生提供手术解剖结构的广泛视觉信息,以在整个手术过程中协助他们。AR使外科医生能够通过叠加的解剖细节3D虚拟模型查看手术区域。然而,开放手术带来了新的挑战。本研究全面概述了关于在临床和模拟环境中开放手术中使用AR的现有文献。通过这种方式,我们旨在分析当前的趋势和解决方案,以帮助开发者和终端用户讨论并理解这些系统在开放手术中的优缺点。我们使用以下检索词在PubMed上搜索截至2018年1月的现有文献:(1)“增强现实”和“开放手术”;(2)“增强现实”和“手术”但不包括“腹腔镜”“腹腔镜检查”“机器人手术”;(3)“混合现实”和“开放手术”;(4)“混合现实”和“手术”但不包括“腹腔镜”“腹腔镜检查”“机器人手术”。评估的方面如下:真实数据源、虚拟数据源、可视化处理方式、跟踪方式、配准技术和AR显示类型。初步检索产生了502项研究。在去除重复项并阅读摘要后,共选择了13项相关研究。在13项研究中的1项中进行了体外实验,其余研究在临床环境中进行,包括胰腺、肝胆和泌尿生殖系统手术。开放手术中的AR系统在手术室中似乎是一种通用且可靠的工具。然而,在将其应用于常规实践之前,需要解决一些技术限制。