Department of Biomedical Engineering, School of Medicine, Tsinghua University, Beijing, China.
Adv Exp Med Biol. 2018;1093:193-205. doi: 10.1007/978-981-13-1396-7_16.
Augmented reality (AR) techniques play an important role in the field of minimally invasive surgery for orthopedics. AR can improve the hand-eye coordination by providing surgeons with the merged surgical scene, which enables surgeons to perform surgical operations more easily. To display the navigation information in the AR scene, medical image processing and three-dimensional (3D) visualization of the important anatomical structures are required. As a promising 3D display technique, integral videography (IV) can produce an autostereoscopic image with full parallax and continuous viewing points. Moreover, IV-based 3D AR navigation technique is proposed to present intuitive scene and has been applied in orthopedics, including oral surgery and spine surgery. The accurate patient-image registration, as well as the real-time target tracking for surgical tools and the patient, can be achieved. This paper overviews IV-based AR navigation and the applications in orthopedics, discusses the infrastructure required for successful implementation of IV-based approaches, and outlines the challenges that must be overcome for IV-based AR navigation to advance further development.
增强现实（AR）技术在骨科微创手术领域中起着重要作用。AR 通过提供合并的手术场景来提高手眼协调能力，使外科医生能够更轻松地进行手术操作。为了在 AR 场景中显示导航信息，需要进行医学图像处理和重要解剖结构的三维（3D）可视化。作为一种很有前途的 3D 显示技术，积分成像（IV）可以产生具有全视差和连续视点的自动立体图像。此外，提出了基于 IV 的 3D AR 导航技术来呈现直观的场景，并已应用于骨科，包括口腔外科和脊柱外科。可以实现精确的患者图像配准，以及对手术工具和患者的实时目标跟踪。本文综述了基于 IV 的 AR 导航及其在骨科中的应用，讨论了成功实施基于 IV 的方法所需的基础设施，并概述了基于 IV 的 AR 导航要进一步发展必须克服的挑战。
