基于投影仪的增强现实导航系统在计算机辅助手术中的应用。

A Projector-Based Augmented Reality Navigation System for Computer-Assisted Surgery.

机构信息

Institute of Forming Technology & Equipment, Shanghai Jiao Tong University, Shanghai 200030, China.

Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai 200240, China.

出版信息

Sensors (Basel). 2021 Apr 22;21(9):2931. doi: 10.3390/s21092931.

Abstract

In the medical field, guidance to follow the surgical plan is crucial. Image overlay projection is a solution to link the surgical plan with the patient. It realizes augmented reality (AR) by projecting computer-generated image on the surface of the target through a projector, which can visualize additional information to the scene. By overlaying anatomical information or surgical plans on the surgery area, projection helps to enhance the surgeon's understanding of the anatomical structure, and intuitively visualizes the surgical target and key structures of the operation, and avoid the surgeon's sight diversion between monitor and patient. However, it still remains a challenge to project the surgical navigation information on the target precisely and efficiently. In this study, we propose a projector-based surgical navigation system. Through the gray code-based calibration method, the projector can be calibrated with a camera and then be integrated with an optical spatial locator, so that the navigation information of the operation can be accurately projected onto the target area. We validated the projection accuracy of the system through back projection, with average projection error of 3.37 pixels in direction and 1.51 pixels in direction, and model projection with an average position error of 1.03 ± 0.43 mm, and carried out puncture experiments using the system with correct rate of 99%, and qualitatively analyzed the system's performance through the questionnaire. The results demonstrate the efficacy of our proposed AR system.

摘要

在医学领域,遵循手术计划的指导至关重要。图像叠加投影是将手术计划与患者联系起来的一种解决方案。它通过投影仪将计算机生成的图像投射到目标表面上,实现增强现实(AR),可以向场景中可视化附加信息。通过将解剖信息或手术计划叠加在手术区域上,投影有助于增强外科医生对解剖结构的理解,并直观地可视化手术目标和操作的关键结构,避免外科医生在监视器和患者之间视线转移。然而,仍然存在如何将手术导航信息精确、有效地投影到目标上的挑战。在本研究中,我们提出了一种基于投影仪的手术导航系统。通过基于格雷码的校准方法,可以对投影仪进行与相机的校准,然后将其与光学空间定位器集成,从而可以将手术的导航信息准确地投影到目标区域。我们通过反向投影验证了系统的投影精度,在 方向上的平均投影误差为 3.37 像素,在 方向上的平均投影误差为 1.51 像素,模型投影的平均位置误差为 1.03±0.43 毫米,并使用该系统进行了穿刺实验,准确率为 99%,通过问卷调查定性分析了系统的性能。结果表明,我们提出的 AR 系统是有效的。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6b59/8122285/8af0bf435e5f/sensors-21-02931-g001.jpg

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索