Zhang Xiaohui, Otoo Elsa-Marie, Fan Yubo, Tao Chunjing, Wang Tianmiao, Rhode Kawal
IEEE Trans Biomed Eng. 2023 Apr;70(4):1413-1421. doi: 10.1109/TBME.2022.3217481. Epub 2023 Mar 21.
OBJECTIVE: Since Augmented Reality (AR) and 3D visualization have proven to be of great significance to the safety and effectiveness of surgical outcomes, will autostereoscopic 3D AR without glasses bring new opportunities for surgical navigation of laparoscopic surgery? METHODS: We used the CPD-based deformation registration algorithm and the proposed virtual view generation algorithm, realizing a deformable autostereoscopic 3D AR navigation framework for laparoscopic surgery. The depth perception and user experience of the 3D AR navigation were evaluated compared with the 2D AR display using an in-vitro porcine heart and offline clinical partial nephrectomy laparoscopic images. RESULTS: The autostereoscopic 3D AR allowed participants to have a more consistent spatial perception as well as a shorter measuring time than 2D AR with significant difference of p < 0.05. It can also improve relative depth perception for smaller distance separation of objects < = 3.28 mm. However, the autostereoscopic 3D AR perceived a worse experience compared to 2D AR in the user experience. CONCLUSION: Autostereoscopic 3D AR shows a more efficient and robust sense of spatial scale than 2D AR with better potential to shorten the operating time and improve surgical outcomes than 2D AR, but image blur and distortion are issues that must be solved to improve the perception effect. High precise registration and high fluency visualization requirements could make autostereoscopic 3D AR navigation for soft tissue more challenging. SIGNIFICANCE: Our work lays a theoretical foundation for the further development of laparoscopic surgical navigation.
目的:鉴于增强现实(AR)和3D可视化已被证明对手术结果的安全性和有效性具有重要意义,无需佩戴眼镜的自动立体3D AR是否会为腹腔镜手术的手术导航带来新机遇? 方法:我们使用基于CPD的变形配准算法和所提出的虚拟视图生成算法,实现了一种用于腹腔镜手术的可变形自动立体3D AR导航框架。使用体外猪心脏和离线临床部分肾切除术腹腔镜图像,与2D AR显示相比,评估了3D AR导航的深度感知和用户体验。 结果:与2D AR相比,自动立体3D AR使参与者具有更一致的空间感知以及更短的测量时间,p < 0.05,差异具有统计学意义。对于物体间距 <= 3.28 mm的较小距离分离,它还可以改善相对深度感知。然而,在用户体验方面,自动立体3D AR与2D AR相比感觉较差。 结论:自动立体3D AR显示出比2D AR更高效、更强大的空间尺度感,比2D AR更有潜力缩短手术时间并改善手术结果,但图像模糊和失真问题是提高感知效果必须解决的。高精度配准和高流畅度可视化要求可能使软组织的自动立体3D AR导航更具挑战性。 意义:我们的工作为腹腔镜手术导航的进一步发展奠定了理论基础。
IEEE Trans Biomed Eng. 2023-4
Int J Comput Assist Radiol Surg. 2020-5-2
Int J Comput Assist Radiol Surg. 2021-11
Int J Comput Assist Radiol Surg. 2019-4-23
Int J Comput Assist Radiol Surg. 2023-9
Comput Methods Programs Biomed. 2020-4
World J Surg Oncol. 2024-1-17
Adv Exp Med Biol. 2018
Med Image Anal. 2023-12