Department of Robotics and Mechatronics Engineering, DGIST, 333 Techno Jungang-Daero, Daegu 42988, Republic of Korea.
DIGITRACK Inc., Daegu, Republic of Korea.
Comput Methods Programs Biomed. 2023 Aug;238:107618. doi: 10.1016/j.cmpb.2023.107618. Epub 2023 May 21.
An augmented reality (AR)-based surgical guidance system is often used with high-magnification zoom lens systems such as a surgical microscope, particularly in neurology or otolaryngology. To superimpose the internal structures of relevant organs on the microscopy image, an accurate calibration process to obtain the camera intrinsic and hand-eye parameters of the microscope is essential. However, conventional calibration methods are unsuitable for surgical microscopes because of their narrow depth of focus at high magnifications. To realize AR-based surgical guidance with a high-magnification surgical microscope, we herein propose a new calibration method that is applicable to the highest magnification levels as well as low magnifications.
The key idea of the proposed method is to find the relationship between the focal length and the hand-eye parameters, which remains constant regardless of the magnification level. Based on this, even if the magnification changes arbitrarily during surgery, the intrinsic and hand-eye parameters are recalculated quickly and accurately with one or two pictures of the pattern. We also developed a dedicated calibration tool with a prism to take focused pattern images without interfering with the surgery.
The proposed calibration method ensured an AR error of < 1 mm for all magnification levels. In addition, the variation of focal length was within 1% regardless of the magnification level, and the corresponding variation with the conventional calibration method exceeded 20% at high magnification levels.
The comparative study showed that the proposed method has outstanding accuracy and reproducibility for a high-magnification surgical microscope. The proposed calibration method is applicable to various endoscope or microscope systems with zoom lens.
增强现实(AR)手术导航系统通常与高倍变焦镜头系统(如手术显微镜)一起使用,尤其是在神经科或耳鼻喉科。为了将相关器官的内部结构叠加到显微镜图像上,需要进行精确的校准过程以获得显微镜的相机固有参数和手眼参数。然而,传统的校准方法不适用于手术显微镜,因为其在高倍放大时景深较窄。为了在高倍手术显微镜下实现基于 AR 的手术导航,我们提出了一种新的校准方法,该方法适用于最高放大倍率和低倍率。
该方法的关键思想是找到与焦距和手眼参数之间的关系,无论放大倍率如何,这些参数保持不变。基于此,即使手术过程中放大倍率任意变化,也可以通过拍摄一张或两张图案的照片快速准确地重新计算固有参数和手眼参数。我们还开发了一种专用的校准工具,带有棱镜,可以在不干扰手术的情况下拍摄聚焦图案图像。
所提出的校准方法确保了所有放大倍率下的 AR 误差<1mm。此外,焦距的变化率无论放大倍率如何均在 1%以内,而常规校准方法的相应变化率在高放大倍率下超过 20%。
对比研究表明,该方法具有出色的准确性和可重复性,适用于带变焦镜头的各种内窥镜或显微镜系统。该校准方法适用于具有变焦镜头的各种内窥镜或显微镜系统。