Le2i Laboratory, University of Burgundy-Franche Comté.
Otolaryngology-Head and Neck Surgery Department, University Hospital of Dijon, Dijon, France.
Otol Neurotol. 2018 Sep;39(8):931-939. doi: 10.1097/MAO.0000000000001922.
HYPOTHESIS: Augmented reality (AR) may enhance otologic procedures by providing sub-millimetric accuracy and allowing the unification of information in a single screen. BACKGROUND: Several issues related to otologic procedures can be addressed through an AR system by providing sub-millimetric precision, supplying a global view of the middle ear cleft, and advantageously unifying the information in a single screen. The AR system is obtained by combining otoendoscopy with temporal bone computer tomography (CT). METHODS: Four human temporal bone specimens were explored by high-resolution CT-scan and dynamic otoendoscopy with video recordings. The initialization of the system consisted of a semi-automatic registration between the otoendoscopic video and the 3D CT-scan reconstruction of the middle ear. Endoscope movements were estimated by several computer vision techniques (feature detectors/descriptors and optical flow) and used to warp the CT-scan to keep the correspondence with the otoendoscopic video. RESULTS: The system maintained synchronization between the CT-scan image and the otoendoscopic video in all experiments during slow and rapid (5-10 mm/s) endoscope movements. Among tested algorithms, two feature-based methods, scale-invariant feature transform (SIFT); and speeded up robust features (SURF), provided sub-millimeter mean tracking errors (0.38 ± 0.53 mm and 0.20 ± 0.16 mm, respectively) and an adequate image refresh rate (11 and 17 frames per second, respectively) after 2 minutes of procedure with continuous endoscope movements. CONCLUSION: A precise augmented reality combining video and 3D CT-scan data can be applied to otoendoscopy without the use of conventional neuronavigation tracking thanks to computer vision algorithms.
假设:增强现实(AR)技术可以通过提供亚毫米级精度并在单个屏幕上统一信息,从而增强耳科手术。
背景:通过 AR 系统提供亚毫米级精度,提供中耳裂隙的全局视图,并有利地将信息统一在单个屏幕上,可以解决与耳科手术相关的几个问题。AR 系统通过将耳内镜与颞骨计算机断层扫描(CT)相结合获得。
方法:对 4 个人类颞骨标本进行高分辨率 CT 扫描和动态耳内镜检查,并进行视频记录。系统的初始化包括耳内镜视频和中耳 3D CT 扫描重建之间的半自动配准。通过几种计算机视觉技术(特征检测器/描述符和光流)估计内窥镜运动,并使用这些技术来对 CT 扫描进行变形,以保持与耳内镜视频的对应关系。
结果:在所有实验中,内窥镜运动缓慢和快速(5-10mm/s)时,系统在所有实验中都保持了 CT 扫描图像和耳内镜视频之间的同步。在测试的算法中,两种基于特征的方法,尺度不变特征变换(SIFT)和加速稳健特征(SURF),在连续内窥镜运动 2 分钟后提供了亚毫米级的平均跟踪误差(分别为 0.38±0.53mm 和 0.20±0.16mm)和足够的图像刷新率(分别为 11 和 17 帧/秒)。
结论:一种精确的增强现实技术,将视频和 3D CT 扫描数据结合在一起,可以应用于耳内镜检查,而无需使用传统的神经导航跟踪,这要归功于计算机视觉算法。
Otol Neurotol. 2022-2-1
Neuroradiology. 1993
J Med Ext Real. 2024-7-9
Evid Based Complement Alternat Med. 2022-5-11