Department of Otorhinolaryngology, Institute of Science Tokyo, 1-5-45 Yushima, Bunkyo-ku, Tokyo 113-8510, Japan.
Department of Biomedical Information, Institute of Biomaterials and Bioengineering, Institute of Science Tokyo, Tokyo 101-0062, Japan.
Sensors (Basel). 2024 Nov 1;24(21):7063. doi: 10.3390/s24217063.
Augmented reality technologies provide transformative solutions in various surgical fields. Our research focuses on the use of an advanced augmented reality system that projects 3D holographic images directly into surgical footage, potentially improving the surgeon's orientation to the surgical field and lowering the cognitive load. We created a novel system that combines exoscopic surgical footage from the "ORBEYE" and displays both the surgical field and 3D holograms on a single screen. This setup enables surgeons to use the system without using head-mounted displays, instead viewing the integrated images on a 3D monitor. Thirteen surgeons and surgical assistants completed tasks with 2D and 3D graphical surgical guides. The NASA Task Load Index was used to assess mental, physical, and temporal demands. The use of 3D graphical surgical guides significantly improved performance metrics in cochlear implant surgeries by lowering mental, physical, temporal, and frustration levels. However, for Bonebridge implantation, the 2D graphical surgical guide performed better overall ( = 0.045). Participants found the augmented reality system's video latency to be imperceptible, measuring 0.13 ± 0.01 s. This advanced augmented reality system significantly improves the efficiency and precision of cochlear implant surgeries by lowering cognitive load and improving spatial orientation.
增强现实技术在各个外科领域提供了变革性的解决方案。我们的研究重点是使用先进的增强现实系统,将 3D 全息图像直接投影到手术录像中,这有可能改善外科医生对手术区域的方向感并降低认知负担。我们创建了一个新系统,该系统将来自“ORBEYE”的外显手术录像进行组合,并在单个屏幕上同时显示手术区域和 3D 全息图。这样的设置使外科医生无需使用头戴式显示器即可使用该系统,而是可以在 3D 监视器上查看集成图像。13 名外科医生和手术助手使用 2D 和 3D 图形手术指南完成了任务。使用 NASA 任务负荷指数评估了精神、身体和时间需求。使用 3D 图形手术指南可显著降低精神、身体、时间和挫败感水平,从而提高人工耳蜗手术的绩效指标。但是,对于 Bonebridge 植入手术,2D 图形手术指南总体上表现更好( = 0.045)。参与者发现增强现实系统的视频延迟可以忽略不计,为 0.13 ± 0.01 s。这个先进的增强现实系统通过降低认知负担和提高空间定向能力,显著提高了人工耳蜗手术的效率和精度。
Sensors (Basel). 2024-11-1
JAMA Otolaryngol Head Neck Surg. 2014-3
ORL J Otorhinolaryngol Relat Spec. 2021
Acta Neurochir (Wien). 2025-6-26
Langenbecks Arch Surg. 2022-9
BMC Musculoskelet Disord. 2021-5-18
Int J Oral Maxillofac Surg. 2021-6