在沉浸式虚拟现实中对静态和动态光学相干断层扫描容积进行实时可视化和交互。
Real-time visualization and interaction with static and live optical coherence tomography volumes in immersive virtual reality.
作者信息
Draelos Mark, Keller Brenton, Viehland Christian, Carrasco-Zevallos Oscar M, Kuo Anthony, Izatt Joseph
机构信息
Department of Biomedical Engineering, Duke University, Durham, NC 27708, USA.
Department of Ophthalmology, Duke University Medical Center, Durham, NC 27710, USA.
出版信息
Biomed Opt Express. 2018 May 30;9(6):2825-2843. doi: 10.1364/BOE.9.002825. eCollection 2018 Jun 1.
Abstract
Virtual reality (VR) head-mounted displays are an attractive technology for viewing intrasurgical optical coherence tomography (OCT) volumes because they liberate surgeons from microscope oculars. We demonstrate real-time, interactive viewing of OCT volumes in a commercial HTC Vive immersive VR system using previously reported ray casting techniques. Furthermore, we show interactive manipulation and sectioning of volumes using handheld controllers and guidance of mock surgical procedures in porcine eyes exclusively within VR. To the best of our knowledge, we report the first immersive VR-OCT viewer with stereo ray casting volumetric renders, arbitrary sectioning planes, and live acquisition support. We believe VR-OCT volume displays will advance ophthalmic surgery towards VR-integrated surgery.
摘要
虚拟现实（VR）头戴式显示器是一种颇具吸引力的技术，可用于查看术中光学相干断层扫描（OCT）容积，因为它将外科医生从显微镜目镜中解放了出来。我们使用先前报道的光线投射技术，在商用HTC Vive沉浸式VR系统中演示了对OCT容积的实时交互式查看。此外，我们展示了在VR环境中仅使用手持控制器对猪眼容积进行交互式操作和切片，以及模拟手术过程的引导。据我们所知，我们报道了首个具有立体光线投射容积渲染、任意切片平面和实时采集支持的沉浸式VR-OCT查看器。我们相信，VR-OCT容积显示将推动眼科手术朝着VR集成手术的方向发展。
相似文献
1
Real-time visualization and interaction with static and live optical coherence tomography volumes in immersive virtual reality.在沉浸式虚拟现实中对静态和动态光学相干断层扫描容积进行实时可视化和交互。
Biomed Opt Express. 2018 May 30;9(6):2825-2843. doi: 10.1364/BOE.9.002825. eCollection 2018 Jun 1.
2
Novel microscope-integrated stereoscopic heads-up display for intrasurgical optical coherence tomography.用于术中光学相干断层扫描的新型集成显微镜立体平视显示器
Biomed Opt Express. 2016 Apr 6;7(5):1711-26. doi: 10.1364/BOE.7.001711. eCollection 2016 May 1.
3
High-Performance Virtual Reality Volume Rendering of Original Optical Coherence Tomography Point-Cloud Data Enhanced With Real-Time Ray Casting.基于实时光线投射增强的原始光学相干断层扫描点云数据的高性能虚拟现实体绘制
Transl Vis Sci Technol. 2018 Jul 9;7(4):2. doi: 10.1167/tvst.7.4.2. eCollection 2018 Jul.
4
Enhanced volumetric visualization for real time 4D intraoperative ophthalmic swept-source OCT.用于实时4D术中眼科扫频源光学相干断层扫描的增强容积可视化
Biomed Opt Express. 2016 Apr 12;7(5):1815-29. doi: 10.1364/BOE.7.001815. eCollection 2016 May 1.
5
Immersive Live Streaming of Surgery Using 360-Degree Video to Head-Mounted Virtual Reality Devices: A New Paradigm in Surgical Education.使用 360 度视频向头戴虚拟现实设备进行沉浸式手术直播：手术教育的新模式。
Surg Innov. 2023 Aug;30(4):486-492. doi: 10.1177/15533506231165828. Epub 2023 Mar 29.
6
[IMMERSIVE SURGICAL NAVIGATION USING SPATIAL INTERACTIVE VIRTUAL REALITY AND HOLOGRAPHIC AUGMENTED REALITY].[使用空间交互式虚拟现实和全息增强现实的沉浸式手术导航]
Nihon Geka Gakkai Zasshi. 2016 Sep;117(5):387-94.
7
Virtual Reality for the Assessment of Everyday Cognitive Functions in Older Adults: An Evaluation of the Virtual Reality Action Test and Two Interaction Devices in a 91-Year-Old Woman.虚拟现实用于评估老年人日常认知功能：对一名91岁女性进行的虚拟现实行动测试及两种交互设备的评估
Front Psychol. 2020 Feb 7;11:123. doi: 10.3389/fpsyg.2020.00123. eCollection 2020.
8
Handheld spectrally encoded coherence tomography and reflectometry for motion-corrected ophthalmic optical coherence tomography and optical coherence tomography angiography.用于运动校正眼科光学相干断层扫描和光学相干断层扫描血管造影的手持式光谱编码相干断层扫描和反射测量法。
Neurophotonics. 2019 Oct;6(4):041102. doi: 10.1117/1.NPh.6.4.041102. Epub 2019 Jul 3.
9
Immersive virtual reality as a teaching tool for neuroanatomy.沉浸式虚拟现实作为神经解剖学的教学工具。
Int Forum Allergy Rhinol. 2017 Oct;7(10):1006-1013. doi: 10.1002/alr.21986. Epub 2017 Jul 18.
10
Immersive 3-Dimensional Virtual Reality Modeling for Case-Specific Presurgical Discussions in Cerebrovascular Neurosurgery.用于脑血管神经外科特定病例术前讨论的沉浸式三维虚拟现实建模
Oper Neurosurg (Hagerstown). 2021 Feb 16;20(3):289-299. doi: 10.1093/ons/opaa335.
引用本文的文献
1
Robotics and optical coherence tomography: current works and future perspectives [Invited].机器人技术与光学相干断层扫描：当前研究与未来展望[特邀报告]
Biomed Opt Express. 2025 Jan 16;16(2):578-602. doi: 10.1364/BOE.547943. eCollection 2025 Feb 1.
2
New Directions for Ophthalmic OCT - Handhelds, Surgery, and Robotics.眼科光学相干断层扫描的新方向——手持式设备、手术及机器人技术
Transl Vis Sci Technol. 2025 Jan 2;14(1):14. doi: 10.1167/tvst.14.1.14.
3
Microsurgery Robots: Applications, Design, and Development.微创手术机器人：应用、设计与开发。
Sensors (Basel). 2023 Oct 16;23(20):8503. doi: 10.3390/s23208503.
4
Methods for real-time feature-guided image fusion of intrasurgical volumetric optical coherence tomography with digital microscopy.术中容积光学相干断层扫描与数字显微镜实时特征引导图像融合的方法
Biomed Opt Express. 2023 Jun 13;14(7):3308-3326. doi: 10.1364/BOE.488975. eCollection 2023 Jul 1.
5
Validation of collaborative cyberspace virtual reality oculometry enhanced with near real-time spatial audio.协同网络虚拟现实眼动测量法的验证，该方法结合了近实时空间音频。
Sci Rep. 2023 Jun 21;13(1):10076. doi: 10.1038/s41598-023-37267-x.
6
Clinical applications for intraoperative optical coherence tomography: a systematic review.术中光学相干断层扫描的临床应用：系统评价。
Eye (Lond). 2022 Feb;36(2):379-391. doi: 10.1038/s41433-021-01686-9. Epub 2021 Jul 16.
7
Advances in tissue state recognition in spinal surgery: a review.脊柱手术中组织状态识别的研究进展：综述。
Front Med. 2021 Aug;15(4):575-584. doi: 10.1007/s11684-020-0816-3. Epub 2021 May 15.
8
Analysis and evaluation of BC-mode OCT image visualization for microsurgery guidance.用于显微手术引导的BC模式光学相干断层扫描（OCT）图像可视化分析与评估
Biomed Opt Express. 2019 Sep 19;10(10):5268-5290. doi: 10.1364/BOE.10.005268. eCollection 2019 Oct 1.
9
Laser brain cancer surgery in a xenograft model guided by optical coherence tomography.光学相干断层扫描引导下的异种移植模型中的激光脑癌手术。
Theranostics. 2019 May 26;9(12):3555-3564. doi: 10.7150/thno.31811. eCollection 2019.
10
Digital and intelligent liver surgery in the new era: Prospects and dilemmas.新时代的数字化与智能化肝外科：前景与困境。
EBioMedicine. 2019 Mar;41:693-701. doi: 10.1016/j.ebiom.2019.02.017. Epub 2019 Feb 14.
本文引用的文献
1
THE INTEGRATIVE SURGICAL THEATER: Combining Intraoperative Optical Coherence Tomography and 3D Digital Visualization for Vitreoretinal Surgery in the DISCOVER Study.一体化手术间：在 DISCOVER 研究中结合术中光学相干断层扫描和 3D 数字可视化用于玻璃体视网膜手术
Retina. 2018 Sep;38 Suppl 1(Suppl 1):S88-S96. doi: 10.1097/IAE.0000000000001999.
2
Review of intraoperative optical coherence tomography: technology and applications [Invited].术中光学相干断层扫描技术综述：技术与应用[特邀文章]
Biomed Opt Express. 2017 Feb 21;8(3):1607-1637. doi: 10.1364/BOE.8.001607. eCollection 2017 Mar 1.
3
Live volumetric (4D) visualization and guidance of in vivo human ophthalmic surgery with intraoperative optical coherence tomography.术中光学相干断层扫描引导活体人眼手术的实时容积（4D）可视化。
Sci Rep. 2016 Aug 19;6:31689. doi: 10.1038/srep31689.
4
Impact of Microscope-Integrated OCT on Ophthalmology Resident Performance of Anterior Segment Surgical Maneuvers in Model Eyes.显微镜集成光学相干断层扫描对眼科住院医师在模型眼中进行眼前段手术操作表现的影响。
Invest Ophthalmol Vis Sci. 2016 Jul 1;57(9):OCT146-53. doi: 10.1167/iovs.15-18818.
5
Enhanced volumetric visualization for real time 4D intraoperative ophthalmic swept-source OCT.用于实时4D术中眼科扫频源光学相干断层扫描的增强容积可视化
Biomed Opt Express. 2016 Apr 12;7(5):1815-29. doi: 10.1364/BOE.7.001815. eCollection 2016 May 1.
6
Novel microscope-integrated stereoscopic heads-up display for intrasurgical optical coherence tomography.用于术中光学相干断层扫描的新型集成显微镜立体平视显示器
Biomed Opt Express. 2016 Apr 6;7(5):1711-26. doi: 10.1364/BOE.7.001711. eCollection 2016 May 1.
7
Advantages of microscope-integrated intraoperative online optical coherence tomography: usage in Boston keratoprosthesis type I surgery.显微镜集成式术中在线光学相干断层扫描的优势：在I型波士顿人工角膜手术中的应用
J Biomed Opt. 2016 Jan;21(1):16005. doi: 10.1117/1.JBO.21.1.016005.
8
Handheld, rapidly switchable, anterior/posterior segment swept source optical coherence tomography probe.手持式、可快速切换的前节/后节扫频源光学相干断层扫描探头。
Biomed Opt Express. 2015 Oct 21;6(11):4516-28. doi: 10.1364/BOE.6.004516. eCollection 2015 Nov 1.
9
Real-Time Microscope-Integrated OCT to Improve Visualization in DSAEK for Advanced Bullous Keratopathy.用于改善严重大疱性角膜病变的角膜内皮移植术中可视化的实时显微镜集成光学相干断层扫描技术
Cornea. 2015 Dec;34(12):1606-10. doi: 10.1097/ICO.0000000000000661.
10
Intraoperative optical coherence tomography: ocular surgery on a higher level or just nice pictures?术中光学相干断层扫描：眼部手术的更高水平还是仅仅是漂亮的图片？
JAMA Ophthalmol. 2015 Oct;133(10):1133-4. doi: 10.1001/jamaophthalmol.2015.2396.
Zotero 插件