Yoon Jang W, Spadola Michael, Blue Rachel, Saylany Anissa, Sharma Nikhil, Ahmad Hasan S, Buch Vivek, Madhavan Karthik, Chen H Isaac, Steinmetz Michael P, Welch William C, Malhotra Neil R
Department of Neurosurgery, Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania.
Department of Neurosurgery, University of Miami, Miami, Florida.
Int J Spine Surg. 2021 Aug;15(4):826-833. doi: 10.14444/8106. Epub 2021 Jul 15.
BACKGROUND: We present a "Do-It-Yourself" method to build an affordable augmented reality heads-up display system (AR-HUD) capable of displaying intraoperative images. All components are commercially available products, which the surgeons may use in their own practice for educational and research purposes. METHODS: Moverio BT 35-E smart glasses were connected to operating room imaging modalities (ie, fluoroscopy and 3D navigation platforms) via a high-definition multimedia interface (HDMI) converter, allowing for continuous high-definition video transmission. The addition of an HDMI transmitter-receiver makes the AR-HUD system wireless. RESULTS: We used our AR-HUD system in 3 patients undergoing instrumented spinal fusion. AR-HUD projected fluoroscopy images onto the surgical field, eliminating shift of surgeon focus and procedure interruption, with only a 40- to 100-ms delay in transmission, which was not clinically impactful. CONCLUSIONS: An affordable AR-HUD capable of displaying real-time information into the surgeon's view can be easily designed, built, and tested in surgical practice. As wearable heads-up display technology continues to evolve rapidly, individual components presented here may be substituted to improve its functionality and usability. Surgeons are in a unique position to conduct clinical testing in the operating room environment to optimize the augmented reality system for surgical use.
背景:我们提出一种“自己动手做”的方法来构建一个经济实惠的增强现实平视显示系统(AR-HUD),该系统能够显示术中图像。所有组件均为市售产品,外科医生可在自己的实践中用于教育和研究目的。 方法:Moverio BT 35-E智能眼镜通过高清多媒体接口(HDMI)转换器连接到手术室成像设备(即荧光透视和3D导航平台),实现连续的高清视频传输。添加HDMI发射器-接收器使AR-HUD系统具备无线功能。 结果:我们在3例接受器械辅助脊柱融合手术的患者中使用了我们的AR-HUD系统。AR-HUD将荧光透视图像投射到手术区域,消除了外科医生注意力的转移和手术中断,传输延迟仅为40至100毫秒,在临床上无显著影响。 结论:在外科实践中,可以轻松设计、构建并测试一种能够将实时信息显示到外科医生视野中的经济实惠的AR-HUD。随着可穿戴平视显示技术的快速发展,这里介绍的各个组件可能会被替换,以提高其功能和可用性。外科医生处于在手术室环境中进行临床试验以优化用于手术的增强现实系统的独特地位。
Int J Spine Surg. 2021-8
J Clin Orthop Trauma. 2021-5-5
HSS J. 2021-10
Hepatobiliary Pancreat Dis Int. 2018-2-19
BMC Musculoskelet Disord. 2021-5-18
Asian J Neurosurg. 2025-5-21
World Neurosurg X. 2024-9-26
World Neurosurg X. 2024-3-8
Int J Med Robot. 2018-8
Oper Neurosurg (Hagerstown). 2018-8-1
Neurosurg Focus. 2014-3
Eur Spine J. 2009-9-11
Stereotact Funct Neurosurg. 1997
Int J Oral Maxillofac Surg. 1996-4