Aidlen Jeremy T, Glick Sara, Silverman Kenneth, Silverman Harvey F, Luks Francois I
Division of Pediatric Surgery, Alpert Medical School of Brown University and Division of Engineering, Brown University, 2 Dudley Street, Providence, RI 02965, USA.
J Laparoendosc Adv Surg Tech A. 2009 Aug;19(4):595-8. doi: 10.1089/lap.2009.0123.
BACKGROUND: Light-weight, low-profile, and high-resolution head-mounted displays (HMDs) now allow personalized viewing, of a laparoscopic image. The advantages include unobstructed viewing, regardless of position at the operating table, and the possibility to customize the image (i.e., enhanced reality, picture-in-picture, etc.). The bright image display allows use in daylight surroundings and the low profile of the HMD provides adequate peripheral vision. Theoretic disadvantages include reliance for all on the same image capture and anticues (i.e., reality disconnect) when the projected image remains static, despite changes in head position. This can lead to discomfort and even nausea. MATERIALS AND METHODS: We have developed a prototype of interactive laparoscopic image display that allows hands-free control of the displayed image by changes in spatial orientation of the operator's head. The prototype consists of an HMD, a spatial orientation device, and computer software to enable hands-free panning and zooming of a video-endoscopic image display. The spatial orientation device uses magnetic fields created by a transmitter and receiver, each containing three orthogonal coils. The transmitter coils are efficiently driven, using USB power only, by a newly developed circuit, each at a unique frequency. The HMD-mounted receiver system links to a commercially available PC-interface PCI-bus sound card (M-Audiocard Delta 44; Avid Technology, Tewksbury, MA). Analog signals at the receiver are filtered, amplified, and converted to digital signals, which are processed to control the image display. RESULTS: The prototype uses a proprietary static fish-eye lens and software for the distortion-free reconstitution of any portion of the captured image. Left-right and up-down motions of the head (and HMD) produce real-time panning of the displayed image. Motion of the head toward, or away from, the transmitter causes real-time zooming in or out, respectively, of the displayed image. CONCLUSIONS: This prototype of the interactive HMD allows hands-free, intuitive control of the laparoscopic field, independent of the captured image.
背景:轻便、低轮廓且高分辨率的头戴式显示器(HMD)现在允许对腹腔镜图像进行个性化观看。其优点包括无论在手术台上的位置如何都能无阻碍地观看,以及能够自定义图像(即增强现实、画中画等)。明亮的图像显示允许在日光环境下使用,并且HMD的低轮廓提供了足够的周边视野。理论上的缺点包括当投影图像保持静止,尽管头部位置发生变化时,所有人都依赖于相同的图像捕捉和反线索(即与现实脱节)。这可能导致不适甚至恶心。 材料与方法:我们开发了一种交互式腹腔镜图像显示原型,通过操作员头部空间方向的变化实现对显示图像的免提控制。该原型由一个HMD、一个空间方向设备和计算机软件组成,以实现对视频内窥镜图像显示的免提平移和缩放。空间方向设备使用由发射器和接收器产生的磁场,每个发射器和接收器都包含三个正交线圈。发射器线圈仅使用USB电源,由新开发的电路高效驱动,每个线圈以独特的频率工作。安装在HMD上的接收器系统连接到市售的PC接口PCI总线声卡(M-Audiocard Delta 44;Avid Technology,马萨诸塞州特克斯伯里)。接收器处的模拟信号经过滤波、放大并转换为数字信号,这些数字信号被处理以控制图像显示。 结果:该原型使用专有的静态鱼眼镜头和软件对捕获图像的任何部分进行无失真重构。头部(和HMD)的左右和上下运动产生显示图像的实时平移。头部朝向或远离发射器的运动会分别导致显示图像的实时放大或缩小。 结论:这种交互式HMD原型允许对腹腔镜视野进行免提、直观的控制,而与捕获的图像无关。
J Laparoendosc Adv Surg Tech A. 2009-8
Stud Health Technol Inform. 2013
J Laparoendosc Adv Surg Tech A. 2009-4
Surg Endosc. 2003-6
Med Biol Eng Comput. 2018-10-2