Harders Matthias, Bianchi Gérald, Knoerlein Benjamin, Székely Gábor
Computer Vision Laboratory, ETH Zurich, Zurich, Switzerland.
IEEE Trans Vis Comput Graph. 2009 Jan-Feb;15(1):138-49. doi: 10.1109/TVCG.2008.63.
In our current research we examine the application of visuo-haptic augmented reality setups in medical training. To this end, highly accurate calibration, system stability, and low latency are indispensable prerequisites. These are necessary to maintain user immersion and avoid breaks in presence which potentially diminish the training outcome. In this paper we describe the developed calibration methods for visuo-haptic integration, the hybrid tracking technique for stable alignment of the augmentation, and the distributed framework ensuring low latency and component synchronization. Finally, we outline an early prototype system based on the multimodal augmented reality framework. The latter allows colocated visuo-haptic interaction with real and virtual scene components in a simplified open surgery setting.
在我们当前的研究中,我们考察了视觉-触觉增强现实设置在医学培训中的应用。为此,高精度校准、系统稳定性和低延迟是必不可少的先决条件。这些对于保持用户沉浸感以及避免出现可能降低训练效果的临场感中断是必要的。在本文中,我们描述了为视觉-触觉集成开发的校准方法、用于增强现实稳定对齐的混合跟踪技术以及确保低延迟和组件同步的分布式框架。最后,我们概述了一个基于多模态增强现实框架的早期原型系统。后者允许在简化的开放手术环境中与真实和虚拟场景组件进行并置的视觉-触觉交互。