IEEE Trans Vis Comput Graph. 2022 Dec;28(12):4156-4171. doi: 10.1109/TVCG.2021.3079849. Epub 2022 Oct 26.
Estimating the depth of virtual content has proven to be a challenging task in Augmented Reality (AR) applications. Existing studies have shown that the visual system makes use of multiple depth cues to infer the distance of objects, occlusion being one of the most important ones. The ability to generate appropriate occlusions becomes particularly important for AR applications that require the visualization of augmented objects placed below a real surface. Examples of these applications are medical scenarios in which the visualization of anatomical information needs to be observed within the patient's body. In this regard, existing works have proposed several focus and context (F+C) approaches to aid users in visualizing this content using Video See-Through (VST) Head-Mounted Displays (HMDs). However, the implementation of these approaches in Optical See-Through (OST) HMDs remains an open question due to the additive characteristics of the display technology. In this article, we, for the first time, design and conduct a user study that compares depth estimation between VST and OST HMDs using existing in-situ visualization methods. Our results show that these visualizations cannot be directly transferred to OST displays without increasing error in depth perception tasks. To tackle this gap, we perform a structured decomposition of the visual properties of AR F+C methods to find best-performing combinations. We propose the use of chromatic shadows and hatching approaches transferred from computer graphics. In a second study, we perform a factorized analysis of these combinations, showing that varying the shading type and using colored shadows can lead to better depth estimation when using OST HMDs.
在增强现实 (AR) 应用中,估计虚拟内容的深度已被证明是一项具有挑战性的任务。现有研究表明,视觉系统利用多种深度线索来推断物体的距离,遮挡是最重要的线索之一。生成适当遮挡的能力对于需要可视化放置在真实表面下方的增强对象的 AR 应用程序变得尤为重要。这些应用程序的示例包括医学场景,其中需要在患者体内观察解剖信息的可视化。在这方面,现有工作已经提出了几种焦点和上下文 (F+C) 方法,以帮助用户使用视频透视 (VST) 头戴式显示器 (HMD) 可视化此内容。然而,由于显示技术的附加特性,这些方法在光学透视 (OST) HMD 中的实现仍然是一个悬而未决的问题。在本文中,我们首次设计并进行了一项用户研究,该研究使用现有的原位可视化方法比较了 VST 和 OST HMD 之间的深度估计。我们的结果表明,如果不增加深度感知任务中的误差,这些可视化不能直接转移到 OST 显示器上。为了解决这个差距,我们对 AR F+C 方法的视觉属性进行了结构化分解,以找到性能最佳的组合。我们建议使用从计算机图形学转移过来的彩色阴影和阴影线方法。在第二项研究中,我们对这些组合进行了因子分析,表明当使用 OST HMD 时,改变阴影类型并使用彩色阴影可以导致更好的深度估计。