IEEE Trans Vis Comput Graph. 2024 Nov;30(11):6997-7007. doi: 10.1109/TVCG.2024.3456172. Epub 2024 Oct 10.
Mixed Reality allows us to integrate virtual and physical content into users' environments seamlessly. Yet, how this fusion affects perceptual and cognitive resources and our ability to find virtual or physical objects remains uncertain. Displaying virtual and physical information simultaneously might lead to divided attention and increased visual complexity, impacting users' visual processing, performance, and workload. In a visual search task, we asked participants to locate virtual and physical objects in Augmented Reality and Augmented Virtuality to understand the effects on performance. We evaluated search efficiency and attention allocation for virtual and physical objects using event-related potentials, fixation and saccade metrics, and behavioral measures. We found that users were more efficient in identifying objects in Augmented Virtuality, while virtual objects gained saliency in Augmented Virtuality. This suggests that visual fidelity might increase the perceptual load of the scene. Reduced amplitude in distractor positivity ERP, and fixation patterns supported improved distractor suppression and search efficiency in Augmented Virtuality. We discuss design implications for mixed reality adaptive systems based on physiological inputs for interaction.
混合现实允许我们将虚拟和物理内容无缝地集成到用户的环境中。然而，这种融合如何影响感知和认知资源以及我们找到虚拟或物理对象的能力还不确定。同时显示虚拟和物理信息可能会导致注意力分散和视觉复杂度增加，从而影响用户的视觉处理、性能和工作量。在视觉搜索任务中，我们要求参与者在增强现实和增强虚拟环境中定位虚拟和物理对象，以了解对性能的影响。我们使用事件相关电位、注视和扫视指标以及行为测量来评估虚拟和物理对象的搜索效率和注意力分配。我们发现，用户在增强虚拟环境中识别对象的效率更高，而虚拟对象在增强虚拟环境中更引人注目。这表明视觉逼真度可能会增加场景的感知负荷。ERP 中的分心正波振幅减小，以及注视模式支持增强虚拟环境中干扰抑制和搜索效率的提高。我们讨论了基于生理输入的混合现实自适应系统的设计意义，用于交互。
