IEEE Trans Vis Comput Graph. 2020 May;26(5):1880-1890. doi: 10.1109/TVCG.2020.2973052. Epub 2020 Feb 13.
The gaze behavior of virtual avatars is critical to social presence and perceived eye contact during social interactions in Virtual Reality. Virtual Reality headsets are being designed with integrated eye tracking to enable compelling virtual social interactions. This paper shows that the near infra-red cameras used in eye tracking capture eye images that contain iris patterns of the user. Because iris patterns are a gold standard biometric, the current technology places the user's biometric identity at risk. Our first contribution is an optical defocus based hardware solution to remove the iris biometric from the stream of eye tracking images. We characterize the performance of this solution with different internal parameters. Our second contribution is a psychophysical experiment with a same-different task that investigates the sensitivity of users to a virtual avatar's eye movements when this solution is applied. By deriving detection threshold values, our findings provide a range of defocus parameters where the change in eye movements would go unnoticed in a conversational setting. Our third contribution is a perceptual study to determine the impact of defocus parameters on the perceived eye contact, attentiveness, naturalness, and truthfulness of the avatar. Thus, if a user wishes to protect their iris biometric, our approach provides a solution that balances biometric protection while preventing their conversation partner from perceiving a difference in the user's virtual avatar. This work is the first to develop secure eye tracking configurations for VR/AR/XR applications and motivates future work in the area.
虚拟化身的注视行为对于虚拟现实中的社交互动中的社交存在感和感知眼神接触至关重要。虚拟现实耳机正通过集成眼动追踪来设计,以实现引人入胜的虚拟社交互动。本文表明,眼动追踪中使用的近红外摄像机捕捉到的眼图像包含用户的虹膜模式。由于虹膜模式是一种黄金标准的生物识别技术,因此当前技术将用户的生物识别身份置于风险之中。我们的第一个贡献是一种基于光学散焦的硬件解决方案,可将虹膜生物识别从眼动追踪图像流中去除。我们用不同的内部参数来描述该解决方案的性能。我们的第二个贡献是一项相同-不同任务的心理物理实验,该实验研究了当应用此解决方案时,用户对虚拟化身的眼睛运动的敏感性。通过得出检测阈值,我们的发现为在会话设置中不易察觉的眼睛运动变化提供了一系列散焦参数。我们的第三个贡献是一项感知研究,旨在确定散焦参数对虚拟化身的眼神接触、注意力、自然度和真实性的影响。因此,如果用户希望保护其虹膜生物识别,我们的方法提供了一种解决方案,在保护生物识别的同时,防止其对话伙伴感知到用户虚拟化身的差异。这项工作是第一个为 VR/AR/XR 应用开发安全眼动追踪配置的工作,并激发了该领域的未来工作。