Department of Physics, Technische Universität Kaiserslautern, Erwin-Schrödinger-Str. 46, 67663 Kaiserslautern, Germany.
German Research Center for Artificial Intelligence (DFKI), Interactive Machine Learning Department, Stuhlsatzenhausweg 3, Saarland Informatics Campus D3_2, 66123 Saarbrücken, Germany.
Sensors (Basel). 2021 Mar 23;21(6):2234. doi: 10.3390/s21062234.
Currently an increasing number of head mounted displays (HMD) for virtual and augmented reality (VR/AR) are equipped with integrated eye trackers. Use cases of these integrated eye trackers include rendering optimization and gaze-based user interaction. In addition, visual attention in VR and AR is interesting for applied research based on eye tracking in cognitive or educational sciences for example. While some research toolkits for VR already exist, only a few target AR scenarios. In this work, we present an open-source eye tracking toolkit for reliable gaze data acquisition in AR based on Unity 3D and the Microsoft HoloLens 2, as well as an R package for seamless data analysis. Furthermore, we evaluate the spatial accuracy and precision of the integrated eye tracker for fixation targets with different distances and angles to the user (n=21). On average, we found that gaze estimates are reported with an angular accuracy of 0.83 degrees and a precision of 0.27 degrees while the user is resting, which is on par with state-of-the-art mobile eye trackers.
目前，越来越多的虚拟现实（VR）和增强现实（AR）头戴式显示器（HMD）配备了集成的眼动追踪器。这些集成的眼动追踪器的用例包括渲染优化和基于注视的用户交互。此外，在 VR 和 AR 中的视觉注意力对于基于眼动追踪的认知或教育科学等应用研究也很有趣。虽然已经有一些针对 VR 的研究工具包，但只有少数针对 AR 场景。在这项工作中，我们提出了一个基于 Unity 3D 和 Microsoft HoloLens 2 的用于 AR 中可靠注视数据采集的开源眼动追踪工具包，以及一个用于无缝数据分析的 R 包。此外，我们评估了集成眼动追踪器对于用户不同距离和角度的固定目标的空间精度和精度（n=21）。平均而言，我们发现当用户处于静止状态时，注视估计的角度精度为 0.83 度，精度为 0.27 度，与最先进的移动眼动追踪器相当。
