Department of Artificial Intelligence, Hanyang University, Seoul, Republic of Korea.
Electronics and Telecommunications Research Institute, Daejeon, Republic of Korea.
PLoS One. 2022 Dec 29;17(12):e0278970. doi: 10.1371/journal.pone.0278970. eCollection 2022.
Research has shown that sensor data generated by a user during a VR experience is closely related to the user's behavior or state, meaning that the VR user can be quantitatively understood and modeled. Eye-tracking as a sensor signal has been studied in prior research, but its usefulness in a VR context has been less examined, and most extant studies have dealt with eye-tracking within a single environment. Our goal is to expand the understanding of the relationship between eye-tracking data and user modeling in VR. In this paper, we examined the role and influence of eye-tracking data in predicting a level of cybersickness and types of locomotion. We developed and applied the same structure of a deep learning model to the multi-sensory data collected from two different studies (cybersickness and locomotion) with a total of 50 participants. The experiment results highlight not only a high applicability of our model to sensor data in a VR context, but also a significant relevance of eye-tracking data as a potential supplement to improving the model's performance and the importance of eye-tracking data in learning processes overall. We conclude by discussing the relevance of these results to potential future studies on this topic.
研究表明,用户在虚拟现实体验中产生的传感器数据与用户的行为或状态密切相关,这意味着可以对虚拟现实用户进行定量理解和建模。眼动追踪作为一种传感器信号,在先前的研究中已经得到了研究,但它在虚拟现实环境中的有用性尚未得到充分研究,而且大多数现有研究都涉及单一环境中的眼动追踪。我们的目标是扩展对虚拟现实中眼动追踪数据与用户建模之间关系的理解。在本文中,我们研究了眼动追踪数据在预测网络晕动症水平和运动类型方面的作用和影响。我们开发并应用了相同的深度学习模型结构,对来自两个不同研究(网络晕动症和运动)的多感官数据进行了分析,总共有 50 名参与者。实验结果不仅突出了我们的模型在虚拟现实环境中对传感器数据的高度适用性,还突出了眼动追踪数据作为潜在补充,以提高模型性能的重要性,以及眼动追踪数据在整个学习过程中的重要性。最后,我们讨论了这些结果对该主题未来潜在研究的相关性。