Department of Sports ICT Convergence, Sangmyung University Graduate School, Seoul, Republic of Korea.
Department of Human-Centered Artificial Intelligence, Institute of Intelligence Informatics Technology, Sangmyung University, Seoul, Republic of Korea.
Cyberpsychol Behav Soc Netw. 2021 Nov;24(11):729-736. doi: 10.1089/cyber.2020.0613. Epub 2021 Aug 10.
This study aims to classify cybersickness (CS) caused by virtual reality (VR) immersion through a machine-deep-ensemble learning model. The heart rate variability and respiratory signal parameters of 20 subjects were measured, while watching a VR video for ∼5 minutes. After the experiment, the subjects were examined for CS and questioned to determine their CS states. Based on the results, we constructed a machine-deep-ensemble learning model that could identify and classify VR immersion CS among subjects. The ensemble model comprised four stacked machine learning models (support vector machine [SVM], k-nearest neighbor [KNN], random forest, and AdaBoost), which were used to derive prediction data, and then, classified the prediction data using a convolution neural network. This model was a multiclass classification model, allowing us to classify subjects' CS into three states (neutral, non-CS, and CS). The accuracy of SVM, KNN, random forest, and AdaBoost was 94.23 percent, 92.44 percent, 93.20 percent, and 90.33 percent, respectively, and the ensemble model could classify the three states with an accuracy of 96.48 percent. This implied that the ensemble model has a higher classification performance than when each model is used individually. Our results confirm that CS caused by VR immersion can be detected as physiological signal data with high accuracy. Moreover, our proposed model can determine the presence or absence of CS as well as the neutral state. Clinical Trial Registration Number: 20-2021-1.
本研究旨在通过机器学习深度学习集成模型对虚拟现实(VR)沉浸式引起的晕动症(CS)进行分类。对 20 名受试者在观看约 5 分钟的 VR 视频时的心率变异性和呼吸信号参数进行了测量。实验结束后,对受试者进行了 CS 检查,并询问了他们的 CS 状态。基于结果,我们构建了一个机器学习深度学习集成模型,可以识别和分类受试者的 VR 沉浸式 CS。该集成模型由四个堆叠的机器学习模型(支持向量机[SVM]、k-最近邻[KNN]、随机森林和 AdaBoost)组成,用于导出预测数据,然后使用卷积神经网络对预测数据进行分类。该模型是一个多类分类模型,允许我们将受试者的 CS 状态分为三种(中性、非 CS 和 CS)。SVM、KNN、随机森林和 AdaBoost 的准确率分别为 94.23%、92.44%、93.20%和 90.33%,集成模型的准确率为 96.48%。这意味着集成模型的分类性能高于每个模型单独使用的性能。我们的结果证实,VR 沉浸式引起的 CS 可以作为生理信号数据进行高精度检测。此外,我们提出的模型可以确定是否存在 CS 以及中性状态。临床试验注册号:20-2021-1。