Zuo Mingliang, Chen Xiaoyu, Sui Li
School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai 200093, China.
School of Information Science and Technology, Fudan University, Shanghai 200433, China.
Brain Sci. 2025 Jan 16;15(1):75. doi: 10.3390/brainsci15010075.
Virtual reality (VR) has become a transformative technology with applications in gaming, education, healthcare, and psychotherapy. The subjective experiences in VR vary based on the virtual environment's characteristics, and electroencephalography (EEG) is instrumental in assessing these differences. By analyzing EEG signals, researchers can explore the neural mechanisms underlying cognitive and emotional responses to VR stimuli. However, distinguishing EEG signals recorded by two-dimensional (2D) versus three-dimensional (3D) VR environments remains underexplored. Current research primarily utilizes power spectral density (PSD) features to differentiate between 2D and 3D VR conditions, but the potential of other feature parameters for enhanced discrimination is unclear. Additionally, the use of machine learning techniques to classify EEG signals from 2D and 3D VR using alternative features has not been thoroughly investigated, highlighting the need for further research to identify robust EEG features and effective classification methods.
This study recorded EEG signals from participants exposed to 2D and 3D VR video stimuli to investigate the neural differences between these conditions. Key features extracted from the EEG data included PSD and common spatial patterns (CSPs), which capture frequency-domain and spatial-domain information, respectively. To evaluate classification performance, several classical machine learning algorithms were employed: ssupport vector machine (SVM), k-nearest neighbors (KNN), random forest (RF), naive Bayes, decision Tree, AdaBoost, and a voting classifier. The study systematically compared the classification performance of PSD and CSP features across these algorithms, providing a comprehensive analysis of their effectiveness in distinguishing EEG signals in response to 2D and 3D VR stimuli.
The study demonstrated that machine learning algorithms can effectively classify EEG signals recorded during watching 2D and 3D VR videos. CSP features outperformed PSD in classification accuracy, indicating their superior ability to capture EEG signals differences between the VR conditions. Among the machine learning algorithms, the Random Forest classifier achieved the highest accuracy at 95.02%, followed by KNN with 93.16% and SVM with 91.39%. The combination of CSP features with RF, KNN, and SVM consistently showed superior performance compared to other feature-algorithm combinations, underscoring the effectiveness of CSP and these algorithms in distinguishing EEG responses to different VR experiences.
This study demonstrates that EEG signals recorded during watching 2D and 3D VR videos can be effectively classified using machine learning algorithms with extracted feature parameters. The findings highlight the superiority of CSP features over PSD in distinguishing EEG signals under different VR conditions, emphasizing CSP's value in VR-induced EEG analysis. These results expand the application of feature-based machine learning methods in EEG studies and provide a foundation for future research into the brain cortical activity of VR experiences, supporting the broader use of machine learning in EEG-based analyses.
虚拟现实(VR)已成为一项变革性技术,在游戏、教育、医疗保健和心理治疗等领域都有应用。VR中的主观体验因虚拟环境的特征而异,脑电图(EEG)有助于评估这些差异。通过分析EEG信号,研究人员可以探索对VR刺激的认知和情绪反应背后的神经机制。然而,区分二维(2D)与三维(3D)VR环境记录的EEG信号仍未得到充分探索。目前的研究主要利用功率谱密度(PSD)特征来区分2D和3D VR条件,但其他特征参数用于增强辨别力的潜力尚不清楚。此外,使用机器学习技术利用替代特征对来自2D和3D VR的EEG信号进行分类尚未得到充分研究,这突出表明需要进一步研究以确定强大的EEG特征和有效的分类方法。
本研究记录了参与者在接触2D和3D VR视频刺激时的EEG信号,以研究这些条件之间的神经差异。从EEG数据中提取的关键特征包括PSD和共同空间模式(CSP),它们分别捕获频域和空间域信息。为了评估分类性能,采用了几种经典的机器学习算法:支持向量机(SVM)、k近邻(KNN)、随机森林(RF)、朴素贝叶斯、决策树、AdaBoost和投票分类器。该研究系统地比较了这些算法中PSD和CSP特征的分类性能,全面分析了它们在区分对2D和3D VR刺激的EEG信号方面的有效性。
该研究表明,机器学习算法可以有效地对观看2D和3D VR视频时记录的EEG信号进行分类。CSP特征在分类准确率方面优于PSD,表明其在捕获VR条件之间的EEG信号差异方面具有更强的能力。在机器学习算法中,随机森林分类器的准确率最高,为95.02%,其次是KNN,为93.16%,SVM为91.39%。与其他特征 - 算法组合相比,CSP特征与RF、KNN和SVM的组合始终表现出卓越的性能,强调了CSP和这些算法在区分对不同VR体验的EEG反应方面的有效性。
本研究表明,使用提取的特征参数的机器学习算法可以有效地对观看2D和3D VR视频时记录的EEG信号进行分类。研究结果突出了CSP特征在区分不同VR条件下的EEG信号方面优于PSD,强调了CSP在VR诱发的EEG分析中的价值。这些结果扩展了基于特征的机器学习方法在EEG研究中的应用,并为未来对VR体验的大脑皮层活动的研究奠定了基础,支持机器学习在基于EEG的分析中的更广泛应用。