Ye Weishan, Wang Jiyuan, Chen Lin, Dai Lifei, Sun Zhe, Liang Zhen
School of Biomedical Engineering, Medical School, Shenzhen University, Shenzhen, China.
Guangdong Provincial Key Laboratory of Biomedical Measurements and Ultrasound Imaging, Shenzhen, China.
Cyborg Bionic Syst. 2024 May 8;5:0088. doi: 10.34133/cbsystems.0088. eCollection 2024.
An intelligent emotion recognition system based on electroencephalography (EEG) signals shows considerable potential in various domains such as healthcare, entertainment, and education, thanks to its portability, high temporal resolution, and real-time capabilities. However, the existing research in this field faces limitations stemming from the nonstationary nature and individual variability of EEG signals. In this study, we present a novel EEG emotion recognition model, named GraphEmotionNet, designed to enhance the accuracy of EEG-based emotion recognition through the incorporation of a spatiotemporal attention mechanism and transfer learning. The proposed GraphEmotionNet model can effectively learn the intrinsic connections between EEG channels and construct an adaptive graph. This graph's adaptive nature is crucial in optimizing spatial-temporal graph convolutions, which in turn enhances spatial-temporal feature characterization and contributes to the process of emotion classification. Moreover, an integration of domain adaptation aligns the extracted features across different domains, further alleviating the impact of individual EEG variability. We evaluate the model performance on two benchmark databases, employing two types of cross-validation protocols: within-subject cross-validation and cross-subject cross-validation. The experimental results affirm the model's efficacy in extracting EEG features linked to emotional semantics and demonstrate its promising performance in emotion recognition.
基于脑电图(EEG)信号的智能情感识别系统因其便携性、高时间分辨率和实时能力,在医疗保健、娱乐和教育等各个领域显示出巨大潜力。然而,该领域的现有研究面临着由于EEG信号的非平稳性和个体变异性而产生的局限性。在本研究中,我们提出了一种新颖的EEG情感识别模型,名为GraphEmotionNet,旨在通过结合时空注意力机制和迁移学习来提高基于EEG的情感识别准确性。所提出的GraphEmotionNet模型可以有效地学习EEG通道之间的内在联系并构建自适应图。该图的自适应性质对于优化时空图卷积至关重要,进而增强时空特征表征并有助于情感分类过程。此外,域自适应的整合使跨不同域提取的特征对齐,进一步减轻个体EEG变异性的影响。我们在两个基准数据库上评估模型性能,采用两种类型的交叉验证协议:受试者内交叉验证和受试者间交叉验证。实验结果证实了该模型在提取与情感语义相关的EEG特征方面的有效性,并证明了其在情感识别方面的良好性能。