School of Future Technology, South China University of Technology, Guangzhou, 511422, China; School of Electronic and Information Engineering, South China University of Technology, Guangzhou, 510640, China.
School of Electronic and Information Engineering, South China University of Technology, Guangzhou, 510640, China.
Comput Biol Med. 2022 Jun;145:105519. doi: 10.1016/j.compbiomed.2022.105519. Epub 2022 Apr 14.
In recent years, with the rapid development of machine learning, automatic emotion recognition based on electroencephalogram (EEG) signals has received increasing attention. However, owing to the great variance of EEG signals sampled from different subjects, EEG-based emotion recognition experiences the individual difference problem across subjects, which significantly hinders recognition performance. In this study, we presented a method for EEG-based emotion recognition using a combination of a multi-scale residual network (MSRN) and meta-transfer learning (MTL) strategy. The MSRN was used to represent connectivity features of EEG signals in a multi-scale manner, which utilized different receptive fields of convolution neural networks to capture the interactions of different brain regions. The MTL strategy fully used the merits of meta-learning and transfer learning to significantly reduce the gap in individual differences between various subjects. The proposed method can not only further explore the relationship between connectivity features and emotional states but also alleviate the problem of individual differences across subjects. The average cross-subject accuracies of the proposed method were 71.29% and 71.92% for the valence and arousal tasks on the DEAP dataset, respectively. It achieved an accuracy of 87.05% for the binary classification task on the SEED dataset. The results show that the framework has a positive effect on the cross-subject EEG emotion recognition task.
近年来,随着机器学习的快速发展,基于脑电图(EEG)信号的自动情绪识别受到了越来越多的关注。然而,由于从不同主体采集的 EEG 信号具有很大的差异,基于 EEG 的情绪识别在主体之间存在个体差异问题,这极大地阻碍了识别性能。在这项研究中,我们提出了一种使用多尺度残差网络(MSRN)和元迁移学习(MTL)策略的基于 EEG 的情绪识别方法。MSRN 用于以多尺度方式表示 EEG 信号的连通性特征,它利用卷积神经网络的不同感受野来捕捉不同脑区的相互作用。MTL 策略充分利用元学习和迁移学习的优点,显著缩小了不同主体之间个体差异的差距。所提出的方法不仅可以进一步探索连通性特征与情绪状态之间的关系,还可以缓解主体之间的个体差异问题。在 DEAP 数据集上,所提出的方法在效价和唤醒任务上的跨主体平均准确率分别为 71.29%和 71.92%。在 SEED 数据集上的二进制分类任务中,它的准确率达到了 87.05%。结果表明,该框架对跨主体 EEG 情绪识别任务具有积极的影响。