Zhu Lei, Yu Fei, Ding Wangpan, Huang Aiai, Ying Nanjiao, Zhang Jianhai
School of Automation, Hangzhou Dianzi University, Hangzhou, 310000 China.
School of Computer Science, Hangzhou Dianzi University, Hangzhou, 310000 China.
Cogn Neurodyn. 2024 Oct;18(5):2359-2372. doi: 10.1007/s11571-024-10092-2. Epub 2024 Mar 18.
Electroencephalogram (EEG) emotion recognition plays an important role in human-computer interaction, and a higher recognition accuracy can improve the user experience. In recent years, domain adaptive methods in transfer learning have been used to construct a general emotion recognition model to deal with domain difference among different subjects and sessions. However, it is still challenging to effectively reduce domain difference in domain adaptation. In this paper, we propose a Multiple-Source Distribution Deep Adaptive Feature Norm Network for EEG emotion recognition, which reduce domain difference by improving the transferability of task-specific features. In detail, the domain adaptive method of our model employs a three-layer network topology, inserts Adaptive Feature Norm to self-supervised adjustment between different layers, and combines a multiple-kernel selection approach to mean embedding matching. The method proposed in this paper achieves the best classification performance in the SEED and SEED-IV datasets. In SEED dataset, the average accuracy of cross-subject and cross-session experiments is 85.01 and 91.93%, respectively. In SEED-IV dataset, the average accuracy is 58.81% in cross-subject experiments and 59.51% in cross-session experiments. The experimental results demonstrate that our method can effectively reduce the domain difference and improve the emotion recognition accuracy.
脑电图(EEG)情感识别在人机交互中起着重要作用,更高的识别准确率可以提升用户体验。近年来,迁移学习中的域自适应方法已被用于构建通用情感识别模型,以应对不同受试者和实验环节之间的域差异。然而,在域自适应中有效减少域差异仍然具有挑战性。在本文中,我们提出了一种用于EEG情感识别的多源分布深度自适应特征规范网络,通过提高特定任务特征的可迁移性来减少域差异。具体而言,我们模型的域自适应方法采用三层网络拓扑结构,在不同层之间插入自适应特征规范进行自监督调整,并结合多核选择方法进行均值嵌入匹配。本文提出的方法在SEED和SEED-IV数据集上取得了最佳分类性能。在SEED数据集中,跨受试者和跨实验环节实验的平均准确率分别为85.01%和91.93%。在SEED-IV数据集中,跨受试者实验的平均准确率为58.81%,跨实验环节实验的平均准确率为59.51%。实验结果表明,我们的方法可以有效减少域差异并提高情感识别准确率。