Lu Wei, Liu Haiyan, Ma Hua, Tan Tien-Ping, Xia Lingnan
Henan High-speed Railway Operation and Maintenance Engineering Research Center, Zhengzhou Railway Vocational and Technical College, Zhengzhou, China.
School of Computer Sciences, Universiti Sains Malaysia, Penang, Malaysia.
Front Hum Neurosci. 2023 Nov 16;17:1280241. doi: 10.3389/fnhum.2023.1280241. eCollection 2023.
Emotion recognition constitutes a pivotal research topic within affective computing, owing to its potential applications across various domains. Currently, emotion recognition methods based on deep learning frameworks utilizing electroencephalogram (EEG) signals have demonstrated effective application and achieved impressive performance. However, in EEG-based emotion recognition, there exists a significant performance drop in cross-subject EEG Emotion recognition due to inter-individual differences among subjects. In order to address this challenge, a hybrid transfer learning strategy is proposed, and the Domain Adaptation with a Few-shot Fine-tuning Network (DFF-Net) is designed for cross-subject EEG emotion recognition. The first step involves the design of a domain adaptive learning module specialized for EEG emotion recognition, known as the Emo-DA module. Following this, the Emo-DA module is utilized to pre-train a model on both the source and target domains. Subsequently, fine-tuning is performed on the target domain specifically for the purpose of cross-subject EEG emotion recognition testing. This comprehensive approach effectively harnesses the attributes of domain adaptation and fine-tuning, resulting in a noteworthy improvement in the accuracy of the model for the challenging task of cross-subject EEG emotion recognition. The proposed DFF-Net surpasses the state-of-the-art methods in the cross-subject EEG emotion recognition task, achieving an average recognition accuracy of 93.37% on the SEED dataset and 82.32% on the SEED-IV dataset.
情感识别是情感计算中的一个关键研究课题,因为它在各个领域都有潜在的应用。目前,基于深度学习框架利用脑电图(EEG)信号的情感识别方法已经得到了有效的应用,并取得了令人瞩目的性能。然而,在基于EEG的情感识别中,由于个体之间的差异,跨个体EEG情感识别存在显著的性能下降。为了应对这一挑战,提出了一种混合迁移学习策略,并设计了用于跨个体EEG情感识别的少样本微调网络域适应(DFF-Net)。第一步涉及设计一个专门用于EEG情感识别的域自适应学习模块,即Emo-DA模块。在此之后,利用Emo-DA模块在源域和目标域上对模型进行预训练。随后,专门针对跨个体EEG情感识别测试在目标域上进行微调。这种综合方法有效地利用了域适应和微调的属性,在具有挑战性的跨个体EEG情感识别任务中,模型的准确率得到了显著提高。所提出的DFF-Net在跨个体EEG情感识别任务中超越了现有方法,在SEED数据集上的平均识别准确率达到93.37%,在SEED-IV数据集上达到82.32%。