Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education, School of Artificial Intelligence, Xidian University, Xi'an, People's Republic of China.
Beijing Institute of Mechanical Equipment, Beijing, People's Republic of China.
J Neural Eng. 2022 May 27;19(3). doi: 10.1088/1741-2552/ac6d7d.
Electroencephalogram (EEG)-based affective computing brain-computer interfaces provide the capability for machines to understand human intentions. In practice, people are more concerned with the strength of a certain emotional state over a short period of time, which was called as fine-grained-level emotion in this paper. In this study, we built a fine-grained-level emotion EEG dataset that contains two coarse-grained emotions and four corresponding fine-grained-level emotions. To fully extract the features of the EEG signals, we proposed a corresponding fine-grained emotion EEG network (FG-emotionNet) for spatial-temporal feature extraction. Each feature extraction layer is linked to raw EEG signals to alleviate overfitting and ensure that the spatial features of each scale can be extracted from the raw signals. Moreover, all previous scale features are fused before the current spatial-feature layer to enhance the scale features in the spatial block. Additionally, long short-term memory is adopted as the temporal block to extract the temporal features based on spatial features and classify the category of fine-grained emotions. Subject-dependent and cross-session experiments demonstrated that the performance of the proposed method is superior to that of the representative methods in emotion recognition and similar structure methods with proposed method.
基于脑电图(EEG)的情感计算脑机接口为机器理解人类意图提供了能力。在实践中,人们更关心短时间内某种情绪状态的强度,本文称之为细粒度情绪。在这项研究中,我们构建了一个包含两种粗粒度情绪和四种相应细粒度情绪的细粒度情绪 EEG 数据集。为了充分提取 EEG 信号的特征,我们提出了一种相应的细粒度情绪 EEG 网络(FG-emotionNet),用于时空特征提取。每个特征提取层都与原始 EEG 信号相连,以减轻过拟合并确保可以从原始信号中提取每个尺度的空间特征。此外,在当前空间特征层之前融合所有以前的尺度特征,以增强空间块中的尺度特征。此外,长短期记忆被用作时间块,根据空间特征提取时间特征,并对细粒度情绪的类别进行分类。基于主体的和跨会话的实验表明,所提出的方法在情感识别和具有相似结构的方法方面的性能优于代表性方法。