Kalashami Mahsa Pourhosein, Pedram Mir Mohsen, Sadr Hossein
Department of Electrical and Computer Engineering, Faculty of Engineering, Kharazmi University, Tehran 15719-14911, Iran.
Department of Computer Engineering, Rahbord Shomal Institute of Higher Education, Rasht, Iran.
Comput Intell Neurosci. 2022 Mar 28;2022:7028517. doi: 10.1155/2022/7028517. eCollection 2022.
Emotion recognition is a challenging problem in Brain-Computer Interaction (BCI). Electroencephalogram (EEG) gives unique information about brain activities that are created due to emotional stimuli. This is one of the most substantial advantages of brain signals in comparison to facial expression, tone of voice, or speech in emotion recognition tasks. However, the lack of EEG data and high dimensional EEG recordings lead to difficulties in building effective classifiers with high accuracy. In this study, data augmentation and feature extraction techniques are proposed to solve the lack of data problem and high dimensionality of data, respectively. In this study, the proposed method is based on deep generative models and a data augmentation strategy called Conditional Wasserstein GAN (CWGAN), which is applied to the extracted features to regenerate additional EEG features. DEAP dataset is used to evaluate the effectiveness of the proposed method. Finally, a standard support vector machine and a deep neural network with different tunes were implemented to build effective models. Experimental results show that using the additional augmented data enhances the performance of EEG-based emotion recognition models. Furthermore, the mean accuracy of classification after data augmentation is increased 6.5% for valence and 3.0% for arousal, respectively.
情感识别是脑机交互(BCI)中的一个具有挑战性的问题。脑电图(EEG)提供了因情感刺激而产生的大脑活动的独特信息。与面部表情、语音语调或情感识别任务中的语音相比,这是脑信号最显著的优势之一。然而,EEG数据的缺乏和高维EEG记录导致难以构建具有高精度的有效分类器。在本研究中,分别提出了数据增强和特征提取技术来解决数据缺乏问题和数据的高维性。在本研究中,所提出的方法基于深度生成模型和一种称为条件瓦瑟斯坦生成对抗网络(CWGAN)的数据增强策略,该策略应用于提取的特征以再生额外的EEG特征。使用DEAP数据集来评估所提出方法的有效性。最后,实现了一个标准支持向量机和一个具有不同调优的深度神经网络来构建有效模型。实验结果表明,使用额外的增强数据可提高基于EEG的情感识别模型的性能。此外,数据增强后的分类平均准确率在效价方面提高了6.5%,在唤醒方面提高了3.0%。