Mouri Fatima Islam, Valderrama Camilo E, Camorlinga Sergio G
Department of Applied Computer Science, University of Winnipeg, Winnipeg, MB, Canada.
Front Psychol. 2023 Aug 17;14:1217178. doi: 10.3389/fpsyg.2023.1217178. eCollection 2023.
The left and right hemispheres of the brain process emotion differently. Neuroscientists have proposed two models to explain this difference. The first model states that the right hemisphere is dominant over the left to process all emotions. In contrast, the second model states that the left hemisphere processes positive emotions, whereas the right hemisphere processes negative emotions. Previous studies have used these asymmetry models to enhance the classification of emotions in machine learning models. However, little research has been conducted to explore how machine learning models can help identify associations between hemisphere asymmetries and emotion processing. To address this gap, we conducted two experiments using a subject-independent approach to explore how the asymmetry of the brain hemispheres is involved in processing happiness, sadness, fear, and neutral emotions. We analyzed electroencephalogram (EEG) signals from 15 subjects collected while they watched video clips evoking these four emotions. We derived asymmetry features from the recorded EEG signals by calculating the log ratio between the relative energy of symmetrical left and right nodes. Using the asymmetry features, we trained four binary logistic regressions, one for each emotion, to identify which features were more relevant to the predictions. The average AUC-ROC across the 15 subjects was 56.2, 54.6, 51.6, and 58.4% for neutral, sad, fear, and happy, respectively. We validated these results with an independent dataset, achieving comparable AUC-ROC values. Our results showed that brain lateralization was observed primarily in the alpha frequency bands, whereas for the other frequency bands, both hemispheres were involved in emotion processing. Furthermore, the logistic regression analysis indicated that the gamma and alpha bands were the most relevant for predicting emotional states, particularly for the lateral frontal, parietal, and temporal EEG pairs, such as FT7-FT8, T7-T8, and TP7-TP8. These findings provide valuable insights into which brain areas and frequency bands need to be considered when developing predictive models for emotion recognition.
大脑的左右半球处理情绪的方式不同。神经科学家提出了两种模型来解释这种差异。第一种模型认为,右半球在处理所有情绪方面比左半球占主导地位。相比之下,第二种模型认为,左半球处理积极情绪,而右半球处理消极情绪。先前的研究使用这些不对称模型来增强机器学习模型中的情绪分类。然而,很少有研究探讨机器学习模型如何有助于识别半球不对称与情绪处理之间的关联。为了填补这一空白,我们采用独立于受试者的方法进行了两项实验,以探索大脑半球的不对称性如何参与处理快乐、悲伤、恐惧和中性情绪。我们分析了15名受试者在观看引发这四种情绪的视频片段时收集的脑电图(EEG)信号。我们通过计算对称的左右节点相对能量之间的对数比率,从记录的EEG信号中得出不对称特征。利用这些不对称特征,我们训练了四个二元逻辑回归模型,每种情绪一个,以确定哪些特征与预测更相关。15名受试者的中性、悲伤、恐惧和快乐情绪的平均AUC-ROC分别为56.2%、54.6%、51.6%和58.4%。我们用一个独立数据集验证了这些结果,得到了可比的AUC-ROC值。我们的结果表明,大脑偏侧化主要出现在阿尔法频段,而对于其他频段,两个半球都参与了情绪处理。此外,逻辑回归分析表明,伽马和阿尔法频段与预测情绪状态最相关,特别是对于外侧额叶、顶叶和颞叶的EEG对,如FT7-FT8、T7-T8和TP7-TP8。这些发现为开发情绪识别预测模型时需要考虑哪些脑区和频段提供了有价值的见解。