Digital Health-Connected Healthcare, Hasso Plattner Institute, University of Potsdam, 14482 Potsdam, Germany.
Sensors (Basel). 2023 Feb 21;23(5):2387. doi: 10.3390/s23052387.
Giving emotional intelligence to machines can facilitate the early detection and prediction of mental diseases and symptoms. Electroencephalography (EEG)-based emotion recognition is widely applied because it measures electrical correlates directly from the brain rather than indirect measurement of other physiological responses initiated by the brain. Therefore, we used non-invasive and portable EEG sensors to develop a real-time emotion classification pipeline. The pipeline trains different binary classifiers for Valence and Arousal dimensions from an incoming EEG data stream achieving a 23.9% (Arousal) and 25.8% (Valence) higher F1-Score on the state-of-art AMIGOS dataset than previous work. Afterward, the pipeline was applied to the curated dataset from 15 participants using two consumer-grade EEG devices while watching 16 short emotional videos in a controlled environment. Mean F1-Scores of 87% (Arousal) and 82% (Valence) were achieved for an immediate label setting. Additionally, the pipeline proved to be fast enough to achieve predictions in real-time in a live scenario with delayed labels while continuously being updated. The significant discrepancy from the readily available labels on the classification scores leads to future work to include more data. Thereafter, the pipeline is ready to be used for real-time applications of emotion classification.
赋予机器情商可以促进心理疾病和症状的早期检测和预测。基于脑电图(EEG)的情绪识别应用广泛,因为它直接测量来自大脑的电相关,而不是间接测量大脑引发的其他生理反应。因此,我们使用非侵入性和便携式 EEG 传感器来开发实时情绪分类管道。该管道从传入的 EEG 数据流中为 Valence 和 Arousal 维度训练不同的二进制分类器,在最先进的 AMIGOS 数据集上比以前的工作实现了 23.9%(Arousal)和 25.8%(Valence)的更高 F1 得分。之后,该管道在受控环境下使用两个消费级 EEG 设备观看 16 个短情绪视频时,应用于来自 15 名参与者的精选数据集。即时标签设置的平均 F1 得分为 87%(Arousal)和 82%(Valence)。此外,该管道被证明足够快,可以在实时场景中进行实时预测,同时使用延迟标签进行持续更新。分类分数与现成标签之间存在显著差异,这导致未来的工作需要包括更多的数据。此后,该管道已准备好用于实时情绪分类应用。