Zitouni M Sami, Park Cheul Young, Lee Uichin, Hadjileontiadis Leontios, Khandoker Ahsan
Annu Int Conf IEEE Eng Med Biol Soc. 2021 Nov;2021:686-689. doi: 10.1109/EMBC46164.2021.9630252.
The automated recognition of human emotions plays an important role in developing machines with emotional intelligence. However, most of the affective computing models are based on images, audio, videos and brain signals. There is a lack of prior studies that focus on utilizing only peripheral physiological signals for emotion recognition, which can ideally be implemented in daily life settings using wearables, e.g., smartwatches. Here, an emotion classification method using peripheral physiological signals, obtained by wearable devices that enable continuous monitoring of emotional states, is presented. A Long Short-Term Memory neural network-based classification model is proposed to accurately predict emotions in real-time into binary levels and quadrants of the arousal-valence space. The peripheral sensored data used here were collected from 20 participants, who engaged in a naturalistic debate. Different annotation schemes were adopted and their impact on the classification performance was explored. Evaluation results demonstrate the capability of our method with a measured accuracy of >93% and >89% for binary levels and quad classes, respectively. This paves the way for enhancing the role of wearable devices in emotional state recognition in everyday life.
人类情绪的自动识别在开发具有情商的机器中起着重要作用。然而,大多数情感计算模型都是基于图像、音频、视频和脑信号的。缺乏仅专注于利用外周生理信号进行情绪识别的先前研究,而这理想情况下可通过可穿戴设备(如智能手表)在日常生活场景中实现。在此,提出了一种使用外周生理信号的情绪分类方法,该信号由能够持续监测情绪状态的可穿戴设备获取。提出了一种基于长短期记忆神经网络的分类模型,以实时准确地将情绪预测为二元水平和唤醒 - 效价空间的象限。这里使用的外周传感数据是从20名参与自然辩论的参与者那里收集的。采用了不同的注释方案,并探讨了它们对分类性能的影响。评估结果表明,我们的方法对于二元水平和四类别的测量准确率分别大于93%和89%。这为增强可穿戴设备在日常生活中情绪状态识别的作用铺平了道路。