Department of Sports ICT Convergence, Sangmyung University Graduate School, Seoul 03016, Korea.
Department of Psychiatry and Neuroscience Research Institute, Seoul National University College of Medicine, SMG-SNU Boramae Medical Center, Seoul 07061, Korea.
Sensors (Basel). 2020 Feb 6;20(3):866. doi: 10.3390/s20030866.
This study aimed to design an optimal emotion recognition method using multiple physiological signal parameters acquired by bio-signal sensors for improving the accuracy of classifying individual emotional responses. Multiple physiological signals such as respiration (RSP) and heart rate variability (HRV) were acquired in an experiment from 53 participants when six basic emotion states were induced. Two RSP parameters were acquired from a chest-band respiration sensor, and five HRV parameters were acquired from a finger-clip blood volume pulse (BVP) sensor. A newly designed deep-learning model based on a convolutional neural network (CNN) was adopted for detecting the identification accuracy of individual emotions. Additionally, the signal combination of the acquired parameters was proposed to obtain high classification accuracy. Furthermore, a dominant factor influencing the accuracy was found by comparing the relativeness of the parameters, providing a basis for supporting the results of emotion classification. The users of this proposed model will soon be able to improve the emotion recognition model further based on CNN using multimodal physiological signals and their sensors.
本研究旨在设计一种使用生物信号传感器获取的多种生理信号参数的最优情绪识别方法,以提高个体情绪反应分类的准确性。在实验中,从 53 名参与者中采集了呼吸(RSP)和心率变异性(HRV)等多种生理信号,当诱发六种基本情绪状态时。从胸带呼吸传感器采集了两个 RSP 参数,从指夹式血压脉搏(BVP)传感器采集了五个 HRV 参数。采用了一种新设计的基于卷积神经网络(CNN)的深度学习模型来检测个体情绪的识别准确性。此外,还提出了获取参数的信号组合,以获得高分类准确性。此外,通过比较参数的相关性,发现了影响准确性的主导因素,为支持情绪分类的结果提供了依据。该模型的用户将很快能够使用多模态生理信号及其传感器进一步改进基于 CNN 的情绪识别模型。