Choi Eun Jeong, Kim Dong Keun
Department of Computer Science, Graduate School, Sangmyung University, Seoul, Korea.
Department of Intelligent Engineering Informatics for Human, College of Convergence Engineering, Sangmyung University, Seoul, Korea.
Healthc Inform Res. 2018 Oct;24(4):309-316. doi: 10.4258/hir.2018.24.4.309. Epub 2018 Oct 31.
Both the valence and arousal components of affect are important considerations when managing mental healthcare because they are associated with affective and physiological responses. Research on arousal and valence analysis, which uses images, texts, and physiological signals that employ deep learning, is actively underway; research investigating how to improve the recognition rate is needed. The goal of this research was to design a deep learning framework and model to classify arousal and valence, indicating positive and negative degrees of emotion as high or low.
The proposed arousal and valence classification model to analyze the affective state was tested using data from 40 channels provided by a dataset for emotion analysis using electrocardiography (EEG), physiological, and video signals (the DEAP dataset). Experiments were based on 10 selected featured central and peripheral nervous system data points, using long short-term memory (LSTM) as a deep learning method.
The arousal and valence were classified and visualized on a two-dimensional coordinate plane. Profiles were designed depending on the number of hidden layers, nodes, and hyperparameters according to the error rate. The experimental results show an arousal and valence classification model accuracy of 74.65 and 78%, respectively. The proposed model performed better than previous other models.
The proposed model appears to be effective in analyzing arousal and valence; specifically, it is expected that affective analysis using physiological signals based on LSTM will be possible without manual feature extraction. In a future study, the classification model will be adopted in mental healthcare management systems.
在管理精神卫生保健时,情感的效价和唤醒成分都是重要的考虑因素,因为它们与情感和生理反应相关。目前正在积极开展关于使用图像、文本和采用深度学习的生理信号进行唤醒和效价分析的研究;需要开展研究来探究如何提高识别率。本研究的目标是设计一个深度学习框架和模型,用于对唤醒和效价进行分类,将情感的正负程度表示为高或低。
使用来自一个用于情感分析的数据集提供的40个通道的数据(该数据集包含心电图(EEG)、生理和视频信号,即DEAP数据集),对所提出的用于分析情感状态的唤醒和效价分类模型进行测试。实验基于10个选定的中枢和外周神经系统特征数据点,使用长短期记忆(LSTM)作为深度学习方法。
在二维坐标平面上对唤醒和效价进行分类并可视化。根据错误率,依据隐藏层数量、节点和超参数设计了配置文件。实验结果表明,唤醒和效价分类模型的准确率分别为74.65%和78%。所提出的模型比之前的其他模型表现更好。
所提出的模型似乎在分析唤醒和效价方面有效;具体而言,预计无需手动特征提取,基于LSTM使用生理信号进行情感分析将成为可能。在未来的研究中,该分类模型将被应用于精神卫生保健管理系统。