Tanabe Hiroki, Shiraishi Toshihiko, Sato Haruhiko, Nihei Misato, Inoue Takenobu, Kuwabara Chika
Graduate School of Environment and Information Sciences, Yokohama National University, Yokohama, Japan.
Department of Rehabilitation, Kansai Medical University, Hirakata, Japan.
Disabil Rehabil Assist Technol. 2024 May;19(4):1319-1326. doi: 10.1080/17483107.2023.2170478. Epub 2023 Jan 25.
This study proposes a concept for emotion recognition systems for children with profound intellectual and multiple disabilities (PIMD) based on artificial intelligence (AI) using physiological and motion signals.
First, the heartbeat interval (R-R interval, RRI) of a child with PIMD was measured, and the correlation between the RRI and emotion was briefly tested in a preliminary experiment. Then, a concept based on AI for emotion recognition systems for children with PIMD was created using physiological and motion signals, and an emotion recognition system based on the proposed concept was developed using a random forest classifier taking as inputs the RRI, eye gaze, and other data acquired using low physical burden sensors. Subsequently, the developed emotion recognition system was evaluated, validating the proposed concept. Finally, we proposed a validated concept for emotion recognition systems.
A correlation was found between the RRI and emotion. The emotion recognition system was created based on the proposed concept and tested. According to the results, the recognition rate of "negative" and "not negative" of 70.4% ± 6.1% (Mean ± S.D.) of the developed emotion recognition system was higher than 48.5% ± 5.0% of an unfamiliar person used as a control.
The results indicate that the proposed concept for emotion recognition systems is useful for communicating with children with PIMD.
本研究基于人工智能（AI），利用生理和运动信号，为重度智力和多重残疾（PIMD）儿童提出一种情感识别系统的概念。
首先，测量一名PIMD儿童的心跳间期（R-R间期，RRI），并在初步实验中简要测试RRI与情感之间的相关性。然后，利用生理和运动信号创建基于AI的PIMD儿童情感识别系统概念，并使用随机森林分类器开发基于该概念的情感识别系统，将RRI、目光注视以及使用低身体负担传感器获取的其他数据作为输入。随后，对开发的情感识别系统进行评估，验证所提出的概念。最后，我们提出了一个经过验证的情感识别系统概念。
发现RRI与情感之间存在相关性。基于所提出的概念创建并测试了情感识别系统。结果显示，开发的情感识别系统对“负面”和“非负面”的识别率为70.4%±6.1%（均值±标准差），高于作为对照的不熟悉人员的48.5%±5.0%。
结果表明，所提出的情感识别系统概念对于与PIMD儿童进行交流是有用的。
