Abdollahi Hojjat, Mahoor Mohammad H, Zandie Rohola, Siewierski Jarid, Qualls Sara H
Department of Electrical and Computer Engineering, University of Denver.
DreamFace Technologies, LLC.
IEEE Trans Affect Comput. 2023 Jul-Sep;14(3):2020-2032. doi: 10.1109/taffc.2022.3143803. Epub 2022 Jan 18.
This paper presents our recent research on integrating artificial emotional intelligence in a social robot (Ryan) and studies the robot's effectiveness in engaging older adults. Ryan is a socially assistive robot designed to provide companionship for older adults with depression and dementia through conversation. We used two versions of Ryan for our study, empathic and non-empathic. The empathic Ryan utilizes a multimodal emotion recognition algorithm and a multimodal emotion expression system. Using different input modalities for emotion, i.e. facial expression and speech sentiment, the empathic Ryan detects users emotional state and utilizes an affective dialogue manager to generate a response. On the other hand, the non-empathic Ryan lacks facial expression and uses scripted dialogues that do not factor in the users emotional state. We studied these two versions of Ryan with 10 older adults living in a senior care facility. The statistically significant improvement in the users' reported face-scale mood measurement indicates an overall positive effect from the interaction with both the empathic and non-empathic versions of Ryan. However, the number of spoken words measurement and the exit survey analysis suggest that the users perceive the empathic Ryan as more engaging and likable.
本文介绍了我们最近关于将人工情感智能集成到社交机器人(瑞安)中的研究,并研究了该机器人在吸引老年人方面的有效性。瑞安是一款社交辅助机器人,旨在通过对话为患有抑郁症和痴呆症的老年人提供陪伴。我们在研究中使用了两个版本的瑞安,即有同理心的和没有同理心的。有同理心的瑞安利用多模态情感识别算法和多模态情感表达系统。通过使用不同的情感输入模态,即面部表情和语音情感,有同理心的瑞安检测用户的情绪状态,并利用情感对话管理器生成回应。另一方面,没有同理心的瑞安缺乏面部表情,使用的是不考虑用户情绪状态的脚本化对话。我们对居住在一家老年护理机构的10名老年人使用这两个版本的瑞安进行了研究。用户报告的面部表情量表情绪测量结果有统计学意义的改善,表明与有同理心和没有同理心版本的瑞安互动都产生了总体积极影响。然而,口语单词数量测量和退出调查分析表明,用户认为有同理心的瑞安更具吸引力和亲和力。