Sawabe Taishi, Honda Suguru, Sato Wataru, Ishikura Tomoki, Kanbara Masayuki, Yoshikawa Sakiko, Fujimoto Yuichiro, Kato Hirokazu
Division of Information Science, Nara Institute of Science and Technology (NAIST), 8916-5 Takayama, Ikoma, Nara, 630-0192, Japan.
Psychological Process Research Team, Guardian Robot Project, RIKEN, 2-2-2 Hikaridai, Seika, Soraku District, Kyoto, 619-0288, Japan.
Sci Rep. 2022 Apr 27;12(1):6884. doi: 10.1038/s41598-022-10503-6.
A gentle touch is an essential part of human interaction that produces a positive care effect. Previously, robotics studies have shown that robots can reproduce a gentle touch that elicits similar, positive emotional responses in humans. However, whether the positive emotional effects of a robot's touch combined with speech can be enhanced using a multimodal approach remains unclear. This study supports the hypothesis that a multimodal interaction combining gentle touch and speech by a robot enhances positive emotional responses. Here, we conducted an experiment using a robotic arm to perform a gentle touch combined with speech and compared three conditions: touch alone, speech alone, and touch with speech. We assessed participants' subjective ratings of valence, arousal, and human likeliness using subjective emotional responses. Furthermore, we recorded facial electromyography (EMG) from the corrugator supercilii and zygomaticus major muscles and measured skin conductance levels (SCLs) as physiological emotional responses. Our results show that touch combined with speech elicited higher subjective valence and arousal ratings, stronger zygomaticus major EMG and SCL activities than touch alone. The results suggest that the positive emotional effects of robotic touch can be boosted by combining elements of speech.
轻柔的触摸是人际互动的重要组成部分,能产生积极的护理效果。此前,机器人学研究表明,机器人可以再现轻柔的触摸,从而在人类身上引发类似的积极情绪反应。然而,机器人的触摸与语音相结合所产生的积极情绪效果能否通过多模态方法得到增强,目前尚不清楚。本研究支持这样一种假设,即机器人将轻柔的触摸与语音相结合的多模态互动会增强积极的情绪反应。在此,我们进行了一项实验,使用机械臂进行轻柔触摸并结合语音,并比较了三种情况:仅触摸、仅语音以及触摸加语音。我们使用主观情绪反应评估了参与者对效价、唤醒度和人类相似度的主观评分。此外,我们记录了皱眉肌和颧大肌的面部肌电图(EMG),并测量了皮肤电导水平(SCL)作为生理情绪反应。我们的结果表明,与仅触摸相比,触摸与语音相结合引发了更高的主观效价和唤醒度评分、更强的颧大肌EMG和SCL活动。结果表明,通过结合语音元素可以增强机器人触摸的积极情绪效果。