IEEE Trans Neural Syst Rehabil Eng. 2022;30:390-399. doi: 10.1109/TNSRE.2022.3147260. Epub 2022 Feb 23.
Combining immersive virtual reality (VR) using head-mounted displays (HMDs) with assisting robotic devices might be a promising procedure to enhance neurorehabilitation. However, it is still an open question how immersive virtual environments (VE) should be designed when interacting with rehabilitation robots. In conventional training, the robot is usually not visually represented in the VE, resulting in a visuo-haptic sensory conflict between what users see and feel. This study aimed to investigate how motivation, embodiment, and presence are affected by this visuo-haptic sensory conflict. Using an HMD and a rehabilitation robot, 28 healthy participants performed a path-tracing task, while the robot was either visually reproduced in the VE or not and while the robot either assisted the movements or not. Participants' performance and visual attention were measured during the tasks, and after each visibility/assistance condition, they reported their motivation, presence, and embodiment with questionnaires. We found that, independently of the assistance, the robot visibility did not affect participants' motivation, presence, embodiment, nor task performance. We only found a greater effort/importance reported when the robot was visible. The visual attention was also slightly affected by the robot's visibility. Importantly, we found that the robotic assistance hampered presence and embodiment, but improved motivation. Our results indicate no disadvantage of not reproducing robotic devices in VEs when using HMDs. However, caution must be put when developing assisting controllers, as they might hamper users' affect.
结合沉浸式虚拟现实(VR)头戴式显示器(HMD)和辅助机器人设备可能是增强神经康复的有前途的方法。然而,当与康复机器人交互时,沉浸式虚拟环境(VE)应该如何设计仍然是一个悬而未决的问题。在传统训练中,机器人通常不在 VE 中进行视觉表示,导致用户所见和所感之间存在视触觉感官冲突。本研究旨在探讨这种视触觉感官冲突如何影响动机、体现和存在感。使用 HMD 和康复机器人,28 名健康参与者执行了路径跟踪任务,同时机器人在 VE 中要么进行视觉再现,要么不进行视觉再现,而机器人要么辅助运动,要么不辅助运动。在任务期间测量参与者的表现和视觉注意力,并且在每个可见性/辅助条件之后,他们使用问卷报告他们的动机、存在感和体现感。我们发现,无论是否提供辅助,机器人的可见性都不会影响参与者的动机、存在感、体现感或任务表现。我们只发现当机器人可见时,报告的努力/重要性更大。视觉注意力也受到机器人可见性的轻微影响。重要的是,我们发现机器人辅助会阻碍存在感和体现感,但会提高动机。我们的结果表明,在使用 HMD 时,在 VE 中不再现机器人设备没有不利之处。然而,在开发辅助控制器时必须谨慎,因为它们可能会阻碍用户的情感。