IEEE Trans Vis Comput Graph. 2024 May;30(5):2390-2399. doi: 10.1109/TVCG.2024.3372035. Epub 2024 Apr 19.
We present Virtual Reality Self Co-embodiment, a new method for post-stroke upper limb rehabilitation. It is inspired by mirror therapy, where the patient's healthy arm is involved in recovering the affected arm's motion. By tracking the user's head, wrists, and fingers' positions, our new approach allows the handicapped arm to control a digital avatar in order to pursue a reaching task. We apply the concept of virtual co-embodiment to use the information from the unaffected arm and complete the affected limb's impaired motion, which is our added unique feature. This requires users to mechanically involve the incapacitated area as much as possible, prioritizing actual movement rather than the sole imagination of it. As a result, subjects will see a seemingly normally functional virtual arm primarily controlled by their handicapped extremity, but with the constant support of their healthy limb's motion. Our experiment compares the task execution performance and embodiment perceived when interacting with both mirror therapy and our proposed technique. We found that our approach's provided sense of ownership is mildly impacted by users' motion planning response times, which mirror therapy does not exhibit. We also observed that mirror therapy's sense of ownership is moderately affected by the subject's proficiency while executing the assigned task, which our new method did not display. The results indicate that our proposed method provides similar embodiment and rehabilitation capabilities to those perceived from existing mirror therapy. This experiment was performed in healthy individuals to have an unbiased comparison of how mirror therapy's and VRSelfCo's task performance and degree of virtual embodiment compare, but future work explores the possibility of applying this new approach to actual post-stroke patients.
我们提出了虚拟现实自我共现,一种新的脑卒中后上肢康复方法。它的灵感来自镜像疗法,即患者的健康手臂参与恢复受影响手臂的运动。通过跟踪用户的头部、手腕和手指的位置,我们的新方法允许残疾手臂控制数字替身,以完成伸展任务。我们应用虚拟共现的概念,利用未受影响手臂的信息来完成受影响肢体的受损运动,这是我们的独特之处。这需要用户尽可能多地机械地参与到丧失功能的区域,优先考虑实际运动,而不仅仅是想象它。因此,受试者将看到一个看似正常功能的虚拟手臂,主要由他们残疾的肢体控制,但始终由他们健康肢体的运动支持。我们的实验比较了与镜像疗法和我们提出的技术交互时的任务执行性能和感知的体现。我们发现,我们的方法提供的所有权感受到用户运动规划响应时间的轻微影响,而镜像疗法则没有表现出这种影响。我们还观察到,镜像疗法的所有权感受到受试者执行指定任务的熟练程度的中度影响,而我们的新方法则没有表现出这种影响。结果表明,我们提出的方法提供了与从现有的镜像疗法中感知到的相似的体现和康复能力。这项实验是在健康个体中进行的,以便在不偏不倚的情况下比较镜像疗法和 VRSelfCo 的任务表现和虚拟体现程度的差异,但未来的工作探讨了将这种新方法应用于实际脑卒中患者的可能性。