IEEE Trans Vis Comput Graph. 2024 Nov;30(11):7086-7096. doi: 10.1109/TVCG.2024.3456147. Epub 2024 Oct 10.
Brain-computer interfaces (BCI) are widely used in the field of disability assistance and rehabilitation, and virtual reality (VR) is increasingly used for visual guidance of BCI-MI (motor imagery). Therefore, how to improve the quality of electroencephalogram (EEG) signals for MI in VR has emerged as a critical issue. People can perform MI more easily when they visualize the hand used for visual guidance as their own, and the Rubber Hand Illusion (RHI) can increase people's ownership of the prosthetic hand. We proposed to induce RHI in VR to enhance participants' MI ability and designed five methods of inducing RHI, namely active movement, haptic stimulation, passive movement, active movement mixed with haptic stimulation, and passive movement mixed with haptic stimulation, respectively. We constructed a first-person training scenario to train participants' MI ability through the five induction methods. The experimental results showed that through the training, the participants' feeling of ownership of the virtual hand in VR was enhanced, and the MI ability was improved. Among them, the method of mixing active movement and tactile stimulation proved to have a good effect on enhancing MI. Finally, we developed a BCI system in VR utilizing the above training method, and the performance of the participants improved after the training. This also suggests that our proposed method is promising for future application in BCI rehabilitation systems.
脑机接口(BCI)在残疾辅助和康复领域得到了广泛应用,虚拟现实(VR)也越来越多地用于 BCI-MI(运动想象)的视觉引导。因此,如何提高 VR 中 MI 的脑电图(EEG)信号质量成为一个关键问题。当人们将用于视觉引导的手想象成自己的手时,他们可以更轻松地进行 MI,而橡胶手错觉(RHI)可以增加人们对手套的拥有感。我们提出在 VR 中诱导 RHI 以增强参与者的 MI 能力,并设计了五种诱导 RHI 的方法,即主动运动、触觉刺激、被动运动、主动运动混合触觉刺激和被动运动混合触觉刺激,分别。我们构建了一个第一人称训练场景,通过这五种诱导方法来训练参与者的 MI 能力。实验结果表明,通过训练,参与者在 VR 中对虚拟手的所有权感增强,MI 能力得到提高。其中,主动运动和触觉刺激混合的方法被证明对增强 MI 有很好的效果。最后,我们利用上述训练方法在 VR 中开发了一个 BCI 系统,参与者在训练后表现有所提高。这也表明,我们提出的方法在未来的 BCI 康复系统中有很好的应用前景。