Department of Sensors and Biomedical Tech, School of Electronics Engineering, Vellore Institute of Technology;
Department of Orthopaedic Surgery, University of Arizona.
J Vis Exp. 2024 May 10(207). doi: 10.3791/66859.
This study introduces an innovative framework for neurological rehabilitation by integrating brain-computer interfaces (BCI) and virtual reality (VR) technologies with the customization of three-dimensional (3D) avatars. Traditional approaches to rehabilitation often fail to fully engage patients, primarily due to their inability to provide a deeply immersive and interactive experience. This research endeavors to fill this gap by utilizing motor imagery (MI) techniques, where participants visualize physical movements without actual execution. This method capitalizes on the brain's neural mechanisms, activating areas involved in movement execution when imagining movements, thereby facilitating the recovery process. The integration of VR's immersive capabilities with the precision of electroencephalography (EEG) to capture and interpret brain activity associated with imagined movements forms the core of this system. Digital Twins in the form of personalized 3D avatars are employed to significantly enhance the sense of immersion within the virtual environment. This heightened sense of embodiment is crucial for effective rehabilitation, aiming to bolster the connection between the patient and their virtual counterpart. By doing so, the system not only aims to improve motor imagery performance but also seeks to provide a more engaging and efficacious rehabilitation experience. Through the real-time application of BCI, the system allows for the direct translation of imagined movements into virtual actions performed by the 3D avatar, offering immediate feedback to the user. This feedback loop is essential for reinforcing the neural pathways involved in motor control and recovery. The ultimate goal of the developed system is to significantly enhance the effectiveness of motor imagery exercises by making them more interactive and responsive to the user's cognitive processes, thereby paving a new path in the field of neurological rehabilitation.
本研究通过将脑机接口 (BCI) 和虚拟现实 (VR) 技术与三维 (3D) 头像的定制相结合,引入了一种神经康复的创新框架。传统的康复方法往往无法充分吸引患者,主要是因为它们无法提供深度沉浸式和互动式体验。本研究旨在通过利用运动想象 (MI) 技术来填补这一空白,参与者在不实际执行的情况下想象身体运动。这种方法利用了大脑的神经机制,在想象运动时激活与运动执行相关的区域,从而促进康复过程。将 VR 的沉浸式功能与脑电图 (EEG) 的精确性相结合,以捕获和解释与想象运动相关的大脑活动,构成了该系统的核心。以个性化 3D 头像形式呈现的数字孪生体被用于显著增强虚拟环境中的沉浸感。这种增强的存在感对于有效的康复至关重要,旨在加强患者与其虚拟对应物之间的联系。通过这样做,该系统不仅旨在提高运动想象性能,还旨在提供更具吸引力和更有效的康复体验。通过实时应用 BCI,系统允许将想象运动直接转换为 3D 头像执行的虚拟动作,并向用户提供即时反馈。这种反馈回路对于加强涉及运动控制和恢复的神经通路至关重要。开发系统的最终目标是通过使运动想象练习更加互动和响应用户的认知过程,显著提高其效果,从而为神经康复领域开辟新的途径。