Xu Baoguo, Liu Deping, Xue Muhui, Miao Minmin, Hu Cong, Song Aiguo
State Key Laboratory of Bioelectronics, Jiangsu Key Laboratory of Remote Measurement and Control, School of Instrument Science and Engineering, Southeast University, Nanjing 210096, China.
School of Information Engineering, Huzhou University, Huzhou 313000, China.
Comput Struct Biotechnol J. 2023 Jul 29;22:3-16. doi: 10.1016/j.csbj.2023.07.033. eCollection 2023.
Although the electroencephalography (EEG) based brain-computer interface (BCI) has been successfully developed for rehabilitation and assistance, it is still challenging to achieve continuous control of a brain-actuated mobile robot system. In this study, we propose a continuous shared control strategy combining continuous BCI and autonomous navigation for a mobile robot system. The weight of shared control is designed to dynamically adjust the fusion of continuous BCI control and autonomous navigation. During this process, the system uses the visual-based simultaneous localization and mapping (SLAM) method to construct environmental maps. After obtaining the global optimal path, the system utilizes the brain-based shared control dynamic window approach (BSC-DWA) to evaluate safe and reachable trajectories while considering shared control velocity. Eight subjects participated in two-stage training, and six of these eight subjects participated in online shared control experiments. The training results demonstrated that naïve subjects could achieve continuous control performance with an average percent valid correct rate of approximately 97 % and an average total correct rate of over 80 %. The results of online shared control experiments showed that all of the subjects could complete navigation tasks in an unknown corridor with continuous shared control. Therefore, our experiments verified the feasibility and effectiveness of the proposed system combining continuous BCI, shared control, autonomous navigation, and visual SLAM. The proposed continuous shared control framework shows great promise in BCI-driven tasks, especially navigation tasks for brain-driven assistive mobile robots and wheelchairs in daily applications.
尽管基于脑电图(EEG)的脑机接口(BCI)已成功开发用于康复和辅助,但实现对脑驱动移动机器人系统的连续控制仍然具有挑战性。在本研究中,我们为移动机器人系统提出了一种结合连续BCI和自主导航的连续共享控制策略。共享控制的权重旨在动态调整连续BCI控制和自主导航的融合。在此过程中,系统使用基于视觉的同步定位与地图构建(SLAM)方法来构建环境地图。在获得全局最优路径后,系统利用基于脑的共享控制动态窗口方法(BSC-DWA)在考虑共享控制速度的同时评估安全且可达的轨迹。八名受试者参加了两阶段训练,其中六名受试者参加了在线共享控制实验。训练结果表明,新手受试者能够实现连续控制性能,平均有效正确率约为97%,平均总正确率超过80%。在线共享控制实验结果表明,所有受试者都能在连续共享控制下在未知走廊中完成导航任务。因此,我们的实验验证了所提出的结合连续BCI、共享控制、自主导航和视觉SLAM系统的可行性和有效性。所提出的连续共享控制框架在BCI驱动的任务中显示出巨大潜力,特别是在日常应用中用于脑驱动辅助移动机器人和轮椅的导航任务。