Suma Daniel, Meng Jianjun, Edelman Bradley Jay, He Bin
Department of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, PA 15213, United States of America.
Department of Neurology and Neurological Sciences, Stanford University, Stanford, CA 94305, United States of America.
J Neural Eng. 2020 Nov 11;17(6). doi: 10.1088/1741-2552/abc0b4.
The goal of this work is to identify the spatio-temporal facets of state-of-the-art electroencephalography (EEG)-based continuous neurorobotics that need to be addressed, prior to deployment in practical applications at home and in the clinic.Nine healthy human subjects participated in five sessions of one-dimensional (1D) horizontal (LR), 1D vertical (UD) and two-dimensional (2D) neural tracking from EEG. Users controlled a robotic arm and virtual cursor to continuously track a Gaussian random motion target using EEG sensorimotor rhythm modulation via motor imagery (MI) commands. Continuous control quality was analyzed in the temporal and spatial domains separately.Axis-specific errors during 2D tasks were significantly larger than during 1D counterparts. Fatigue rates were larger for control tasks with higher cognitive demand (LR, left- and right-hand MI) compared to those with lower cognitive demand (UD, both hands MI and rest). Additionally robotic arm and virtual cursor control exhibited equal tracking error during all tasks. However, further spatial error analysis of 2D control revealed a significant reduction in tracking quality that was dependent on the visual interference of the physical device. In fact, robotic arm performance was significantly greater than that of virtual cursor control when the users' sightlines were not obstructed.This work emphasizes the need for practical interfaces to be designed around real-world tasks of increased complexity. Here, the dependence of control quality on cognitive task demand emphasizes the need for decoders that facilitate the translation of 1D task mastery to 2D control. When device footprint was accounted for, the introduction of a physical robotic arm improved control quality, likely due to increased user engagement. In general, this work demonstrates the need to consider both the physical footprint of devices, the complexity of training tasks, and the synergy of control strategies during the development of neurorobotic control.
这项工作的目标是,在基于脑电图(EEG)的先进连续神经机器人技术部署到家庭和临床的实际应用之前,识别出其中需要解决的时空方面的问题。九名健康人类受试者参与了五轮基于脑电图的一维(1D)水平(LR)、一维垂直(UD)和二维(2D)神经跟踪实验。用户通过运动想象(MI)命令,利用脑电图传感器运动节律调制,控制机械臂和虚拟光标持续跟踪高斯随机运动目标。分别在时间和空间域分析了连续控制质量。二维任务期间特定轴的误差显著大于一维任务。与认知需求较低的任务(UD,双手MI和休息)相比,认知需求较高的控制任务(LR,左手和右手MI)的疲劳率更高。此外,在所有任务中,机械臂和虚拟光标的控制表现出相同的跟踪误差。然而,二维控制的进一步空间误差分析显示,跟踪质量显著下降,这取决于物理设备的视觉干扰。事实上,当用户视线不受阻碍时,机械臂的性能明显优于虚拟光标的控制。这项工作强调了需要围绕复杂性增加的现实世界任务设计实用接口。在这里,控制质量对认知任务需求的依赖性强调了需要解码器,以促进将一维任务掌握转化为二维控制。当考虑设备占用空间时,引入物理机械臂提高了控制质量,这可能是由于用户参与度提高。总体而言,这项工作表明,在神经机器人控制的开发过程中,需要考虑设备的物理占用空间、训练任务的复杂性以及控制策略的协同作用。