Lindig-León Cecilia, Rimbert Sébastien, Bougrain Laurent
Université de Lorraine, CNRS, LORIA, Inria, Nancy, France.
Faculty of Engineering, Computer Science and Psychology, Institute of Neural Information Processing, Ulm University, Ulm, Germany.
Front Neurosci. 2020 Nov 19;14:559858. doi: 10.3389/fnins.2020.559858. eCollection 2020.
Motor imagery (MI) allows the design of self-paced brain-computer interfaces (BCIs), which can potentially afford an intuitive and continuous interaction. However, the implementation of non-invasive MI-based BCIs with more than three commands is still a difficult task. First, the number of MIs for decoding different actions is limited by the constraint of maintaining an adequate spacing among the corresponding sources, since the electroencephalography (EEG) activity from near regions may add up. Second, EEG generates a rather noisy image of brain activity, which results in a poor classification performance. Here, we propose a solution to address the limitation of identifiable motor activities by using combined MIs (i.e., MIs involving 2 or more body parts at the same time). And we propose two new multilabel uses of the Common Spatial Pattern (CSP) algorithm to optimize the signal-to-noise ratio, namely MC2CMI and MC2SMI approaches. We recorded EEG signals from seven healthy subjects during an 8-class EEG experiment including the rest condition and all possible combinations using the left hand, right hand, and feet. The proposed multilabel approaches convert the original 8-class problem into a set of three binary problems to facilitate the use of the CSP algorithm. In the case of the MC2CMI method, each binary problem groups together in one class all the MIs engaging one of the three selected body parts, while the rest of MIs that do not engage the same body part are grouped together in the second class. In this way, for each binary problem, the CSP algorithm produces features to determine if the specific body part is engaged in the task or not. Finally, three sets of features are merged together to predict the user intention by applying an 8-class linear discriminant analysis. The MC2SMI method is quite similar, the only difference is that any of the combined MIs is considered during the training phase, which drastically accelerates the calibration time. For all subjects, both the MC2CMI and the MC2SMI approaches reached a higher accuracy than the classic pair-wise (PW) and one-vs.-all (OVA) methods. Our results show that, when brain activity is properly modulated, multilabel approaches represent a very interesting solution to increase the number of commands, and thus to provide a better interaction.
运动想象(MI)使得自定节奏的脑机接口(BCI)得以设计,这种接口有可能实现直观且持续的交互。然而,实现具有三个以上命令的基于非侵入性MI的BCI仍然是一项艰巨的任务。首先,用于解码不同动作的MI数量受到在相应源之间保持足够间距这一限制的制约,因为来自附近区域的脑电图(EEG)活动可能会叠加。其次,EEG生成的大脑活动图像噪声较大,这导致分类性能较差。在此,我们提出一种解决方案,通过使用组合运动想象(即同时涉及2个或更多身体部位的运动想象)来解决可识别运动活动的局限性。并且我们提出了通用空间模式(CSP)算法的两种新的多标签用法,以优化信噪比,即MC2CMI和MC2SMI方法。在一个包括静息状态以及左手、右手和双脚所有可能组合的8类EEG实验中,我们记录了7名健康受试者的EEG信号。所提出的多标签方法将原始的8类问题转换为一组三个二元问题,以方便使用CSP算法。在MC2CMI方法中,每个二元问题将所有涉及三个选定身体部位之一的运动想象归为一类,而不涉及同一身体部位的其余运动想象归为另一类。通过这种方式,对于每个二元问题,CSP算法生成特征以确定特定身体部位是否参与了任务。最后,通过应用8类线性判别分析将三组特征合并在一起以预测用户意图。MC2SMI方法非常相似,唯一的区别在于在训练阶段会考虑任何组合运动想象,这极大地加快了校准时间。对于所有受试者,MC2CMI和MC2SMI方法都比经典的成对(PW)和一对多(OVA)方法达到了更高的准确率。我们的结果表明,当大脑活动得到适当调制时,多标签方法是增加命令数量从而提供更好交互的一个非常有趣的解决方案。