Rusev Georgi, Yordanov Svetlozar, Nedelcheva Simona, Banderov Alexander, Lafaye de Micheaux Hugo, Sauter-Starace Fabien, Aksenova Tetiana, Koprinkova-Hristova Petia, Kasabov Nikola
Institute of Information and Communication Technologies, Bulgarian Academy of Sciences, 1113 Sofia, Bulgaria.
Univ. Grenoble Alpes, CEA, Leti, Clinatec, F-38000 Grenoble, France.
Biomimetics (Basel). 2025 Aug 7;10(8):518. doi: 10.3390/biomimetics10080518.
In our previous work, we developed a neuromorphic decoder of intended movements of tetraplegic patients using ECoG recordings from the brain motor cortex, called Motor Control Decoder (MCD). Even though the training data are labeled based on the desired movement, there is no guarantee that the patient is satisfied by the action of the effectors. Hence, the need for the classification of brain signals as satisfactory/unsatisfactory is obvious. Based on previous work, we upgrade our neuromorphic MCD with a Neural Response Decoder (NRD) that is intended to predict whether ECoG data are satisfactory or not in order to improve MCD accuracy. The main aim is to design an actor-critic structure able to adapt via reinforcement learning the MCD (actor) based on NRD (critic) predictions. For this aim, NRD was trained using not only an ECoG signal but also the MCD prediction or prescribed intended movement of the patient. The achieved accuracy of the trained NRD is satisfactory and contributes to improved MCD performance. However, further work has to be carried out to fully utilize the NRD for MCD performance optimization in an on-line manner. Possibility to include feedback from the patient would allow for further improvement of MCD-NRD accuracy.
在我们之前的工作中,我们利用大脑运动皮层的脑电信号记录,开发了一种用于四肢瘫痪患者预期运动的神经形态解码器,称为运动控制解码器(MCD)。尽管训练数据是根据期望的运动进行标记的,但并不能保证患者对效应器的动作感到满意。因此,将脑信号分类为满意/不满意的需求显而易见。基于之前的工作,我们用神经反应解码器(NRD)对我们的神经形态MCD进行了升级,该解码器旨在预测脑电数据是否令人满意,以提高MCD的准确性。主要目的是设计一种能够通过强化学习,根据NRD(评论家)的预测来调整MCD(行动者)的行动者-评论家结构。为了实现这一目标,NRD不仅使用脑电信号进行训练,还使用MCD预测或患者规定的预期运动进行训练。训练后的NRD所达到的准确率令人满意,并有助于提高MCD的性能。然而,还需要进一步开展工作,以便在线充分利用NRD来优化MCD的性能。纳入患者反馈的可能性将使MCD-NRD的准确性得到进一步提高。