McNiel David, Bataineh Mohammad, Choi John, Hessburg John, Francis Joseph
Department of Physiology and Pharmacology, SUNY Downstate Medical Center, Brooklyn, NY-11203.
Department of Biomedical Engineering, Cullen College of Engineering, University of Houston, Houston, TX 77204-6022.
Proc South Biomed Eng Conf. 2016 Mar;2016:17-18. doi: 10.1109/SBEC.2016.19. Epub 2016 Apr 28.
Increasingly accurate control of prosthetic limbs has been made possible by a series of advancements in brain machine interface (BMI) control theory. One promising control technique for future BMI applications is reinforcement learning (RL). RL based BMIs require a reinforcing signal to inform the controller whether or not a given movement was intended by the user. This signal has been shown to exist in cortical structures simultaneously used for BMI control. This work evaluates the ability of several common classifiers to detect impending reward delivery within primary somatosensory (S1) cortex during a grip force match to sample task performed by a nonhuman primate. The accuracy of these classifiers was further evaluated over a range of conditions to identify parameters that provide maximum classification accuracy. S1 cortex was found to provide highly accurate classification of the reinforcement signal across many classifiers and a wide variety of data input parameters. The classification accuracy in S1 cortex between rewarding and non-rewarding trials was apparent when the animal was expecting an impending delivery or an impending withholding of reward following trial completion. The high accuracy of classification in S1 cortex can be used to adapt an RL based BMI towards a user's intent. Real-time implementation of these classifiers in an RL based BMI could be used to adapt control of a prosthesis dynamically to match the intent of its user.
脑机接口(BMI)控制理论的一系列进展使得对假肢的控制越来越精确。强化学习(RL)是一种未来BMI应用中很有前景的控制技术。基于RL的BMI需要一个强化信号来告知控制器用户是否有意进行特定动作。已证明该信号存在于同时用于BMI控制的皮质结构中。这项研究评估了几种常见分类器在非人类灵长类动物执行握力匹配采样任务期间检测初级体感(S1)皮层内即将到来的奖励发放的能力。在一系列条件下进一步评估了这些分类器的准确性,以确定能提供最大分类准确性的参数。研究发现,S1皮层在许多分类器和各种数据输入参数下都能对强化信号进行高度准确的分类。当动物在试验完成后预期即将发放奖励或即将扣留奖励时,S1皮层在奖励和无奖励试验之间的分类准确性很明显。S1皮层的高分类准确性可用于使基于RL的BMI适应用户意图。在基于RL的BMI中实时实施这些分类器可用于动态调整假肢控制以匹配用户意图。