Joint Department of Biomedical Engineering, University of North Carolina at Chapel Hill and North Carolina State University, USA.
Joint Department of Biomedical Engineering, University of North Carolina at Chapel Hill and North Carolina State University, USA.
Comput Biol Med. 2022 May;144:105359. doi: 10.1016/j.compbiomed.2022.105359. Epub 2022 Mar 1.
Robust and continuous neural decoding is crucial for reliable and intuitive neural-machine interactions. This study developed a novel generic neural network model that can continuously predict finger forces based on decoded populational motoneuron firing activities.
We implemented convolutional neural networks (CNNs) to learn the mapping from high-density electromyogram (HD-EMG) signals of forearm muscles to populational motoneuron firing frequency. We first extracted the spatiotemporal features of EMG energy and frequency maps to improve learning efficiency, given that EMG signals are intrinsically stochastic. We then established a generic neural network model by training on the populational neuron firing activities of multiple participants. Using a regression model, we continuously predicted individual finger forces in real-time. We compared the force prediction performance with two state-of-the-art approaches: a neuron-decomposition method and a classic EMG-amplitude method.
Our results showed that the generic CNN model outperformed the subject-specific neuron-decomposition method and the EMG-amplitude method, as demonstrated by a higher correlation coefficient between the measured and predicted forces, and a lower force prediction error. In addition, the CNN model revealed more stable force prediction performance over time.
Overall, our approach provides a generic and efficient continuous neural decoding approach for real-time and robust human-robot interactions.
稳健且连续的神经解码对于可靠且直观的神经机器交互至关重要。本研究开发了一种新颖的通用神经网络模型,能够基于解码的群体运动神经元放电活动连续预测手指力。
我们实施了卷积神经网络 (CNN),以学习从前臂肌肉的高密度肌电图 (HD-EMG) 信号到群体运动神经元放电频率的映射。鉴于 EMG 信号本质上是随机的,我们首先提取了 EMG 能量和频率图的时空特征,以提高学习效率。然后,我们通过对多个参与者的群体神经元放电活动进行训练,建立了一个通用的神经网络模型。使用回归模型,我们实时连续预测个体手指力。我们将力预测性能与两种最先进的方法进行了比较:神经元分解方法和经典的 EMG 幅度方法。
我们的结果表明,通用 CNN 模型优于基于个体的神经元分解方法和 EMG 幅度方法,表现为测量力和预测力之间的相关系数更高,力预测误差更低。此外,CNN 模型随着时间的推移显示出更稳定的力预测性能。
总体而言,我们的方法为实时和稳健的人机交互提供了一种通用且高效的连续神经解码方法。