Gautam Arvind, Panwar Madhuri, Biswas Dwaipayan, Acharyya Amit
1Department of Electrical EngineeringIndian Institute of Technology HyderabadHyderabad502205India.
2imec3001LeuvenBelgium.
IEEE J Transl Eng Health Med. 2020 Feb 13;8:2100310. doi: 10.1109/JTEHM.2020.2972523. eCollection 2020.
The clinical assessment technology such as remote monitoring of rehabilitation progress for lower limb related ailments rely on the automatic evaluation of movement performed along with an estimation of joint angle information. In this paper, we introduce a transfer-learning based Long-term Recurrent Convolution Network (LRCN) named as '' for the classification of lower limb movements, along with the prediction of the corresponding knee joint angle. The model consists of three blocks- (i) feature extractor block, (ii) joint angle prediction block, and (iii) movement classification block. Initially, the model is end-to-end trained for knee joint angle prediction followed by transferring the knowledge of a trained model to the movement classification through transfer-learning approach making a memory and computationally efficient design. The proposed was evaluated on publicly available University of California (UC) Irvine machine learning repository dataset of the lower limb for 11 healthy subjects and 11 subjects with knee pathology for three movements type-walking, standing with knee flexion movements and sitting with knee extension movements. The average mean absolute error (MAE) resulted in the prediction of joint angle for healthy subjects and subjects with knee pathology are 8.1 % and 9.2 % respectively. Subsequently, an average classification accuracy of 98.1 % and 92.4 % were achieved for healthy subjects and subjects with knee pathology, respectively. Interestingly, the significance of this study in itself is promising with substantial improvement in the performance compared to state-of-the-art methodologies. The clinical significance of such surface electromyography signals (sEMG) based movement recognition and prediction of corresponding joint angle system could be beneficial for remote monitoring of rehabilitation progress by the physiotherapist using wearables.
诸如对下肢相关疾病康复进展进行远程监测的临床评估技术,依赖于对所执行运动的自动评估以及关节角度信息的估计。在本文中,我们引入了一种基于迁移学习的长期循环卷积网络(LRCN),名为“ ”,用于下肢运动分类以及相应膝关节角度的预测。该模型由三个模块组成:(i)特征提取模块,(ii)关节角度预测模块,以及(iii)运动分类模块。最初,该模型针对膝关节角度预测进行端到端训练,随后通过迁移学习方法将训练模型的知识转移到运动分类中,从而实现内存和计算效率高的设计。我们在公开可用的加利福尼亚大学(UC)欧文分校机器学习库的下肢数据集上,对11名健康受试者和11名患有膝关节疾病的受试者进行了三种运动类型(行走、屈膝站立运动和伸膝坐姿运动)的评估。健康受试者和患有膝关节疾病的受试者在关节角度预测方面的平均平均绝对误差(MAE)分别为8.1%和9.2%。随后,健康受试者和患有膝关节疾病的受试者的平均分类准确率分别达到了98.1%和92.4%。有趣的是,与现有最先进方法相比,本研究本身的意义在于其性能有了显著提高。这种基于表面肌电图信号(sEMG)的运动识别和相应关节角度系统预测的临床意义,可能有助于物理治疗师使用可穿戴设备对康复进展进行远程监测。