• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

基于原型网络的一次性迁移学习实现中风后手势识别

Post-stroke hand gesture recognition via one-shot transfer learning using prototypical networks.

作者信息

Sarwat Hussein, Alkhashab Amr, Song Xinyu, Jiang Shuo, Jia Jie, Shull Peter B

机构信息

School of Mechanical Engineering, Shanghai Jiao Tong University, Dongchuan Road, Shanghai, 200240, China.

Robot Offline Programming, Visual Components, Vänrikinkuja, Espoo, 02600, Finland.

出版信息

J Neuroeng Rehabil. 2024 Jun 12;21(1):100. doi: 10.1186/s12984-024-01398-7.

DOI:10.1186/s12984-024-01398-7
PMID:38867287
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC11167772/
Abstract

BACKGROUND

In-home rehabilitation systems are a promising, potential alternative to conventional therapy for stroke survivors. Unfortunately, physiological differences between participants and sensor displacement in wearable sensors pose a significant challenge to classifier performance, particularly for people with stroke who may encounter difficulties repeatedly performing trials. This makes it challenging to create reliable in-home rehabilitation systems that can accurately classify gestures.

METHODS

Twenty individuals who suffered a stroke performed seven different gestures (mass flexion, mass extension, wrist volar flexion, wrist dorsiflexion, forearm pronation, forearm supination, and rest) related to activities of daily living. They performed these gestures while wearing EMG sensors on the forearm, as well as FMG sensors and an IMU on the wrist. We developed a model based on prototypical networks for one-shot transfer learning, K-Best feature selection, and increased window size to improve model accuracy. Our model was evaluated against conventional transfer learning with neural networks, as well as subject-dependent and subject-independent classifiers: neural networks, LGBM, LDA, and SVM.

RESULTS

Our proposed model achieved 82.2% hand-gesture classification accuracy, which was better (P<0.05) than one-shot transfer learning with neural networks (63.17%), neural networks (59.72%), LGBM (65.09%), LDA (63.35%), and SVM (54.5%). In addition, our model performed similarly to subject-dependent classifiers, slightly lower than SVM (83.84%) but higher than neural networks (81.62%), LGBM (80.79%), and LDA (74.89%). Using K-Best features improved the accuracy in 3 of the 6 classifiers used for evaluation, while not affecting the accuracy in the other classifiers. Increasing the window size improved the accuracy of all the classifiers by an average of 4.28%.

CONCLUSION

Our proposed model showed significant improvements in hand-gesture recognition accuracy in individuals who have had a stroke as compared with conventional transfer learning, neural networks and traditional machine learning approaches. In addition, K-Best feature selection and increased window size can further improve the accuracy. This approach could help to alleviate the impact of physiological differences and create a subject-independent model for stroke survivors that improves the classification accuracy of wearable sensors.

TRIAL REGISTRATION NUMBER

The study was registered in Chinese Clinical Trial Registry with registration number CHiCTR1800017568 in 2018/08/04.

摘要

背景

居家康复系统是中风幸存者传统治疗的一种有前景的潜在替代方案。不幸的是,参与者之间的生理差异以及可穿戴传感器中的传感器位移对分类器性能构成了重大挑战,特别是对于中风患者而言,他们可能在反复进行试验时遇到困难。这使得创建能够准确对手势进行分类的可靠居家康复系统具有挑战性。

方法

20名中风患者进行了七种与日常生活活动相关的不同手势(大量屈曲、大量伸展、腕掌屈、腕背屈、前臂旋前、前臂旋后和休息)。他们在前臂佩戴肌电图(EMG)传感器、在手腕佩戴功能性肌电图(FMG)传感器和惯性测量单元(IMU)的同时执行这些手势。我们基于用于一次性迁移学习的原型网络、K最优特征选择和增加窗口大小开发了一个模型,以提高模型准确性。我们的模型与使用神经网络的传统迁移学习以及依赖个体和不依赖个体的分类器(神经网络、LightGBM、线性判别分析和支持向量机)进行了比较评估。

结果

我们提出的模型实现了82.2%的手势分类准确率,这比使用神经网络的一次性迁移学习(63.17%)、神经网络(59.72%)、LightGBM(65.09%)、线性判别分析(63.35%)和支持向量机(54.5%)更好(P<0.05)。此外,我们的模型表现与依赖个体的分类器相似,略低于支持向量机(83.84%)但高于神经网络(81.62%)、LightGBM(80.79%)和线性判别分析(74.89%)。使用K最优特征提高了用于评估的6个分类器中3个的准确率,同时不影响其他分类器的准确率。增加窗口大小使所有分类器的准确率平均提高了4.28%。

结论

与传统迁移学习、神经网络和传统机器学习方法相比,我们提出的模型在中风患者的手势识别准确率方面有显著提高。此外,K最优特征选择和增加窗口大小可以进一步提高准确率。这种方法有助于减轻生理差异的影响,并为中风幸存者创建一个不依赖个体的模型,提高可穿戴传感器的分类准确率。

试验注册号

该研究于2018年8月4日在中国临床试验注册中心注册,注册号为CHiCTR1800017568。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fed3/11167772/01d404fd7a3f/12984_2024_1398_Fig10_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fed3/11167772/b365c21ae2c4/12984_2024_1398_Fig1_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fed3/11167772/12414ee95e2b/12984_2024_1398_Fig2_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fed3/11167772/20d820a051db/12984_2024_1398_Fig3_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fed3/11167772/900d220eee84/12984_2024_1398_Fig4_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fed3/11167772/aa6d97e7e377/12984_2024_1398_Fig5_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fed3/11167772/c4f22a6f7193/12984_2024_1398_Fig6_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fed3/11167772/51c482505ac0/12984_2024_1398_Fig7_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fed3/11167772/dc5d5357cc13/12984_2024_1398_Fig8_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fed3/11167772/1c630ddf45e1/12984_2024_1398_Fig9_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fed3/11167772/01d404fd7a3f/12984_2024_1398_Fig10_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fed3/11167772/b365c21ae2c4/12984_2024_1398_Fig1_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fed3/11167772/12414ee95e2b/12984_2024_1398_Fig2_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fed3/11167772/20d820a051db/12984_2024_1398_Fig3_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fed3/11167772/900d220eee84/12984_2024_1398_Fig4_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fed3/11167772/aa6d97e7e377/12984_2024_1398_Fig5_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fed3/11167772/c4f22a6f7193/12984_2024_1398_Fig6_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fed3/11167772/51c482505ac0/12984_2024_1398_Fig7_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fed3/11167772/dc5d5357cc13/12984_2024_1398_Fig8_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fed3/11167772/1c630ddf45e1/12984_2024_1398_Fig9_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fed3/11167772/01d404fd7a3f/12984_2024_1398_Fig10_HTML.jpg

相似文献

1
Post-stroke hand gesture recognition via one-shot transfer learning using prototypical networks.基于原型网络的一次性迁移学习实现中风后手势识别
J Neuroeng Rehabil. 2024 Jun 12;21(1):100. doi: 10.1186/s12984-024-01398-7.
2
Supervised Myoelectrical Hand Gesture Recognition in Post-Acute Stroke Patients with Upper Limb Paresis on Affected and Non-Affected Sides.上肢瘫痪的脑卒中后患者患侧和非患侧的肌电手动作的监督识别。
Sensors (Basel). 2022 Nov 11;22(22):8733. doi: 10.3390/s22228733.
3
Electromyogram-Based Classification of Hand and Finger Gestures Using Artificial Neural Networks.基于肌电图的手势和手指动作的人工神经网络分类。
Sensors (Basel). 2021 Dec 29;22(1):225. doi: 10.3390/s22010225.
4
Automated classification of hand gestures using a wristband and machine learning for possible application in pill intake monitoring.使用腕带和机器学习对手势进行自动分类,以便在药物摄入监测中可能得到应用。
Comput Methods Programs Biomed. 2022 Jun;219:106753. doi: 10.1016/j.cmpb.2022.106753. Epub 2022 Mar 15.
5
Design of User-Independent Hand Gesture Recognition Using Multilayer Perceptron Networks and Sensor Fusion Techniques.使用多层感知器网络和传感器融合技术的用户无关手势识别设计
IEEE Int Conf Rehabil Robot. 2019 Jun;2019:1103-1108. doi: 10.1109/ICORR.2019.8779533.
6
Deep learning approach to improve the recognition of hand gesture with multi force variation using electromyography signal from amputees.深度学习方法通过使用截肢者的肌电信号来改善对手部多力变化的手势识别。
Med Eng Phys. 2024 Mar;125:104131. doi: 10.1016/j.medengphy.2024.104131. Epub 2024 Feb 28.
7
FS-HGR: Few-Shot Learning for Hand Gesture Recognition via Electromyography.FS-HGR:基于肌电的少数样本手 gestures 识别的学习。
IEEE Trans Neural Syst Rehabil Eng. 2021;29:1004-1015. doi: 10.1109/TNSRE.2021.3077413. Epub 2021 Jun 8.
8
EMG-based Multi-User Hand Gesture Classification via Unsupervised Transfer Learning Using Unknown Calibration Gestures.基于肌电的多用户手势分类,通过使用未知校准手势的无监督迁移学习。
IEEE Trans Neural Syst Rehabil Eng. 2024;32:1119-1131. doi: 10.1109/TNSRE.2024.3372002. Epub 2024 Mar 12.
9
Multi-Category Gesture Recognition Modeling Based on sEMG and IMU Signals.基于 sEMG 和 IMU 信号的多类别手势识别建模。
Sensors (Basel). 2022 Aug 5;22(15):5855. doi: 10.3390/s22155855.
10
Hand Gesture Recognition with Inertial Sensors.基于惯性传感器的手势识别
Annu Int Conf IEEE Eng Med Biol Soc. 2018 Jul;2018:3517-3520. doi: 10.1109/EMBC.2018.8513098.

引用本文的文献

1
Toward Hand Gesture Recognition Using a Channel-Wise Cumulative Spike Train Image-Driven Model.基于通道级累积脉冲序列图像驱动模型的手势识别研究
Cyborg Bionic Syst. 2025 Mar 21;6:0219. doi: 10.34133/cbsystems.0219. eCollection 2025.

本文引用的文献

1
Supervised Myoelectrical Hand Gesture Recognition in Post-Acute Stroke Patients with Upper Limb Paresis on Affected and Non-Affected Sides.上肢瘫痪的脑卒中后患者患侧和非患侧的肌电手动作的监督识别。
Sensors (Basel). 2022 Nov 11;22(22):8733. doi: 10.3390/s22228733.
2
Prediction on the medial knee contact force in patients with knee valgus using transfer learning approaches: Application to rehabilitation gaits.使用迁移学习方法预测膝外翻患者的膝关节内侧接触力:在康复步态中的应用。
Comput Biol Med. 2022 Nov;150:106099. doi: 10.1016/j.compbiomed.2022.106099. Epub 2022 Sep 17.
3
Proposal of a Wearable Multimodal Sensing-Based Serious Games Approach for Hand Movement Training After Stroke.
一种基于可穿戴多模态传感的严肃游戏方法用于中风后手运动训练的提议。
Front Physiol. 2022 Jun 3;13:811950. doi: 10.3389/fphys.2022.811950. eCollection 2022.
4
Using Wearable Inertial Sensors to Estimate Clinical Scores of Upper Limb Movement Quality in Stroke.使用可穿戴惯性传感器评估中风患者上肢运动质量的临床评分
Front Physiol. 2022 May 3;13:877563. doi: 10.3389/fphys.2022.877563. eCollection 2022.
5
Lower-Limb Joint Torque Prediction Using LSTM Neural Networks and Transfer Learning.基于长短期记忆神经网络和迁移学习的下肢关节扭矩预测。
IEEE Trans Neural Syst Rehabil Eng. 2022;30:600-609. doi: 10.1109/TNSRE.2022.3156786. Epub 2022 Mar 21.
6
Activities of Daily Living-Based Rehabilitation System for Arm and Hand Motor Function Retraining After Stroke.基于日常生活活动的上肢和手运动功能再训练康复系统用于脑卒中后。
IEEE Trans Neural Syst Rehabil Eng. 2022;30:621-631. doi: 10.1109/TNSRE.2022.3156387. Epub 2022 Mar 21.
7
World Stroke Organization (WSO): Global Stroke Fact Sheet 2022.世界卒中组织(WSO):全球卒中状况 2022 概要。
Int J Stroke. 2022 Jan;17(1):18-29. doi: 10.1177/17474930211065917.
8
Long-term Effectiveness and Adoption of a Cellphone Augmented Reality System on Patients with Stroke: Randomized Controlled Trial.手机增强现实系统对中风患者的长期有效性及应用情况:随机对照试验
JMIR Serious Games. 2021 Nov 23;9(4):e30184. doi: 10.2196/30184.
9
A transfer learning framework based on motor imagery rehabilitation for stroke.基于运动想象康复的脑卒中转移学习框架。
Sci Rep. 2021 Oct 5;11(1):19783. doi: 10.1038/s41598-021-99114-1.
10
Quantification of Motor Function Post-Stroke Using Novel Combination of Wearable Inertial and Mechanomyographic Sensors.使用新型可穿戴惯性和肌电传感器组合对脑卒中后运动功能进行量化。
IEEE Trans Neural Syst Rehabil Eng. 2021;29:1158-1167. doi: 10.1109/TNSRE.2021.3089613. Epub 2021 Jun 24.