• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

相似文献

1
Improving the Learning Rate, Accuracy, and Workspace of Reinforcement Learning Controllers for a Musculoskeletal Model of the Human Arm.提高强化学习控制器在人类手臂骨骼肌肉模型中的学习率、准确性和工作空间。
IEEE Trans Neural Syst Rehabil Eng. 2022;30:30-39. doi: 10.1109/TNSRE.2021.3135471. Epub 2022 Jan 28.
2
Deep Reinforcement Learning for Control of Time-Varying Musculoskeletal Systems With High Fatigability: A Feasibility Study.基于强化学习的时变肌肉骨骼系统疲劳控制:一项可行性研究。
IEEE Trans Neural Syst Rehabil Eng. 2022;30:2613-2622. doi: 10.1109/TNSRE.2022.3203970. Epub 2022 Sep 19.
3
Hindsight Experience Replay Improves Reinforcement Learning for Control of a MIMO Musculoskeletal Model of the Human Arm.后见之明经验回放改进了多输入多输出人体手臂运动骨骼肌肉模型的强化学习控制。
IEEE Trans Neural Syst Rehabil Eng. 2021;29:1016-1025. doi: 10.1109/TNSRE.2021.3081056. Epub 2021 Jun 8.
4
Restoration of reaching and grasping movements through brain-controlled muscle stimulation in a person with tetraplegia: a proof-of-concept demonstration.脑控肌肉刺激恢复四肢瘫痪患者的上肢运动:概念验证研究。
Lancet. 2017 May 6;389(10081):1821-1830. doi: 10.1016/S0140-6736(17)30601-3. Epub 2017 Mar 28.
5
The Impact of Hill-Type Actuator Components on the Performance of Reinforcement Learning Controllers to Reverse Upper-Limb Paralysis.希尔型致动器组件对用于逆转上肢瘫痪的强化学习控制器性能的影响。
IEEE Trans Neural Syst Rehabil Eng. 2023;31:2883-2892. doi: 10.1109/TNSRE.2023.3285983. Epub 2023 Jul 10.
6
Training an Actor-Critic Reinforcement Learning Controller for Arm Movement Using Human-Generated Rewards.使用人类生成的奖励训练用于手臂运动的 Actor-Critic 强化学习控制器。
IEEE Trans Neural Syst Rehabil Eng. 2017 Oct;25(10):1892-1905. doi: 10.1109/TNSRE.2017.2700395. Epub 2017 May 2.
7
Developing a Quasi-Static Controller for a Paralyzed Human Arm: A Simulation Study.为瘫痪的人类手臂开发一种准静态控制器:一项模拟研究。
IEEE Int Conf Rehabil Robot. 2019 Jun;2019:1153-1158. doi: 10.1109/ICORR.2019.8779381.
8
An optimized proportional-derivative controller for the human upper extremity with gravity.一种针对带重力的人体上肢的优化比例-微分控制器。
J Biomech. 2015 Oct 15;48(13):3692-700. doi: 10.1016/j.jbiomech.2015.08.016. Epub 2015 Aug 29.
9
Optimization and evaluation of a proportional derivative controller for planar arm movement.平面手臂运动比例微分控制器的优化与评估。
J Biomech. 2010 Apr 19;43(6):1086-91. doi: 10.1016/j.jbiomech.2009.12.017. Epub 2010 Jan 25.
10
Arm-cranking exercise assisted by Functional Electrical Stimulation in C6 tetraplegia: a pilot study.C6 四肢瘫患者中功能性电刺激辅助的手摇运动:一项试点研究。
Technol Health Care. 2008;16(6):415-27.

本文引用的文献

1
Hindsight Experience Replay Improves Reinforcement Learning for Control of a MIMO Musculoskeletal Model of the Human Arm.后见之明经验回放改进了多输入多输出人体手臂运动骨骼肌肉模型的强化学习控制。
IEEE Trans Neural Syst Rehabil Eng. 2021;29:1016-1025. doi: 10.1109/TNSRE.2021.3081056. Epub 2021 Jun 8.
2
Training an Actor-Critic Reinforcement Learning Controller for Arm Movement Using Human-Generated Rewards.使用人类生成的奖励训练用于手臂运动的 Actor-Critic 强化学习控制器。
IEEE Trans Neural Syst Rehabil Eng. 2017 Oct;25(10):1892-1905. doi: 10.1109/TNSRE.2017.2700395. Epub 2017 May 2.
3
Restoration of reaching and grasping movements through brain-controlled muscle stimulation in a person with tetraplegia: a proof-of-concept demonstration.脑控肌肉刺激恢复四肢瘫痪患者的上肢运动:概念验证研究。
Lancet. 2017 May 6;389(10081):1821-1830. doi: 10.1016/S0140-6736(17)30601-3. Epub 2017 Mar 28.
4
An optimized proportional-derivative controller for the human upper extremity with gravity.一种针对带重力的人体上肢的优化比例-微分控制器。
J Biomech. 2015 Oct 15;48(13):3692-700. doi: 10.1016/j.jbiomech.2015.08.016. Epub 2015 Aug 29.
5
Multi-muscle FES force control of the human arm for arbitrary goals.多肌肉 FES 对人体手臂的力控制,用于任意目标。
IEEE Trans Neural Syst Rehabil Eng. 2014 May;22(3):654-63. doi: 10.1109/TNSRE.2013.2282903. Epub 2013 Oct 7.
6
Combined feedforward and feedback control of a redundant, nonlinear, dynamic musculoskeletal system.冗余、非线性、动态肌肉骨骼系统的前馈与反馈联合控制
Med Biol Eng Comput. 2009 May;47(5):533-42. doi: 10.1007/s11517-009-0479-3. Epub 2009 Apr 3.
7
Joint angle control by FES using a feedback error learning controller.使用反馈误差学习控制器通过功能性电刺激进行关节角度控制。
IEEE Trans Neural Syst Rehabil Eng. 2005 Sep;13(3):359-71. doi: 10.1109/TNSRE.2005.847355.
8
The role of multisensor data fusion in neuromuscular control of a sagittal arm with a pair of muscles using actor-critic reinforcement learning method.多传感器数据融合在使用演员-评论家强化学习方法对具有一对肌肉的矢状臂进行神经肌肉控制中的作用。
Technol Health Care. 2004;12(6):425-38.
9
Estimation of musculotendon properties in the human upper limb.人体上肢肌肉肌腱特性的评估。
Ann Biomed Eng. 2003 Feb;31(2):207-20. doi: 10.1114/1.1540105.
10
The functional impact of the Freehand System on tetraplegic hand function. Clinical Results.徒手系统对四肢瘫手功能的功能影响。临床结果。
Spinal Cord. 2002 Nov;40(11):560-6. doi: 10.1038/sj.sc.3101373.

提高强化学习控制器在人类手臂骨骼肌肉模型中的学习率、准确性和工作空间。

Improving the Learning Rate, Accuracy, and Workspace of Reinforcement Learning Controllers for a Musculoskeletal Model of the Human Arm.

出版信息

IEEE Trans Neural Syst Rehabil Eng. 2022;30:30-39. doi: 10.1109/TNSRE.2021.3135471. Epub 2022 Jan 28.

DOI:10.1109/TNSRE.2021.3135471
PMID:34898436
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC8847021/
Abstract

Cervical spinal cord injuries frequently cause paralysis of all four limbs - a medical condition known as tetraplegia. Functional electrical stimulation (FES), when combined with an appropriate controller, can be used to restore motor function by electrically stimulating the neuromuscular system. Previous works have demonstrated that reinforcement learning can be used to successfully train FES controllers. Here, we demonstrate that transfer learning and curriculum learning can be used to improve the learning rates, accuracies, and workspaces of FES controllers that are trained using reinforcement learning.

摘要

颈椎脊髓损伤常导致四肢瘫痪——一种被称为四肢瘫痪的医学病症。功能性电刺激 (FES) 与适当的控制器结合使用,可以通过电刺激神经肌肉系统来恢复运动功能。以前的工作已经证明,强化学习可用于成功训练 FES 控制器。在这里,我们证明了迁移学习和课程学习可以用于提高使用强化学习训练的 FES 控制器的学习速度、准确性和工作空间。