• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

通过终端误差反馈适应视觉运动增益涉及强化学习。

Reach adaption to a visuomotor gain with terminal error feedback involves reinforcement learning.

机构信息

Mortimer B. Zuckerman Mind Brain Behavior Institute, Columbia University, New York, NY, United States of America.

Department of Neuroscience, Columbia University, New York, NY, United States of America.

出版信息

PLoS One. 2022 Jun 1;17(6):e0269297. doi: 10.1371/journal.pone.0269297. eCollection 2022.

DOI:10.1371/journal.pone.0269297
PMID:35648778
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC9159621/
Abstract

Motor adaptation can be achieved through error-based learning, driven by sensory prediction errors, or reinforcement learning, driven by reward prediction errors. Recent work on visuomotor adaptation has shown that reinforcement learning leads to more persistent adaptation when visual feedback is removed, compared to error-based learning in which continuous visual feedback of the movement is provided. However, there is evidence that error-based learning with terminal visual feedback of the movement (provided at the end of movement) may be driven by both sensory and reward prediction errors. Here we examined the influence of feedback on learning using a visuomotor adaptation task in which participants moved a cursor to a single target while the gain between hand and cursor movement displacement was gradually altered. Different groups received either continuous error feedback (EC), terminal error feedback (ET), or binary reinforcement feedback (success/fail) at the end of the movement (R). Following adaptation we tested generalization to targets located in different directions and found that generalization in the ET group was intermediate between the EC and R groups. We then examined the persistence of adaptation in the EC and ET groups when the cursor was extinguished and only binary reward feedback was provided. Whereas performance was maintained in the ET group, it quickly deteriorated in the EC group. These results suggest that terminal error feedback leads to a more robust form of learning than continuous error feedback. In addition our findings are consistent with the view that error-based learning with terminal feedback involves both error-based and reinforcement learning.

摘要

运动适应可以通过基于误差的学习来实现,这种学习受感觉预测误差驱动,也可以通过强化学习来实现,这种学习受奖励预测误差驱动。最近关于视觉运动适应的研究表明,与提供连续视觉运动反馈的基于误差的学习相比,在视觉反馈被移除的情况下,强化学习会导致更持久的适应。然而,有证据表明,具有运动终端视觉反馈的基于误差的学习(在运动结束时提供)可能同时受到感觉和奖励预测误差的驱动。在这里,我们使用视觉运动适应任务来检查反馈对学习的影响,在这个任务中,参与者在逐渐改变手和光标运动位移之间的增益的情况下,将光标移动到单个目标上。不同的组在运动结束时分别接受连续误差反馈(EC)、终端误差反馈(ET)或二进制强化反馈(成功/失败)(R)。适应后,我们测试了对位于不同方向的目标的泛化,发现 ET 组的泛化介于 EC 和 R 组之间。然后,我们在光标熄灭且仅提供二进制奖励反馈的情况下,检查了 EC 和 ET 组中适应的持久性。虽然 ET 组的表现得以维持,但 EC 组的表现迅速恶化。这些结果表明,终端误差反馈导致比连续误差反馈更稳健的学习形式。此外,我们的发现与以下观点一致,即具有终端反馈的基于误差的学习涉及基于误差的学习和强化学习。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1a92/9159621/6403503aef02/pone.0269297.g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1a92/9159621/a3d0d1e30906/pone.0269297.g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1a92/9159621/0ef1918cd385/pone.0269297.g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1a92/9159621/6403503aef02/pone.0269297.g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1a92/9159621/a3d0d1e30906/pone.0269297.g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1a92/9159621/0ef1918cd385/pone.0269297.g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1a92/9159621/6403503aef02/pone.0269297.g003.jpg

相似文献

1
Reach adaption to a visuomotor gain with terminal error feedback involves reinforcement learning.通过终端误差反馈适应视觉运动增益涉及强化学习。
PLoS One. 2022 Jun 1;17(6):e0269297. doi: 10.1371/journal.pone.0269297. eCollection 2022.
2
Neural signatures of reward and sensory error feedback processing in motor learning.运动学习中奖励和感觉错误反馈处理的神经特征。
J Neurophysiol. 2019 Apr 1;121(4):1561-1574. doi: 10.1152/jn.00792.2018. Epub 2019 Feb 27.
3
Implicit reward-based motor learning.基于内隐奖励的运动学习。
Exp Brain Res. 2023 Sep;241(9):2287-2298. doi: 10.1007/s00221-023-06683-w. Epub 2023 Aug 14.
4
Task errors contribute to implicit aftereffects in sensorimotor adaptation.任务错误导致运动适应中的内隐后效。
Eur J Neurosci. 2018 Dec;48(11):3397-3409. doi: 10.1111/ejn.14213. Epub 2018 Nov 9.
5
Online and post-trial feedback differentially affect implicit adaptation to a visuomotor rotation.在线反馈和试验后反馈对视觉运动旋转的内隐适应有不同影响。
Exp Brain Res. 2014 Sep;232(9):3007-13. doi: 10.1007/s00221-014-3992-z. Epub 2014 May 23.
6
Dorsomedial frontal cortex damage impairs error-based, but not reinforcement-based motor learning in humans.背内侧额前皮质损伤损害人类基于错误的,但不损害基于强化的运动学习。
Cereb Cortex. 2024 Jan 14;34(1). doi: 10.1093/cercor/bhad424.
7
The influence of awareness on implicit visuomotor adaptation.意识对内隐视动适应的影响。
Conscious Cogn. 2022 Mar;99:103297. doi: 10.1016/j.concog.2022.103297. Epub 2022 Feb 14.
8
Explicit learning based on reward prediction error facilitates agile motor adaptations.基于奖励预测误差的内隐学习促进了敏捷的运动适应。
PLoS One. 2023 Dec 6;18(12):e0295274. doi: 10.1371/journal.pone.0295274. eCollection 2023.
9
Generalization patterns for reach adaptation and proprioceptive recalibration differ after visuomotor learning.在视觉运动学习后,伸手适应和本体感觉重新校准的泛化模式有所不同。
J Neurophysiol. 2015 Jul;114(1):354-65. doi: 10.1152/jn.00415.2014. Epub 2015 May 13.
10
Decomposition of a sensory prediction error signal for visuomotor adaptation.用于视觉运动适应的感觉预测误差信号的分解
J Exp Psychol Hum Percept Perform. 2018 Feb;44(2):176-194. doi: 10.1037/xhp0000440. Epub 2017 May 15.

引用本文的文献

1
Correction: Reach adaption to a visuomotor gain with terminal error feedback involves reinforcement learning.更正:通过终端误差反馈实现对视觉运动增益的适应涉及强化学习。
PLoS One. 2024 Aug 2;19(8):e0308510. doi: 10.1371/journal.pone.0308510. eCollection 2024.
2
The relativity of reaching: Motion of the touched surface alters the trajectory of hand movements.接触的相对性:被触摸表面的运动改变手部运动轨迹。
iScience. 2024 May 2;27(6):109871. doi: 10.1016/j.isci.2024.109871. eCollection 2024 Jun 21.

本文引用的文献

1
Contextual inference underlies the learning of sensorimotor repertoires.情境推理是感觉运动技能学习的基础。
Nature. 2021 Dec;600(7889):489-493. doi: 10.1038/s41586-021-04129-3. Epub 2021 Nov 24.
2
Motor memories of object dynamics are categorically organized.物体动态的运动记忆是有类别地组织起来的。
Elife. 2021 Nov 19;10:e71627. doi: 10.7554/eLife.71627.
3
Reward boosts reinforcement-based motor learning.奖赏可促进基于强化的运动学习。
iScience. 2021 Jul 7;24(7):102821. doi: 10.1016/j.isci.2021.102821. eCollection 2021 Jul 23.
4
Human decision making anticipates future performance in motor learning.人类决策可预测运动学习中的未来表现。
PLoS Comput Biol. 2020 Feb 28;16(2):e1007632. doi: 10.1371/journal.pcbi.1007632. eCollection 2020 Feb.
5
The gradient of the reinforcement landscape influences sensorimotor learning.强化景观的梯度影响感觉运动学习。
PLoS Comput Biol. 2019 Mar 4;15(3):e1006839. doi: 10.1371/journal.pcbi.1006839. eCollection 2019 Mar.
6
Increasing Motor Noise Impairs Reinforcement Learning in Healthy Individuals.电机噪声增大损害健康个体的强化学习能力。
eNeuro. 2018 Aug 13;5(3). doi: 10.1523/ENEURO.0050-18.2018. eCollection 2018 May-Jun.
7
The relationship between reinforcement and explicit control during visuomotor adaptation.在视动适应过程中强化与显式控制之间的关系。
Sci Rep. 2018 Jun 14;8(1):9121. doi: 10.1038/s41598-018-27378-1.
8
Multiple motor memories are learned to control different points on a tool.人们学习多种运动记忆来控制工具上的不同点。
Nat Hum Behav. 2018 Apr;2(4):300-311. doi: 10.1038/s41562-018-0324-5. Epub 2018 Apr 9.
9
Contribution of explicit processes to reinforcement-based motor learning.显性过程对基于强化的运动学习的贡献。
J Neurophysiol. 2018 Jun 1;119(6):2241-2255. doi: 10.1152/jn.00901.2017. Epub 2018 Mar 14.
10
Dissociating error-based and reinforcement-based loss functions during sensorimotor learning.在感觉运动学习过程中分离基于误差和基于强化的损失函数。
PLoS Comput Biol. 2017 Jul 28;13(7):e1005623. doi: 10.1371/journal.pcbi.1005623. eCollection 2017 Jul.