Suppr超能文献

人类基于强化的运动学习中的体感工作记忆。

Somatosensory working memory in human reinforcement-based motor learning.

作者信息

Sidarta Ananda, van Vugt Floris T, Ostry David J

机构信息

Department of Psychology, McGill University , Montréal, Quebec , Canada.

Haskins Laboratories , New Haven, Connecticut.

出版信息

J Neurophysiol. 2018 Dec 1;120(6):3275-3286. doi: 10.1152/jn.00442.2018. Epub 2018 Oct 24.

Abstract

Recent studies using visuomotor adaptation and sequence learning tasks have assessed the involvement of working memory in the visuospatial domain. The capacity to maintain previously performed movements in working memory is perhaps even more important in reinforcement-based learning to repeat accurate movements and avoid mistakes. Using this kind of task in the present work, we tested the relationship between somatosensory working memory and motor learning. The first experiment involved separate memory and motor learning tasks. In the memory task, the participant's arm was displaced in different directions by a robotic arm, and the participant was asked to judge whether a subsequent test direction was one of the previously presented directions. In the motor learning task, participants made reaching movements to a hidden visual target and were provided with positive feedback as reinforcement when the movement ended in the target zone. It was found that participants that had better somatosensory working memory showed greater motor learning. In a second experiment, we designed a new task in which learning and working memory trials were interleaved, allowing us to study participants' memory for movements they performed as part of learning. As in the first experiment, we found that participants with better somatosensory working memory also learned more. Moreover, memory performance for successful movements was better than for movements that failed to reach the target. These results suggest that somatosensory working memory is involved in reinforcement motor learning and that this memory preferentially keeps track of reinforced movements. NEW & NOTEWORTHY The present work examined somatosensory working memory in reinforcement-based motor learning. Working memory performance was reliably correlated with the extent of learning. With the use of a paradigm in which learning and memory trials were interleaved, memory was assessed for movements performed during learning. Movements that received positive feedback were better remembered than movements that did not. Thus working memory does not track all movements equally but is biased to retain movements that were rewarded.

摘要

最近使用视觉运动适应和序列学习任务的研究评估了工作记忆在视觉空间领域的参与情况。在基于强化的学习中,为了重复准确的动作并避免错误,在工作记忆中保持先前执行动作的能力可能更为重要。在本研究中,我们使用这类任务测试了体感工作记忆与运动学习之间的关系。第一个实验包括单独的记忆和运动学习任务。在记忆任务中,参与者的手臂由机械臂向不同方向移动,然后要求参与者判断随后的测试方向是否是之前呈现过的方向之一。在运动学习任务中,参与者向一个隐藏的视觉目标进行伸手动作,当动作在目标区域结束时,会得到积极反馈作为强化。结果发现,具有更好体感工作记忆的参与者表现出更强的运动学习能力。在第二个实验中,我们设计了一项新任务,其中学习和工作记忆试验相互交错,这使我们能够研究参与者对他们作为学习一部分所执行动作的记忆。与第一个实验一样,我们发现具有更好体感工作记忆的参与者学习得也更多。此外,成功动作的记忆表现优于未到达目标的动作。这些结果表明,体感工作记忆参与了基于强化的运动学习,并且这种记忆优先跟踪强化的动作。新发现 本研究考察了基于强化的运动学习中的体感工作记忆。工作记忆表现与学习程度可靠相关。通过使用学习和记忆试验相互交错的范式,对学习过程中执行的动作的记忆进行了评估。得到积极反馈的动作比未得到积极反馈的动作记忆得更好。因此,工作记忆并非平等地跟踪所有动作,而是倾向于保留得到奖励的动作。

相似文献

1
Somatosensory working memory in human reinforcement-based motor learning.人类基于强化的运动学习中的体感工作记忆。
J Neurophysiol. 2018 Dec 1;120(6):3275-3286. doi: 10.1152/jn.00442.2018. Epub 2018 Oct 24.
6
Interactions between motor exploration and reinforcement learning.运动探索与强化学习的相互作用。
J Neurophysiol. 2019 Aug 1;122(2):797-808. doi: 10.1152/jn.00390.2018. Epub 2019 Jun 26.
7
Clustering analysis of movement kinematics in reinforcement learning.强化学习中运动运动学的聚类分析。
J Neurophysiol. 2022 Feb 1;127(2):341-353. doi: 10.1152/jn.00229.2021. Epub 2021 Dec 22.
8
Somatosensory perceptual training enhances motor learning by observing.体感感知训练通过观察增强运动学习。
J Neurophysiol. 2018 Dec 1;120(6):3017-3025. doi: 10.1152/jn.00313.2018. Epub 2018 Sep 19.
10
The human somatosensory cortex contributes to the encoding of newly learned movements.人类躯体感觉皮层有助于新学习运动的编码。
Proc Natl Acad Sci U S A. 2024 Feb 6;121(6):e2316294121. doi: 10.1073/pnas.2316294121. Epub 2024 Jan 29.

引用本文的文献

3
Working memory constraints for visuomotor retrieval strategies.视觉运动检索策略的工作记忆约束。
J Neurophysiol. 2024 Aug 1;132(2):347-361. doi: 10.1152/jn.00122.2024. Epub 2024 Jun 26.
6
7
8
Reward timing matters in motor learning.奖励时机在运动学习中很重要。
iScience. 2022 Apr 25;25(5):104290. doi: 10.1016/j.isci.2022.104290. eCollection 2022 May 20.
9
Clustering analysis of movement kinematics in reinforcement learning.强化学习中运动运动学的聚类分析。
J Neurophysiol. 2022 Feb 1;127(2):341-353. doi: 10.1152/jn.00229.2021. Epub 2021 Dec 22.
10
Reward boosts reinforcement-based motor learning.奖赏可促进基于强化的运动学习。
iScience. 2021 Jul 7;24(7):102821. doi: 10.1016/j.isci.2021.102821. eCollection 2021 Jul 23.

本文引用的文献

3
Contribution of explicit processes to reinforcement-based motor learning.显性过程对基于强化的运动学习的贡献。
J Neurophysiol. 2018 Jun 1;119(6):2241-2255. doi: 10.1152/jn.00901.2017. Epub 2018 Mar 14.
8
Credit assignment in movement-dependent reinforcement learning.运动依赖型强化学习中的信用分配
Proc Natl Acad Sci U S A. 2016 Jun 14;113(24):6797-802. doi: 10.1073/pnas.1523669113. Epub 2016 May 31.

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验