Empowerment Informatics, University of Tsukuba, Tsukuba, Ibaraki, 305-8573, Japan.
Biokinesiology and Physical Therapy, University of Southern California, Los Angeles, CA, 90089-9006, USA.
Nat Commun. 2023 Jul 8;14(1):3988. doi: 10.1038/s41467-023-39536-9.
Humans and animals develop learning-to-learn strategies throughout their lives to accelerate learning. One theory suggests that this is achieved by a metacognitive process of controlling and monitoring learning. Although such learning-to-learn is also observed in motor learning, the metacognitive aspect of learning regulation has not been considered in classical theories of motor learning. Here, we formulated a minimal mechanism of this process as reinforcement learning of motor learning properties, which regulates a policy for memory update in response to sensory prediction error while monitoring its performance. This theory was confirmed in human motor learning experiments, in which the subjective sense of learning-outcome association determined the direction of up- and down-regulation of both learning speed and memory retention. Thus, it provides a simple, unifying account for variations in learning speeds, where the reinforcement learning mechanism monitors and controls the motor learning process.
人类和动物在一生中都会发展出学习策略,以加速学习。有一种理论认为,这是通过元认知过程来控制和监控学习来实现的。尽管在运动学习中也观察到了这种学习策略,但运动学习的经典理论并没有考虑学习调节的元认知方面。在这里,我们将这个过程的元认知机制表述为对运动学习属性的强化学习,它通过响应感觉预测误差来调节记忆更新策略,同时监控其性能。这个理论在人类运动学习实验中得到了验证,其中对学习结果关联的主观感知决定了学习速度和记忆保持的上调和下调的方向。因此,它为学习速度的变化提供了一个简单、统一的解释,其中强化学习机制监控和控制着运动学习过程。