Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands.
Max Plank Institute for Psycholinguistics, Nijmegen, The Netherlands.
PLoS One. 2024 Aug 5;19(8):e0306797. doi: 10.1371/journal.pone.0306797. eCollection 2024.
Prediction errors have a prominent role in many forms of learning. For example, in reinforcement learning, agents learn by updating the association between states and outcomes as a function of the prediction error elicited by the event. One paradigm often used to study error-driven learning is blocking. In forward blocking, participants are first presented with stimulus A, followed by outcome X (A→X). In the second phase, A and B are presented together, followed by X (AB→X). Here, A→X blocks the formation of B→X, given that X is already fully predicted by A. In backward blocking, the order of phases is reversed. Here, the association between B and X that is formed during the first learning phase of AB→X is weakened when participants learn exclusively A→X in the second phase. The present study asked the question whether forward and backward blocking occur during visual statistical learning, i.e., the incidental learning of the statistical structure of the environment. In a series of studies, using both forward and backward blocking, we observed statistical learning of temporal associations among pairs of images. While we found no forward blocking, we observed backward blocking, thereby suggesting a retrospective revaluation process in statistical learning and supporting a functional similarity between statistical learning and reinforcement learning.
预测误差在许多形式的学习中都起着重要作用。例如,在强化学习中,代理通过更新状态和结果之间的关联来学习,这种关联是由事件引起的预测误差所决定的。一种常用于研究基于错误的学习的范式是阻断。在正向阻断中,参与者首先呈现刺激 A,然后呈现结果 X(A→X)。在第二阶段,A 和 B 一起呈现,然后呈现 X(AB→X)。在这里,A→X 阻止了 B→X 的形成,因为 X 已经完全被 A 预测到了。在反向阻断中,阶段的顺序是相反的。在这里,当参与者在第二阶段仅学习 A→X 时,AB→X 第一学习阶段中形成的 B 和 X 之间的关联会减弱。本研究提出了一个问题,即在视觉统计学习中是否会发生正向和反向阻断,即对环境统计结构的偶然学习。在一系列使用正向和反向阻断的研究中,我们观察到了对成对图像之间时间关联的统计学习。虽然我们没有发现正向阻断,但我们观察到了反向阻断,这表明在统计学习中存在回溯性重新评估过程,并支持统计学习和强化学习之间的功能相似性。