Székely Anna, Török Balázs, Kiss Mariann, Janacsek Karolina, Németh Dezső, Orbán Gergő
Department of Computational Sciences, HUN-REN Wigner Research Centre for Physics, Konkoly-Thege Miklós út 29-33., H-1121, Budapest, Hungary.
Department of Cognitive Science, Faculty of Natural Sciences, Budapest University of Technology and Economics, Műegyetem rkp. 3., H-1111 Budapest, Hungary.
Open Mind (Camb). 2024 Sep 15;8:1107-1128. doi: 10.1162/opmi_a_00158. eCollection 2024.
Transfer learning, the reuse of newly acquired knowledge under novel circumstances, is a critical hallmark of human intelligence that has frequently been pitted against the capacities of artificial learning agents. Yet, the computations relevant to transfer learning have been little investigated in humans. The benefit of efficient inductive biases (meta-level constraints that shape learning, often referred as priors in the Bayesian learning approach), has been both theoretically and experimentally established. Efficiency of inductive biases depends on their capacity to generalize earlier experiences. We argue that successful transfer learning upon task acquisition is ensured by updating inductive biases and transfer of knowledge hinges upon capturing the structure of the task in the inductive bias that can be reused in novel tasks. To explore this, we trained participants on a non-trivial visual stimulus sequence task (Alternating Serial Response Times, ASRT); during the Training phase, participants were exposed to one specific sequence for multiple days, then on the Transfer phase, the sequence changed, while the underlying structure of the task remained the same. Our results show that beyond the acquisition of the stimulus sequence, our participants were also able to update their inductive biases. Acquisition of the new sequence was considerably sped up by earlier exposure but this enhancement was specific to individuals showing signatures of abandoning initial inductive biases. Enhancement of learning was reflected in the development of a new internal model. Additionally, our findings highlight the ability of participants to construct an inventory of internal models and alternate between them based on environmental demands. Further, investigation of the behavior during transfer revealed that it is the subjective internal model of individuals that can predict the transfer across tasks. Our results demonstrate that even imperfect learning in a challenging environment helps learning in a new context by reusing the subjective and partial knowledge about environmental regularities.
迁移学习,即在新环境中重新运用新获取的知识,是人类智能的一个关键特征,常与人工智能学习主体的能力形成对比。然而,与迁移学习相关的计算在人类中鲜有研究。高效归纳偏差(塑造学习的元层次约束,在贝叶斯学习方法中常被称为先验)的益处已在理论和实验上得到证实。归纳偏差的效率取决于它们对早期经验进行泛化的能力。我们认为,通过更新归纳偏差可确保在任务习得时成功进行迁移学习,并且知识的迁移取决于在归纳偏差中捕捉任务结构,而这种结构可在新任务中重复使用。为了探究这一点,我们让参与者进行一项非平凡的视觉刺激序列任务(交替序列反应时,ASRT)训练;在训练阶段,参与者连续多天接触一个特定序列,然后在迁移阶段,序列发生变化,而任务的底层结构保持不变。我们的结果表明,除了习得刺激序列外,我们的参与者还能够更新他们的归纳偏差。早期接触显著加快了新序列的习得,但这种增强只针对那些表现出摒弃初始归纳偏差特征的个体。学习的增强体现在一个新的内部模型的发展上。此外,我们的研究结果突出了参与者构建内部模型清单并根据环境需求在它们之间进行切换的能力。此外,对迁移过程中的行为进行调查发现,能够预测跨任务迁移的是个体的主观内部模型。我们的结果表明,即使在具有挑战性的环境中进行的学习并不完美,也能通过重用关于环境规律的主观和部分知识来帮助在新环境中的学习。