Zuckerman Mind Brain Behavior Institute, Department of Neuroscience, Columbia University, New York, NY 10027, USA.
Zuckerman Mind Brain Behavior Institute, Department of Neuroscience, Columbia University, New York, NY 10027, USA; Department of Brain and Cognitive Sciences, Department of Electrical Engineering and Computer Science, Center for Brains, Minds, and Machines, McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139, USA.
Neuron. 2022 Feb 2;110(3):544-557.e8. doi: 10.1016/j.neuron.2021.11.009. Epub 2021 Dec 2.
Over the course of a lifetime, we process a continual stream of information. Extracted from this stream, memories must be efficiently encoded and stored in an addressable manner for retrieval. To explore potential mechanisms, we consider a familiarity detection task in which a subject reports whether an image has been previously encountered. We design a feedforward network endowed with synaptic plasticity and an addressing matrix, meta-learned to optimize familiarity detection over long intervals. We find that anti-Hebbian plasticity leads to better performance than Hebbian plasticity and replicates experimental results such as repetition suppression. A combinatorial addressing function emerges, selecting a unique neuron as an index into the synaptic memory matrix for storage or retrieval. Unlike previous models, this network operates continuously and generalizes to intervals it has not been trained on. Our work suggests a biologically plausible mechanism for continual learning and demonstrates an effective application of machine learning for neuroscience discovery.
在人的一生当中,我们会持续不断地接收各种信息。为了能够高效地编码并以可寻址的方式存储这些信息以便日后检索,记忆必须被有效地提取。为了探究潜在的机制,我们考虑了一种熟悉度检测任务,即被试报告一个图像是否之前见过。我们设计了一个具有突触可塑性和寻址矩阵的前馈网络,通过元学习来优化长时间间隔内的熟悉度检测。我们发现,拮抗Hebbian 可塑性比Hebbian 可塑性表现更好,并复制了实验结果,如重复抑制。一种组合寻址功能出现了,选择一个独特的神经元作为存储或检索的突触记忆矩阵的索引。与以前的模型不同,这个网络是连续运行的,并且可以推广到它没有经过训练的区间。我们的工作为持续学习提供了一种合理的生物学机制,并展示了机器学习在神经科学发现中的有效应用。