Research Institute for Cognition and Robotics, University of Bielefeld, Germany.
Neural Netw. 2012 Oct;34:28-41. doi: 10.1016/j.neunet.2012.06.005. Epub 2012 Jun 28.
Synaptic plasticity is a major mechanism for adaptation, learning, and memory. Yet current models struggle to link local synaptic changes to the acquisition of behaviors. The aim of this paper is to demonstrate a computational relationship between local Hebbian plasticity and behavior learning by exploiting two traditionally unwanted features: neural noise and synaptic weight saturation. A modulation signal is employed to arbitrate the sign of plasticity: when the modulation is positive, the synaptic weights saturate to express exploitative behavior; when it is negative, the weights converge to average values, and neural noise reconfigures the network's functionality. This process is demonstrated through simulating neural dynamics in the autonomous emergence of fearful and aggressive navigating behaviors and in the solution to reward-based problems. The neural model learns, memorizes, and modifies different behaviors that lead to positive modulation in a variety of settings. The algorithm establishes a simple relationship between local plasticity and behavior learning by demonstrating the utility of noise and weight saturation. Moreover, it provides a new tool to simulate adaptive behavior, and contributes to bridging the gap between synaptic changes and behavior in neural computation.
突触可塑性是适应、学习和记忆的主要机制。然而,当前的模型难以将局部突触变化与行为的习得联系起来。本文旨在通过利用两个传统上不受欢迎的特征——神经噪声和突触权重饱和,来证明局部海伯氏可塑性与行为学习之间的计算关系。调制信号被用来仲裁可塑性的符号:当调制为正时,突触权重饱和以表达掠夺性行为;当调制为负时,权重收敛到平均值,神经噪声重新配置网络的功能。通过模拟自主出现的恐惧和攻击性导航行为以及基于奖励的问题的解决过程中的神经动力学,演示了这一过程。神经模型学习、记忆和修改不同的行为,导致在各种情况下的正调制。该算法通过展示噪声和权重饱和的实用性,在局部可塑性和行为学习之间建立了简单的关系。此外,它提供了一种模拟自适应行为的新工具,并有助于弥合神经计算中突触变化和行为之间的差距。