Brader Joseph M, Senn Walter, Fusi Stefano
Neural Comput. 2007 Nov;19(11):2881-912. doi: 10.1162/neco.2007.19.11.2881.
We present a model of spike-driven synaptic plasticity inspired by experimental observations and motivated by the desire to build an electronic hardware device that can learn to classify complex stimuli in a semisupervised fashion. During training, patterns of activity are sequentially imposed on the input neurons, and an additional instructor signal drives the output neurons toward the desired activity. The network is made of integrate-and-fire neurons with constant leak and a floor. The synapses are bistable, and they are modified by the arrival of presynaptic spikes. The sign of the change is determined by both the depolarization and the state of a variable that integrates the postsynaptic action potentials. Following the training phase, the instructor signal is removed, and the output neurons are driven purely by the activity of the input neurons weighted by the plastic synapses. In the absence of stimulation, the synapses preserve their internal state indefinitely. Memories are also very robust to the disruptive action of spontaneous activity. A network of 2000 input neurons is shown to be able to classify correctly a large number (thousands) of highly overlapping patterns (300 classes of preprocessed Latex characters, 30 patterns per class, and a subset of the NIST characters data set) and to generalize with performances that are better than or comparable to those of artificial neural networks. Finally we show that the synaptic dynamics is compatible with many of the experimental observations on the induction of long-term modifications (spike-timing-dependent plasticity and its dependence on both the postsynaptic depolarization and the frequency of pre- and postsynaptic neurons).
我们提出了一种受实验观察启发并受构建能够以半监督方式学习对复杂刺激进行分类的电子硬件设备的愿望所驱动的尖峰驱动突触可塑性模型。在训练期间,活动模式被依次施加到输入神经元上,并且一个额外的指导信号将输出神经元驱动到期望的活动状态。该网络由具有恒定漏电和下限的积分发放神经元组成。突触是双稳态的,并且它们会被突触前尖峰的到来所修改。变化的符号由去极化和整合突触后动作电位的变量的状态共同决定。在训练阶段之后,指导信号被移除,并且输出神经元纯粹由由可塑性突触加权的输入神经元的活动所驱动。在没有刺激的情况下,突触无限期地保持其内部状态。记忆对自发活动的干扰作用也非常稳健。一个由2000个输入神经元组成的网络被证明能够正确分类大量(数千个)高度重叠的模式(300类预处理的乳胶字符,每类30个模式,以及NIST字符数据集的一个子集),并且能够以优于或与人工神经网络相当的性能进行泛化。最后,我们表明突触动力学与许多关于长期修饰诱导的实验观察结果(尖峰时间依赖性可塑性及其对突触后去极化以及突触前和突触后神经元频率的依赖性)是兼容的。