Zhang Shao-Qun, Zhou Zhi-Hua
National Key Laboratory for Novel Software Technology, Nanjing University, Nanjing 210023, China
Neural Comput. 2021 Oct 12;33(11):2951-2970. doi: 10.1162/neco_a_01431.
Current neural networks are mostly built on the MP model, which usually formulates the neuron as executing an activation function on the real-valued weighted aggregation of signals received from other neurons. This letter proposes the flexible transmitter (FT) model, a novel bio-plausible neuron model with flexible synaptic plasticity. The FT model employs a pair of parameters to model the neurotransmitters between neurons and puts up a neuron-exclusive variable to record the regulated neurotrophin density. Thus, the FT model can be formulated as a two-variable, two-valued function, taking the commonly used MP neuron model as its particular case. This modeling manner makes the FT model biologically more realistic and capable of handling complicated data, even spatiotemporal data. To exhibit its power and potential, we present the flexible transmitter network (FTNet), which is built on the most common fully connected feedforward architecture taking the FT model as the basic building block. FTNet allows gradient calculation and can be implemented by an improved backpropagation algorithm in the complex-valued domain. Experiments on a broad range of tasks show that FTNet has power and potential in processing spatiotemporal data. This study provides an alternative basic building block in neural networks and exhibits the feasibility of developing artificial neural networks with neuronal plasticity.
当前的神经网络大多基于MP模型构建,该模型通常将神经元定义为对从其他神经元接收到的实值加权信号聚合执行激活函数。本文提出了灵活递质(FT)模型,这是一种具有灵活突触可塑性的新型生物合理神经元模型。FT模型采用一对参数对神经元之间的神经递质进行建模,并设置一个神经元专属变量来记录调节后的神经营养因子密度。因此,FT模型可以被表述为一个双变量、二值函数,常用的MP神经元模型是其特殊情况。这种建模方式使FT模型在生物学上更具现实意义,并且能够处理复杂数据,甚至是时空数据。为了展示其能力和潜力,我们提出了灵活递质网络(FTNet),它基于最常见的全连接前馈架构构建,以FT模型作为基本构建块。FTNet允许进行梯度计算,并且可以通过复值域中的改进反向传播算法来实现。在广泛任务上的实验表明,FTNet在处理时空数据方面具有能力和潜力。本研究为神经网络提供了另一种基本构建块,并展示了开发具有神经元可塑性的人工神经网络的可行性。