Wu Tingfang, Pan Linqiang, Yu Qiang, Tan Kay Chen
IEEE Trans Neural Netw Learn Syst. 2021 Jun;32(6):2443-2457. doi: 10.1109/TNNLS.2020.3005538. Epub 2021 Jun 2.
Spiking neural P (SN P) systems are a class of discrete neuron-inspired computation models, where information is encoded by the numbers of spikes in neurons and the timing of spikes. However, due to the discontinuous nature of the integrate-and-fire behavior of neurons and the symbolic representation of information, SN P systems are incompatible with the gradient descent-based training algorithms, such as the backpropagation algorithm, and lack the capability of processing the numerical representation of information. In this work, motivated by the numerical nature of numerical P (NP) systems in the area of membrane computing, a novel class of SN P systems is proposed, called numerical SN P (NSN P) systems. More precisely, information is encoded by the values of variables, and the integrate-and-fire way of neurons and the distribution of produced values are described by continuous production functions. The computation power of NSN P systems is investigated. We prove that NSN P is Turing universal as number generating devices, where the production functions in each neuron are linear functions, each involving at most one variable; as number accepting devices, NSN P systems are proved to be universal as well, even if each neuron contains only one production function. These results show that even if a single neuron is simple in the sense that it contains one or two production functions and the production functions in each neuron are linear functions with one variable, a network of simple neurons are still computationally powerful. With the powerful computation power and the characteristic of continuous production functions, developing learning algorithms for NSN P systems is potentially exploitable.
脉冲神经P(SNP)系统是一类受离散神经元启发的计算模型,其中信息由神经元中的脉冲数量和脉冲时间编码。然而,由于神经元积分发放行为的不连续性以及信息的符号表示,SNP系统与基于梯度下降的训练算法(如反向传播算法)不兼容,并且缺乏处理信息数值表示的能力。在这项工作中,受膜计算领域数值P(NP)系统的数值特性启发,提出了一类新颖的SNP系统,称为数值SNP(NSNP)系统。更确切地说,信息由变量的值编码,神经元的积分发放方式和产生值的分布由连续产生函数描述。研究了NSNP系统的计算能力。我们证明,作为数字生成设备,NSNP是图灵通用的,其中每个神经元中的产生函数是线性函数,每个函数最多涉及一个变量;作为数字接受设备,NSNP系统也被证明是通用的,即使每个神经元只包含一个产生函数。这些结果表明,即使单个神经元在包含一两个产生函数且每个神经元中的产生函数是单变量线性函数的意义上很简单,但简单神经元组成的网络仍然具有强大的计算能力。凭借强大的计算能力和连续产生函数的特性,可以开发NSNP系统的学习算法。