Elliott Terry
Department of Electronics and Computer Science, University of Southampton, Highfield, Southampton, SO17 1BJ, U.K.
Neural Comput. 2017 Dec;29(12):3219-3259. doi: 10.1162/neco_a_01016. Epub 2017 Sep 28.
Memory models based on synapses with discrete and bounded strengths store new memories by forgetting old ones. Memory lifetimes in such memory systems may be defined in a variety of ways. A mean first passage time (MFPT) definition overcomes much of the arbitrariness and many of the problems associated with the more usual signal-to-noise ratio (SNR) definition. We have previously computed MFPT lifetimes for simple, binary-strength synapses that lack internal, plasticity-related states. In simulation we have also seen that for multistate synapses, optimality conditions based on SNR lifetimes are absent with MFPT lifetimes, suggesting that such conditions may be artifactual. Here we extend our earlier work by computing the entire first passage time (FPT) distribution for simple, multistate synapses, from which all statistics, including the MFPT lifetime, may be extracted. For this, we develop a Fokker-Planck equation using the jump moments for perceptron activation. Two models are considered that satisfy a particular eigenvector condition that this approach requires. In these models, MFPT lifetimes do not exhibit optimality conditions, while in one but not the other, SNR lifetimes do exhibit optimality. Thus, not only are such optimality conditions artifacts of the SNR approach, but they are also strongly model dependent. By examining the variance in the FPT distribution, we may identify regions in which memory storage is subject to high variability, although MFPT lifetimes are nevertheless robustly positive. In such regions, SNR lifetimes are typically (defined to be) zero. FPT-defined memory lifetimes therefore provide an analytically superior approach and also have the virtue of being directly related to a neuron's firing properties.
基于具有离散且有界强度的突触的记忆模型通过遗忘旧记忆来存储新记忆。在这样的记忆系统中,记忆寿命可以用多种方式定义。平均首次通过时间(MFPT)定义克服了许多与更常用的信噪比(SNR)定义相关的随意性和问题。我们之前已经计算了缺乏内部可塑性相关状态的简单二进制强度突触的MFPT寿命。在模拟中我们还发现,对于多状态突触,基于SNR寿命的最优性条件在MFPT寿命中不存在,这表明此类条件可能是人为的。在这里,我们通过计算简单多状态突触的整个首次通过时间(FPT)分布来扩展我们早期的工作,从中可以提取包括MFPT寿命在内的所有统计量。为此,我们使用感知器激活的跳跃矩开发了一个福克 - 普朗克方程。考虑了满足该方法所需特定特征向量条件的两个模型。在这些模型中,MFPT寿命不表现出最优性条件,而在其中一个模型中(但不是另一个),SNR寿命确实表现出最优性。因此,不仅此类最优性条件是SNR方法的人为产物,而且它们还强烈依赖于模型。通过检查FPT分布的方差,我们可以识别记忆存储具有高变异性的区域,尽管MFPT寿命仍然稳健地为正。在这些区域中,SNR寿命通常(定义为)为零。因此,FPT定义的记忆寿命提供了一种分析上更优越的方法,并且还具有与神经元放电特性直接相关的优点。