MITACS Centre for Disease Modeling, and Department of Mathematics and Statistics, York University, Toronto, Ontario M3J1P3, Canada.
Neural Comput. 2011 Jun;23(6):1568-604. doi: 10.1162/NECO_a_00124. Epub 2011 Mar 11.
We develop a new neural network architecture for projective clustering of data sets that incorporates adaptive transmission delays and signal transmission information loss. The resultant selective output signaling mechanism does not require the addition of multiple hidden layers but instead is based on the assumption that the signal transmission velocity between input processing neurons and clustering neurons is proportional to the similarity between the input pattern and the feature vector (the top-down weights) of the clustering neuron. The mathematical model governing the evolution of the signal transmission delay, the short-term memory traces, and the long-term memory traces represents a new class of large-scale delay differential equations where the evolution of the delay is described by a nonlinear differential equation involving the similarity measure already noted. We give a complete description of the computational performance of the network for a wide range of parameter values.
我们开发了一种新的神经网络架构,用于对数据集进行投影聚类,其中包含自适应传输延迟和信号传输信息丢失。所得的选择性输出信令机制不需要添加多个隐藏层,而是基于以下假设:输入处理神经元和聚类神经元之间的信号传输速度与输入模式与聚类神经元的特征向量(自上而下的权重)之间的相似性成正比。控制信号传输延迟、短期记忆痕迹和长期记忆痕迹演化的数学模型代表了一类新的大规模时滞微分方程,其中延迟的演化由涉及已注意到的相似性度量的非线性微分方程来描述。我们为网络的广泛参数值的计算性能提供了完整的描述。