Kimoto Tomoyuki, Okada Masato
Oita National College of Technology, 1666 Maki, Oita-shi 870-0152, Japan.
Neural Netw. 2004 Jan;17(1):103-12. doi: 10.1016/S0893-6080(03)00137-0.
We investigated the properties of mixed states in a sparsely encoded associative memory model with a structural learning method. When mixed states are made of s memory patterns, s types of mixed states, which become equilibrium states of the model, can be generated. To investigate the properties of s types of the mixed states, we analyzed them using the statistical mechanical method. We found that the storage capacity of the memory pattern and the storage capacity of only a particular mixed state diverge at the sparse limit. We also found that the threshold value needed to recall the memory pattern is nearly equal to the threshold value needed to recall the particular mixed state. This means that the memory pattern and the particular mixed state can be made to easily coexist at the sparse limit. The properties of the model obtained by the analysis are also useful for constructing a transform-invariant recognition model.
我们使用一种结构学习方法研究了稀疏编码联想记忆模型中混合态的性质。当混合态由s个记忆模式组成时,可以生成s种类型的混合态,它们会成为模型的平衡态。为了研究这s种类型混合态的性质,我们用统计力学方法对其进行了分析。我们发现,在稀疏极限下,记忆模式的存储容量和仅一种特定混合态的存储容量会发散。我们还发现,召回记忆模式所需的阈值几乎等于召回特定混合态所需的阈值。这意味着在稀疏极限下,记忆模式和特定混合态能够很容易地共存。通过分析得到的模型性质对于构建变换不变识别模型也很有用。