Lee Hahn-Ming, Chen Chih-Ming, Lu Yung-Feng
Dept. of Comput. Sci. and Inf. Eng., Nat. Taiwan Univ. of Sci. and Technol., Taiwan.
IEEE Trans Neural Netw. 2003;14(1):15-27. doi: 10.1109/TNN.2002.806607.
This paper presents a self-organizing hierarchical cerebellar model arithmetic computer (HCMAC) neural-network classifier, which contains a self-organizing input space module and an HCMAC neural network. The conventional CMAC can be viewed as a basis function network (BFN) with supervised learning, and performs well in terms of its fast learning speed and local generalization capability for approximating nonlinear functions. However, the conventional CMAC has an enormous memory requirement for resolving high-dimensional classification problems, and its performance heavily depends on the approach of input space quantization. To solve these problems, this paper presents a novel supervised HCMAC neural network capable of resolving high-dimensional classification problems well. Also, in order to reduce what is often trial-and-error parameter searching for constructing memory allocation automatically, proposed herein is a self-organizing input space module that uses Shannon's entropy measure and the golden-section search method to appropriately determine the input space quantization according to the various distributions of training data sets. Experimental results indicate that the self-organizing HCMAC indeed has a fast learning ability and low memory requirement. It is a better performing network than the conventional CMAC for resolving high-dimensional classification problems. Furthermore, the self-organizing HCMAC classifier has a better classification ability than other compared classifiers.
本文提出了一种自组织分层小脑模型算术计算机(HCMAC)神经网络分类器,它包含一个自组织输入空间模块和一个HCMAC神经网络。传统的CMAC可以看作是一个具有监督学习的基函数网络(BFN),在逼近非线性函数方面,其学习速度快且局部泛化能力强。然而,传统的CMAC在解决高维分类问题时需要巨大的内存,并且其性能在很大程度上依赖于输入空间量化的方法。为了解决这些问题,本文提出了一种能够很好地解决高维分类问题的新型监督HCMAC神经网络。此外,为了减少构建内存分配时通常需要反复试验的参数搜索,本文提出了一种自组织输入空间模块,该模块使用香农熵测度和黄金分割搜索方法,根据训练数据集的各种分布来适当地确定输入空间量化。实验结果表明,自组织HCMAC确实具有快速学习能力和低内存需求。在解决高维分类问题方面,它是一个比传统CMAC性能更好的网络。此外,自组织HCMAC分类器比其他比较的分类器具有更好的分类能力。