Wallace Manolis, Tsapatsoulis Nicolas, Kollias Stefanos
Department of Computer Science, University of Indianapolis, Athens Campus, Athens, Greece.
Neural Netw. 2005 Mar;18(2):117-22. doi: 10.1016/j.neunet.2004.11.005.
In any neural network system, proper parameter initialization reduces training time and effort, and generally leads to compact modeling of the process under examination, i.e. less complex network structures and better generalization. However, in cases of multi-dimensional data, parameter initialization is both difficult and time consuming. In the proposed scheme a novel, multi-dimensional, unsupervised clustering method is used to properly initialize neural network architectures, focusing on resource allocating networks (RAN); both the hidden and output layer parameters are determined by the output of the clustering process, without the need for any user interference. The main contribution of this work is that the proposed approach leads to network structures that are compact, efficient and achieve best classification results, without the need for manual selection of suitable initial network parameters. The efficiency of the proposed method has been tested on several classes of publicly available data, such as iris, Wisconsin and ionosphere data.
在任何神经网络系统中,适当的参数初始化可减少训练时间和工作量,并且通常会使所研究的过程实现紧凑建模,即网络结构更简单且泛化能力更强。然而,在处理多维数据时,参数初始化既困难又耗时。在所提出的方案中,一种新颖的多维无监督聚类方法被用于正确初始化神经网络架构,重点是资源分配网络(RAN);隐藏层和输出层参数均由聚类过程的输出确定,无需任何用户干预。这项工作的主要贡献在于,所提出的方法能够生成紧凑、高效且能实现最佳分类结果的网络结构,而无需手动选择合适的初始网络参数。所提方法的效率已在几类公开可用的数据上进行了测试,如鸢尾花、威斯康星和电离层数据。