Lee M D
Communications Division, Defence Science and Technology Organisation, Salisbury, South Australia.
Neural Comput. 1998 Oct 1;10(7):1815-30. doi: 10.1162/089976698300017151.
The common neural network modeling practice of representing the elements of a task domain in terms of a set of features lacks justification if the features are derived through some form of ad hoc preabstraction. By examining a featural similarity model related to established multidimensional scaling techniques, a neural network is developed that generates features from similarity data and attaches weights to these features. The network performs a constrained search of a continuous solution space to determine the features and uses a previously developed regularization technique to minimize the number of features it derives. The network is demonstrated on artificial data, from which it recovers known features and weights, and on two real data sets involving the similarity of a set of geometric shapes and the abstract conceptual similarities of the 10 Arabic numerals. On the basis of these results, the relationship between the multidimensional scaling approach adopted by the network and an alternative additive clustering approach to feature extraction is discussed.
如果通过某种形式的特别预抽象得出特征,那么在任务领域中用一组特征来表示任务领域元素的常见神经网络建模实践就缺乏合理性。通过研究与已建立的多维缩放技术相关的特征相似性模型,开发了一种神经网络,该网络从相似性数据中生成特征并为这些特征赋予权重。该网络对连续解空间进行约束搜索以确定特征,并使用先前开发的正则化技术来最小化其得出的特征数量。该网络在人工数据上进行了演示,它从人工数据中恢复了已知的特征和权重,并且在两个真实数据集上进行了演示,这两个数据集分别涉及一组几何形状的相似性以及10个阿拉伯数字的抽象概念相似性。基于这些结果,讨论了该网络采用的多维缩放方法与另一种用于特征提取的加法聚类方法之间的关系。