Suppr超能文献

作为基于原型的类别学习模型的霍普菲尔德网络:一种区分训练吸引子、虚假吸引子和原型吸引子的方法。

Hopfield networks as a model of prototype-based category learning: A method to distinguish trained, spurious, and prototypical attractors.

作者信息

Gorman Chris, Robins Anthony, Knott Alistair

机构信息

Department of Computer Science, University of Otago, 133 Union Street East, Dunedin 9016, New Zealand.

出版信息

Neural Netw. 2017 Jul;91:76-84. doi: 10.1016/j.neunet.2017.04.007. Epub 2017 Apr 25.

Abstract

We present an investigation of the potential use of Hopfield networks to learn neurally plausible, distributed representations of category prototypes. Hopfield networks are dynamical models of autoassociative memory which learn to recreate a set of input states from any given starting state. These networks, however, will almost always learn states which were not presented during training, so called spurious states. Historically, spurious states have been an undesirable side-effect of training a Hopfield network and there has been much research into detecting and discarding these unwanted states. However, we suggest that some of these states may represent useful information, namely states which represent prototypes of the categories instantiated in the network's training data. It would be desirable for a memory system trained on multiple instance tokens of a category to extract a representation of the category prototype. We present an investigation showing that Hopfield networks are in fact capable of learning category prototypes as strong, stable, attractors without being explicitly trained on them. We also expand on previous research into the detection of spurious states in order to show that it is possible to distinguish between trained, spurious, and prototypical attractors.

摘要

我们展示了一项关于霍普菲尔德网络潜在用途的研究,该研究旨在学习类别原型的神经似然分布式表示。霍普菲尔德网络是自联想记忆的动力学模型,它能从任何给定的起始状态学习重现一组输入状态。然而,这些网络几乎总是会学习到训练期间未呈现的状态,即所谓的虚假状态。从历史上看,虚假状态一直是训练霍普菲尔德网络时不期望出现的副作用,并且已经有很多关于检测和丢弃这些不需要状态的研究。然而,我们认为其中一些状态可能代表有用信息,即代表网络训练数据中实例化类别的原型的状态。对于一个基于类别多个实例令牌进行训练的记忆系统来说,提取类别原型的表示是很理想的。我们展示了一项研究,表明霍普菲尔德网络实际上能够在没有对类别原型进行明确训练的情况下,将其学习为强大、稳定的吸引子。我们还扩展了之前关于虚假状态检测的研究,以表明可以区分训练吸引子、虚假吸引子和原型吸引子。

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验