Seung H S, Sompolinsky H
AT&T Bell Laboratories, Murray Hill, NJ 07974.
Proc Natl Acad Sci U S A. 1993 Nov 15;90(22):10749-53. doi: 10.1073/pnas.90.22.10749.
In many neural systems, sensory information is distributed throughout a population of neurons. We study simple neural network models for extracting this information. The inputs to the networks are the stochastic responses of a population of sensory neurons tuned to directional stimuli. The performance of each network model in psychophysical tasks is compared with that of the optimal maximum likelihood procedure. As a model of direction estimation in two dimensions, we consider a linear network that computes a population vector. Its performance depends on the width of the population tuning curves and is maximal for width, which increases with the level of background activity. Although for narrowly tuned neurons the performance of the population vector is significantly inferior to that of maximum likelihood estimation, the difference between the two is small when the tuning is broad. For direction discrimination, we consider two models: a perceptron with fully adaptive weights and a network made by adding an adaptive second layer to the population vector network. We calculate the error rates of these networks after exhaustive training to a particular direction. By testing on the full range of possible directions, the extent of transfer of training to novel stimuli can be calculated. It is found that for threshold linear networks the transfer of perceptual learning is nonmonotonic. Although performance deteriorates away from the training stimulus, it peaks again at an intermediate angle. This nonmonotonicity provides an important psychophysical test of these models.
在许多神经系统中,感觉信息分布于一群神经元中。我们研究用于提取此信息的简单神经网络模型。网络的输入是一群被调谐到方向刺激的感觉神经元的随机反应。将每个网络模型在心理物理学任务中的表现与最优最大似然程序的表现进行比较。作为二维方向估计的模型,我们考虑一个计算群体向量的线性网络。其表现取决于群体调谐曲线的宽度,并且对于随着背景活动水平增加的宽度而言是最大的。尽管对于调谐狭窄的神经元,群体向量的表现明显逊于最大似然估计,但当调谐宽泛时,两者之间的差异很小。对于方向辨别,我们考虑两个模型:一个具有完全自适应权重的感知器和一个通过向群体向量网络添加自适应第二层而构成的网络。在对特定方向进行详尽训练后,我们计算这些网络的错误率。通过在所有可能方向的范围内进行测试,可以计算训练向新刺激的转移程度。结果发现,对于阈值线性网络,感知学习的转移是非单调的。尽管表现会随着远离训练刺激而变差,但它会在中间角度再次达到峰值。这种非单调性为这些模型提供了一项重要的心理物理学测试。