Oxford Centre for Theoretical Neuroscience and Artificial Intelligence, University of Oxford.
Department of Experimental Psychology, University of Oxford.
Psychol Rev. 2017 Mar;124(2):154-167. doi: 10.1037/rev0000049. Epub 2017 Jan 9.
We use an established neural network model of the primate visual system to show how neurons might learn to encode the gender of faces. The model consists of a hierarchy of 4 competitive neuronal layers with associatively modifiable feedforward synaptic connections between successive layers. During training, the network was presented with many realistic images of male and female faces, during which the synaptic connections are modified using biologically plausible local associative learning rules. After training, we found that different subsets of output neurons have learned to respond exclusively to either male or female faces. With the inclusion of short range excitation within each neuronal layer to implement a self-organizing map architecture, neurons representing either male or female faces were clustered together in the output layer. This learning process is entirely unsupervised, as the gender of the face images is not explicitly labeled and provided to the network as a supervisory training signal. These simulations are extended to training the network on rotating faces. It is found that by using a trace learning rule incorporating a temporal memory trace of recent neuronal activity, neurons responding selectively to either male or female faces were also able to learn to respond invariantly over different views of the faces. This kind of trace learning has been previously shown to operate within the primate visual system by neurophysiological and psychophysical studies. The computer simulations described here predict that similar neurons encoding the gender of faces will be present within the primate visual system. (PsycINFO Database Record
我们使用已建立的灵长类视觉系统神经网络模型来展示神经元如何学会编码面部的性别。该模型由具有层间联想可修改的前馈突触连接的 4 个竞争神经元层组成。在训练过程中,网络会呈现许多真实的男性和女性面部图像,在此期间,使用生物学上合理的局部联想学习规则来修改突触连接。在训练后,我们发现不同的输出神经元子集已经学会仅对男性或女性面部做出反应。通过在每个神经元层内包含短程兴奋来实现自组织映射架构,代表男性或女性面部的神经元在输出层中聚集在一起。这个学习过程是完全无监督的,因为面部图像的性别并未明确标记并作为监督训练信号提供给网络。这些模拟扩展到对旋转面部进行网络训练。研究发现,通过使用包含最近神经元活动的时间记忆痕迹的轨迹学习规则,选择性地对男性或女性面部做出反应的神经元也能够学习对不同面部视图的不变响应。先前的神经生理学和心理物理学研究表明,这种轨迹学习在灵长类视觉系统中起作用。这里描述的计算机模拟预测,在灵长类视觉系统中也存在编码面部性别的类似神经元。