School of Psychology and Institute of Neuroscience, Trinity College Dublin, Ireland.
Br J Psychol. 2012 Feb;103(1):73-82. doi: 10.1111/j.2044-8295.2011.02044.x. Epub 2011 May 17.
Recent studies on cross-modal recognition suggest that face and voice information are linked for the purpose of person identification. We tested whether congruent associations between familiarized faces and voices facilitated subsequent person recognition relative to incongruent associations. Furthermore, we investigated whether congruent face and name associations would similarly benefit person identification relative to incongruent face and name associations. Participants were familiarized with a set of talking video-images of actors, their names, and their voices. They were then tested on their recognition of either the face, voice, or name of each actor from bimodal stimuli which were either congruent or novel (incongruent) associations between the familiarized face and voice or face and name. We found that response times to familiarity decisions based on congruent face and voice stimuli were facilitated relative to incongruent associations. In contrast, we failed to find a benefit for congruent face and name pairs. Our findings suggest that faces and voices, but not faces and names, are integrated in memory for the purpose of person recognition. These findings have important implications for current models of face perception and support growing evidence for multisensory effects in face perception areas of the brain for the purpose of person recognition.
最近的跨模态识别研究表明，人脸和语音信息是为了进行身份识别而联系在一起的。我们测试了在熟悉的人脸和声音之间是否存在一致的联想会相对于不一致的联想促进后续的人物识别。此外，我们还研究了在熟悉的人脸和名字之间是否存在一致的联想是否会相对于不一致的联想对人物识别同样有益。参与者熟悉了一组说话的演员视频图像、他们的名字和他们的声音。然后，他们从双模态刺激中测试每个演员的面孔、声音或名字的识别，这些刺激是熟悉的面孔和声音或面孔和名字之间的一致或新颖（不一致）的联想。我们发现，基于一致的面孔和声音刺激的熟悉度判断的反应时间相对于不一致的联想得到了促进。相比之下，我们没有发现一致的面孔和名字对有好处。我们的研究结果表明，人脸和声音，而不是人脸和名字，在记忆中是为了进行身份识别而整合在一起的。这些发现对当前的面孔感知模型具有重要意义，并支持在大脑的面孔感知区域中存在用于身份识别的多感官效应的不断增加的证据。
