Campanella Salvatore, Belin Pascal
Department of Psychiatry, CHU Brugmann, 1020 Brussels, Belgium.
Trends Cogn Sci. 2007 Dec;11(12):535-43. doi: 10.1016/j.tics.2007.10.001. Epub 2007 Nov 9.
Integration of information from face and voice plays a central role in our social interactions. It has been mostly studied in the context of audiovisual speech perception: integration of affective or identity information has received comparatively little scientific attention. Here, we review behavioural and neuroimaging studies of face-voice integration in the context of person perception. Clear evidence for interference between facial and vocal information has been observed during affect recognition or identity processing. Integration effects on cerebral activity are apparent both at the level of heteromodal cortical regions of convergence, particularly bilateral posterior superior temporal sulcus (pSTS), and at 'unimodal' levels of sensory processing. Whether the latter reflects feedback mechanisms or direct crosstalk between auditory and visual cortices is as yet unclear.
面部和声音信息的整合在我们的社交互动中起着核心作用。它主要是在视听言语感知的背景下进行研究的：情感或身份信息的整合相对较少受到科学关注。在这里，我们回顾了在人物感知背景下面部-声音整合的行为和神经影像学研究。在情感识别或身份处理过程中，已经观察到面部和声音信息之间干扰的明确证据。对大脑活动的整合效应在汇聚的异模态皮质区域层面，特别是双侧后颞上沟（pSTS），以及在感觉处理的“单模态”层面都很明显。后者是否反映了听觉和视觉皮层之间的反馈机制或直接串扰尚不清楚。
