Neuroscience Institute, Princeton University, Princeton, NJ, USA.
PLoS Comput Biol. 2011 Sep;7(9):e1002165. doi: 10.1371/journal.pcbi.1002165. Epub 2011 Sep 29.
Speech production involves the movement of the mouth and other regions of the face resulting in visual motion cues. These visual cues enhance intelligibility and detection of auditory speech. As such, face-to-face speech is fundamentally a multisensory phenomenon. If speech is fundamentally multisensory, it should be reflected in the evolution of vocal communication: similar behavioral effects should be observed in other primates. Old World monkeys share with humans vocal production biomechanics and communicate face-to-face with vocalizations. It is unknown, however, if they, too, combine faces and voices to enhance their perception of vocalizations. We show that they do: monkeys combine faces and voices in noisy environments to enhance their detection of vocalizations. Their behavior parallels that of humans performing an identical task. We explored what common computational mechanism(s) could explain the pattern of results we observed across species. Standard explanations or models such as the principle of inverse effectiveness and a "race" model failed to account for their behavior patterns. Conversely, a "superposition model", positing the linear summation of activity patterns in response to visual and auditory components of vocalizations, served as a straightforward but powerful explanatory mechanism for the observed behaviors in both species. As such, it represents a putative homologous mechanism for integrating faces and voices across primates.
言语产生涉及嘴和面部其他区域的运动,从而产生视觉运动线索。这些视觉线索提高了听觉言语的可理解性和检测能力。因此,面对面的言语本质上是一种多感觉现象。如果言语本质上是多感觉的,那么它应该反映在声音通讯的进化中:在其他灵长类动物中应该观察到类似的行为效应。旧大陆猴与人类共享发声生物力学,并通过发声进行面对面交流。然而,它们是否也将面部和声音结合起来以增强对声音的感知,尚不清楚。我们表明它们确实如此:猴子在嘈杂的环境中将面部和声音结合起来,以提高对声音的检测能力。它们的行为与人类执行相同任务的行为相似。我们探讨了什么样的共同计算机制可以解释我们在不同物种中观察到的结果模式。标准的解释或模型,如逆有效性原则和“竞赛”模型,无法解释它们的行为模式。相反,“叠加模型”假设活动模式对声音的视觉和听觉成分的线性叠加,作为一种简单但强大的解释机制,适用于两种物种的观察行为。因此,它代表了一种在灵长类动物中整合面部和声音的假定同源机制。