Department of Brain and Cognitive Sciences and McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, Massachusetts.
Hum Brain Mapp. 2019 Jun 1;40(8):2499-2510. doi: 10.1002/hbm.24540. Epub 2019 Feb 13.
Facial motion is a primary source of social information about other humans. Prior fMRI studies have identified regions of the superior temporal sulcus (STS) that respond specifically to perceived face movements (termed fSTS), but little is known about the nature of motion representations in these regions. Here we use fMRI and multivoxel pattern analysis to characterize the representational content of the fSTS. Participants viewed a set of specific eye and mouth movements, as well as combined eye and mouth movements. Our results demonstrate that fSTS response patterns contain information about face movements, including subtle distinctions between types of eye and mouth movements. These representations generalize across the actor performing the movement, and across small differences in visual position. Critically, patterns of response to combined movements could be well predicted by linear combinations of responses to individual eye and mouth movements, pointing to a parts-based representation of complex face movements. These results indicate that the fSTS plays an intermediate role in the process of inferring social content from visually perceived face movements, containing a representation that is sufficiently abstract to generalize across low-level visual details, but still tied to the kinematics of face part movements.
面部运动是人类社会信息的主要来源之一。先前的 fMRI 研究已经确定了颞上沟(STS)的特定区域对感知到的面部运动有特异性反应(称为 fSTS),但这些区域中运动表现的性质知之甚少。在这里,我们使用 fMRI 和多体素模式分析来描述 fSTS 的代表性内容。参与者观看了一组特定的眼睛和嘴巴运动,以及眼睛和嘴巴的组合运动。我们的结果表明,fSTS 的反应模式包含有关面部运动的信息,包括眼睛和嘴巴运动类型之间的细微区别。这些表示在执行运动的演员之间以及视觉位置的微小差异上具有通用性。至关重要的是,对组合运动的反应模式可以通过对个体眼睛和嘴巴运动的反应进行线性组合来很好地预测,这表明复杂面部运动的基于部分的表示。这些结果表明,fSTS 在从视觉感知的面部运动中推断社会内容的过程中起着中间作用,包含一个足够抽象的表示,可以在低水平视觉细节上进行概括,但仍与面部运动的运动学相关。