Massaro D W, Cohen M M
University of California, Santa Cruz 95064, USA.
Percept Psychophys. 1996 Oct;58(7):1047-65. doi: 10.3758/bf03206832.
We examined whether the orientation of the face influences speech perception in face-to-face communication. Participants identified auditory syllables, visible syllables, and bimodal syllables presented in an expanded factorial design. The syllables were /ba/, /va/, /oa/, or /da/. The auditory syllables were taken from natural speech whereas the visible syllables were produced by computer animation of a realistic talking face. The animated face was presented either as viewed in normal upright orientation or inverted orientation (180 degrees frontal rotation). The central intent of the study was to determine if an inverted view of the face would change the nature of processing bimodal speech or simply influence the information available in visible speech. The results with both the upright and inverted face views were adequately described by the fuzzy logical model of perception (FLMP). The observed differences in the FLMP's parameter values corresponding to the visual information indicate that inverting the view of the face influences the amount of visible information but does not change the nature of the information processing in bimodal speech perception.
我们研究了在面对面交流中面部朝向是否会影响言语感知。参与者识别以扩展析因设计呈现的听觉音节、视觉音节和双模态音节。音节为/ba/、/va/、/oa/或/da/。听觉音节取自自然言语，而视觉音节由逼真的会说话面部的计算机动画生成。动画面部呈现为正常直立朝向或倒置朝向（正面旋转180度）。该研究的核心目的是确定面部的倒置视图是否会改变双模态言语处理的性质，或者仅仅影响视觉言语中可用的信息。感知模糊逻辑模型（FLMP）充分描述了正面和倒置面部视图的结果。与视觉信息相对应的FLMP参数值中观察到的差异表明，面部视图的倒置会影响视觉信息的量，但不会改变双模态言语感知中信息处理的性质。
