Jordan T R, Bevan K
Psychological Laboratory, University of St. Andrews, St. Andrews, Fife, Scotland.
J Exp Psychol Hum Percept Perform. 1997 Apr;23(2):388-403. doi: 10.1037//0096-1523.23.2.388.
It is well-known that facial orientation affects the processing of static facial information, but similar effects on the processing of visual speech have yet to be explored fully. Three experiments are reported in which the effects of facial orientation on visual speech processing were examined using a talking face presented at 8 orientations through 360 degrees. Auditory and visual forms of the syllables /ba/, /bi/, /ga/, /gi/, /ma/, /mi/, /ta/, and /ti/ were used to produce the following speech stimulus types: auditory, visual, congruent audiovisual, and incongruent audiovisual. Facial orientation did not affect identification of visual speed per se or the near-perfect accuracy of auditory speech report with congruent audiovisual speech stimuli. However, facial orientation did affect the accuracy of auditory speech report with incongruent audiovisual speech stimuli. Moreover, the nature of this effect depended on the type of incongruent visual speech used. Implications for the processing of visual and audiovisual speech are discussed.
众所周知，面部朝向会影响静态面部信息的处理，但对视觉言语处理的类似影响尚未得到充分探索。本文报告了三项实验，其中通过呈现360度范围内8种朝向的会说话面部来检验面部朝向对视觉言语处理的影响。使用音节/ba/、/bi/、/ga/、/gi/、/ma/、/mi/、/ta/和/ti/的听觉和视觉形式来产生以下言语刺激类型：听觉、视觉、一致视听和不一致视听。面部朝向本身并不影响视觉言语的识别，也不影响一致视听言语刺激下听觉言语报告的近乎完美的准确性。然而，面部朝向确实会影响不一致视听言语刺激下听觉言语报告的准确性。此外，这种影响的性质取决于所使用的不一致视觉言语的类型。本文还讨论了对视觉和视听言语处理的启示。
