Irwin Julia, Brancazio Lawrence, Volpe Nicole
Haskins Laboratories, 300 George Street, New Haven, Connecticut 06511, USA.
Southern Connecticut State University, 501 Crescent Street, New Haven, Connecticut 06515, USA.
J Acoust Soc Am. 2017 May;141(5):3145. doi: 10.1121/1.4982727.
When a speaker talks, the visible consequences of what they are saying can be seen. Listeners are influenced by this visible speech both in a noisy listening environment and even when auditory speech can easily be heard. While visible influence on heard speech has been reported to increase from early to late childhood, little is known about the mechanism that underlies this developmental trend. One possible account of developmental differences is that looking behavior to the face of a speaker changes with age. To examine this possibility, the gaze to a speaking face was examined in children from 5 to 10 yrs of age and adults. Participants viewed a speaker's face in a range of conditions that elicit looking: in a visual only (speech reading) condition, in the presence of auditory noise (speech in noise) condition, and in an audiovisual mismatch (McGurk) condition. Results indicate an increase in gaze on the face, and specifically, to the mouth of a speaker between the ages of 5 and 10 for all conditions. This change in looking behavior may help account for previous findings in the literature showing that visual influence on heard speech increases with development.
当说话者讲话时,可以看到他们所说内容的可见后果。在嘈杂的聆听环境中,甚至当听觉语音很容易被听到时,听众都会受到这种可见语音的影响。虽然据报道,可见语音对听到的语音的影响从童年早期到晚期会增加,但对于这种发展趋势背后的机制却知之甚少。关于发展差异的一种可能解释是,对说话者面部的注视行为会随着年龄而变化。为了检验这种可能性,研究人员对5至10岁的儿童和成年人注视说话者面部的情况进行了研究。参与者在一系列引发注视的条件下观看说话者的面部:仅视觉(唇读)条件、存在听觉噪声(噪声中的语音)条件以及视听不匹配(麦格克)条件。结果表明,在所有条件下,5至10岁之间对说话者面部尤其是嘴巴的注视有所增加。这种注视行为的变化可能有助于解释文献中先前的研究结果,即视觉对听到的语音的影响会随着发育而增加。