Brancazio Lawrence, Miller Joanne L
Department of Psychology, Southern Connecticut State University, 501 Crescent St., New Haven, CT 06515, USA.
Percept Psychophys. 2005 Jul;67(5):759-69. doi: 10.3758/bf03193531.
The McGurk effect, where an incongruent visual syllable influences identification of an auditory syllable, does not always occur, suggesting that perceivers sometimes fail to use relevant visual phonetic information. We tested whether another visual phonetic effect, which involves the influence of visual speaking rate on perceived voicing (Green & Miller, 1985), would occur in instances when the McGurk effect does not. In Experiment 1, we established this visual rate effect using auditory and visual stimuli matching in place of articulation, finding a shift in the voicing boundary along an auditory voice-onset-time continuum with fast versus slow visual speech tokens. In Experiment 2, we used auditory and visual stimuli differing in place of articulation and found a shift in the voicing boundary due to visual rate when the McGurk effect occurred and, more critically, when it did not. The latter finding indicates that phonetically relevant visual information is used in speech perception even when the McGurk effect does not occur, suggesting that the incidence of the McGurk effect underestimates the extent of audio-visual integration.
麦格克效应是指不一致的视觉音节会影响听觉音节的识别,但这种效应并非总是出现,这表明感知者有时未能利用相关的视觉语音信息。我们测试了另一种视觉语音效应(即视觉语速对感知到的浊音的影响,格林和米勒,1985年)在麦格克效应未出现的情况下是否会发生。在实验1中,我们使用匹配发音部位的听觉和视觉刺激建立了这种视觉语速效应,发现在听觉语音起始时间连续体上,快速与慢速视觉语音标记会使浊音边界发生偏移。在实验2中,我们使用发音部位不同的听觉和视觉刺激,发现在麦格克效应出现时以及更关键的是在其未出现时,视觉语速都会使浊音边界发生偏移。后一发现表明,即使麦格克效应未发生,语音相关的视觉信息也会在语音感知中被利用,这表明麦格克效应的发生率低估了视听整合的程度。