Magnotti John F, Basu Mallick Debshila, Feng Guo, Zhou Bin, Zhou Wen, Beauchamp Michael S
Department of Neurosurgery, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, United States.
OpenStax, Rice University, Houston, TX, United States.
Front Psychol. 2025 Mar 28;16:1531566. doi: 10.3389/fpsyg.2025.1531566. eCollection 2025.
Humans combine the visual information from mouth movements with auditory information from the voice to recognize speech. A common method for assessing audiovisual speech perception is the McGurk effect: when presented with some incongruent pairings of auditory and visual speech syllables (e.g., the auditory speech sound "ba" dubbed onto the visual mouth movements for "ga") individuals perceive a third syllable, distinct from the auditory and visual components. The many differences between Chinese and American culture and language suggest the possibility of group differences in the McGurk effect. Published studies have reported less McGurk effect in native Mandarin Chinese speakers than in English speakers, but these studies sampled small numbers of participants tested with a small number of stimuli. Therefore, we conducted in-person tests of the McGurk effect in large samples of Mandarin-speaking individuals from China and English-speaking individuals from the USA (total = 307) viewing nine different stimuli. Averaged across participants and stimuli, we found similar frequencies of the McGurk effect between Chinese and American participants (48% vs. 44%). In both groups, there was high variability both across participants (range from 0% to 100%) and stimuli (14%-83%) with the main effect of culture and language accounting for only 0.2% of the variance in the data. The high variability inherent to the McGurk effect necessitates the use of large sample sizes to accurately estimate group differences and requires testing with a variety of McGurk stimuli, especially stimuli potent enough to evoke the illusion in the majority of participants.
人类将来自口部动作的视觉信息与来自语音的听觉信息相结合来识别语音。评估视听语音感知的一种常见方法是麦格克效应:当呈现一些听觉和视觉语音音节不一致的配对时(例如,将听觉语音“ba”与视觉口型“ga”配对),个体感知到的是第三个音节,与听觉和视觉成分都不同。中美文化和语言之间的诸多差异表明在麦格克效应中可能存在群体差异。已发表的研究报告称,以普通话为母语的人比以英语为母语的人表现出的麦格克效应更少,但这些研究的参与者样本量小,且测试的刺激物数量也少。因此,我们对来自中国的大量说普通话的人和来自美国的大量说英语的人(共307人)进行了麦格克效应的现场测试,他们观看了九种不同的刺激物。综合参与者和刺激物来看,我们发现中国和美国参与者的麦格克效应出现频率相似(分别为48%和44%)。在两组中,参与者之间(范围从0%到100%)以及刺激物之间(14%-83%)都存在很大的变异性,文化和语言的主要影响仅占数据方差的0.2%。麦格克效应固有的高变异性使得有必要使用大样本量来准确估计群体差异,并且需要用各种麦格克刺激物进行测试,尤其是那些足以在大多数参与者中引发错觉的刺激物。