Department of Psychological & Brain Sciences, Washington University in St. Louis, One Brookings Dr, St. Louis, MO, 63130, USA.
Atten Percept Psychophys. 2022 Aug;84(6):2074-2086. doi: 10.3758/s13414-021-02423-w. Epub 2022 Jan 5.
Speech intelligibility is improved when the listener can see the talker in addition to hearing their voice. Notably, though, previous work has suggested that this "audiovisual benefit" for nonnative (i.e., foreign-accented) speech is smaller than the benefit for native speech, an effect that may be partially accounted for by listeners' implicit racial biases (Yi et al., 2013, The Journal of the Acoustical Society of America, 134[5], EL387-EL393.). In the present study, we sought to replicate these findings in a significantly larger sample of online participants. In a direct replication of Yi et al. (Experiment 1), we found that audiovisual benefit was indeed smaller for nonnative-accented relative to native-accented speech. However, our results did not support the conclusion that implicit racial biases, as measured with two types of implicit association tasks, were related to these differences in audiovisual benefit for native and nonnative speech. In a second experiment, we addressed a potential confound in the experimental design; to ensure that the difference in audiovisual benefit was caused by a difference in accent rather than a difference in overall intelligibility, we reversed the overall difficulty of each accent condition by presenting them at different signal-to-noise ratios. Even when native speech was presented at a much more difficult intelligibility level than nonnative speech, audiovisual benefit for nonnative speech remained poorer. In light of these findings, we discuss alternative explanations of reduced audiovisual benefit for nonnative speech, as well as methodological considerations for future work examining the intersection of social, cognitive, and linguistic processes.
当听众除了听到说话者的声音外,还能看到说话者时,言语可懂度会提高。值得注意的是,尽管先前的研究表明,对于非母语(即带有外国口音)的言语,这种“视听增益”小于母语的增益,这种效应可能部分归因于听众的隐性种族偏见(Yi 等人,2013 年,美国声学学会杂志,134[5],EL387-EL393.)。在本研究中,我们试图在一个更大的在线参与者样本中复制这些发现。在对 Yi 等人的直接复制中(实验 1),我们发现,与母语口音相比,非母语口音的视听增益确实更小。然而,我们的结果并不支持隐性种族偏见与母语和非母语言语的视听增益差异有关的结论,这种偏见是通过两种内隐联想任务来衡量的。在第二个实验中,我们解决了实验设计中的一个潜在混杂因素;为了确保视听增益的差异是由口音差异而不是整体可懂度差异引起的,我们通过在不同的信噪比下呈现每个口音条件来反转它们的整体难度。即使在母语以比非母语更难的可懂度水平呈现时,非母语言语的视听增益仍然较差。鉴于这些发现,我们讨论了减少非母语言语视听增益的替代解释,以及未来研究社会、认知和语言过程交叉点的方法学考虑因素。