Buchwald Adam B, Winters Stephen J, Pisoni David B
Department of Speech-Language Pathology and Audiology, New York University, New York, NY, and Department of Psychological and Brain Sciences, Indiana University, Bloomington, IN, USA.
Lang Cogn Process. 2009;24(4):580-610. doi: 10.1080/01690960802536357.
Visual speech perception has become a topic of considerable interest to speech researchers. Previous research has demonstrated that perceivers neurally encode and use speech information from the visual modality, and this information has been found to facilitate spoken word recognition in tasks such as lexical decision (Kim, Davis, & Krins, 2004). In this paper, we used a cross-modality repetition priming paradigm with visual speech lexical primes and auditory lexical targets to explore the nature of this priming effect. First, we report that participants identified spoken words mixed with noise more accurately when the words were preceded by a visual speech prime of the same word compared with a control condition. Second, analyses of the responses indicated that both correct and incorrect responses were constrained by the visual speech information in the prime. These complementary results suggest that the visual speech primes have an effect on lexical access by increasing the likelihood that words with certain phonetic properties are selected. Third, we found that the cross-modality repetition priming effect was maintained even when visual and auditory signals came from different speakers, and thus different instances of the same lexical item. We discuss implications of these results for current theories of speech perception.
视觉言语感知已成为言语研究者相当感兴趣的一个话题。先前的研究表明,感知者会对来自视觉通道的言语信息进行神经编码并加以利用,而且在诸如词汇判断等任务中,已发现这种信息有助于口语单词的识别(Kim、Davis和Krins,2004)。在本文中,我们使用了一种跨通道重复启动范式,以视觉言语词汇启动项和听觉词汇目标来探究这种启动效应的本质。首先,我们报告称,与控制条件相比,当单词之前呈现相同单词的视觉言语启动项时,参与者能更准确地识别出夹杂噪音的口语单词。其次,对反应的分析表明,正确和错误反应均受到启动项中视觉言语信息的限制。这些互补的结果表明,视觉言语启动项通过增加选择具有特定语音属性单词的可能性,对词汇通达产生影响。第三,我们发现,即使视觉和听觉信号来自不同的说话者,即同一词汇项的不同实例,跨通道重复启动效应依然存在。我们讨论了这些结果对当前言语感知理论的意义。