Suppr超能文献

视觉语音线索能促进对口语单词的开放集识别。

Visual speech primes open-set recognition of spoken words.

作者信息

Buchwald Adam B, Winters Stephen J, Pisoni David B

机构信息

Department of Speech-Language Pathology and Audiology, New York University, New York, NY, and Department of Psychological and Brain Sciences, Indiana University, Bloomington, IN, USA.

出版信息

Lang Cogn Process. 2009;24(4):580-610. doi: 10.1080/01690960802536357.

Abstract

Visual speech perception has become a topic of considerable interest to speech researchers. Previous research has demonstrated that perceivers neurally encode and use speech information from the visual modality, and this information has been found to facilitate spoken word recognition in tasks such as lexical decision (Kim, Davis, & Krins, 2004). In this paper, we used a cross-modality repetition priming paradigm with visual speech lexical primes and auditory lexical targets to explore the nature of this priming effect. First, we report that participants identified spoken words mixed with noise more accurately when the words were preceded by a visual speech prime of the same word compared with a control condition. Second, analyses of the responses indicated that both correct and incorrect responses were constrained by the visual speech information in the prime. These complementary results suggest that the visual speech primes have an effect on lexical access by increasing the likelihood that words with certain phonetic properties are selected. Third, we found that the cross-modality repetition priming effect was maintained even when visual and auditory signals came from different speakers, and thus different instances of the same lexical item. We discuss implications of these results for current theories of speech perception.

摘要

视觉言语感知已成为言语研究者相当感兴趣的一个话题。先前的研究表明,感知者会对来自视觉通道的言语信息进行神经编码并加以利用,而且在诸如词汇判断等任务中,已发现这种信息有助于口语单词的识别(Kim、Davis和Krins,2004)。在本文中,我们使用了一种跨通道重复启动范式,以视觉言语词汇启动项和听觉词汇目标来探究这种启动效应的本质。首先,我们报告称,与控制条件相比,当单词之前呈现相同单词的视觉言语启动项时,参与者能更准确地识别出夹杂噪音的口语单词。其次,对反应的分析表明,正确和错误反应均受到启动项中视觉言语信息的限制。这些互补的结果表明,视觉言语启动项通过增加选择具有特定语音属性单词的可能性,对词汇通达产生影响。第三,我们发现,即使视觉和听觉信号来自不同的说话者,即同一词汇项的不同实例,跨通道重复启动效应依然存在。我们讨论了这些结果对当前言语感知理论的意义。

相似文献

1
Visual speech primes open-set recognition of spoken words.
Lang Cogn Process. 2009;24(4):580-610. doi: 10.1080/01690960802536357.
2
Amodal processing of visual speech as revealed by priming.
Cognition. 2004 Aug;93(1):B39-47. doi: 10.1016/j.cognition.2003.11.003.
3
Cross-modal masked repetition and semantic priming in auditory lexical decision.
Psychon Bull Rev. 2019 Apr;26(2):599-608. doi: 10.3758/s13423-018-1540-8.
4
Predictive Neural Computations Support Spoken Word Recognition: Evidence from MEG and Competitor Priming.
J Neurosci. 2021 Aug 11;41(32):6919-6932. doi: 10.1523/JNEUROSCI.1685-20.2021. Epub 2021 Jul 1.
5
Phoneme-Order Encoding During Spoken Word Recognition: A Priming Investigation.
Cogn Sci. 2019 Oct;43(10):e12785. doi: 10.1111/cogs.12785.
6
Delayed commitment in spoken word recognition: evidence from cross-modal priming.
Percept Psychophys. 1998 Apr;60(3):484-90. doi: 10.3758/bf03206868.
7
Form-based priming in spoken word recognition: the roles of competition and bias.
J Exp Psychol Learn Mem Cogn. 1992 Nov;18(6):1211-38. doi: 10.1037//0278-7393.18.6.1211.
8
Representational level matters for tone-word recognition: Evidence from form priming.
Q J Exp Psychol (Hove). 2024 May;77(5):1125-1135. doi: 10.1177/17470218231203615. Epub 2023 Oct 24.
9
Does Talker-Specific Information Influence Lexical Competition? Evidence From Phonological Priming.
Cogn Sci. 2017 Nov;41(8):2221-2233. doi: 10.1111/cogs.12472. Epub 2016 Dec 10.
10
Speech perception in children with cochlear implants: effects of lexical difficulty, talker variability, and word length.
Ann Otol Rhinol Laryngol Suppl. 2000 Dec;185:79-81. doi: 10.1177/0003489400109s1234.

引用本文的文献

1
Lexical Effects on the Perceived Clarity of Noise-Vocoded Speech in Younger and Older Listeners.
Front Psychol. 2022 Apr 1;13:837644. doi: 10.3389/fpsyg.2022.837644. eCollection 2022.
2
More than words: word predictability, prosody, gesture and mouth movements in natural language comprehension.
Proc Biol Sci. 2021 Jul 28;288(1955):20210500. doi: 10.1098/rspb.2021.0500. Epub 2021 Jul 21.
3
Speechreading in hearing children can be improved by training.
Dev Sci. 2021 Nov;24(6):e13124. doi: 10.1111/desc.13124. Epub 2021 Jun 1.
4
6
Different neural processes underlie visual speech perception in school-age children and adults: An event-related potentials study.
J Exp Child Psychol. 2019 Aug;184:98-122. doi: 10.1016/j.jecp.2019.03.009. Epub 2019 Apr 20.
7
Learning Spoken Words via the Ears and Eyes: Evidence from 30-Month-Old Children.
Front Psychol. 2017 Dec 8;8:2122. doi: 10.3389/fpsyg.2017.02122. eCollection 2017.
8
The Role of Auditory and Visual Speech in Word Learning at 18 Months and in Adulthood.
Child Dev. 2017 Nov;88(6):2043-2059. doi: 10.1111/cdev.12715. Epub 2017 Jan 26.

本文引用的文献

1
Puzzle-solving science: the quixotic quest for units in speech perception.
J Phon. 2003 Jul-Oct;31(3-4):305-320. doi: 10.1016/S0095-4470(03)00030-5. Epub 2003 Oct 20.
3
Crossmodal Source Identification in Speech Perception.
Ecol Psychol. 2004;16(3):159-187. doi: 10.1207/s15326969eco1603_1.
4
SPEECH PERCEPTION AS A TALKER-CONTINGENT PROCESS.
Psychol Sci. 1994 Jan 1;5(1):42-46. doi: 10.1111/j.1467-9280.1994.tb00612.x.
5
Crossmodal binding: evaluating the "unity assumption" using audiovisual speech stimuli.
Percept Psychophys. 2007 Jul;69(5):744-56. doi: 10.3758/bf03193776.
6
Lip-read me now, hear me better later: cross-modal transfer of talker-familiarity effects.
Psychol Sci. 2007 May;18(5):392-6. doi: 10.1111/j.1467-9280.2007.01911.x.
7
Discriminating languages by speech-reading.
Percept Psychophys. 2007 Feb;69(2):218-31. doi: 10.3758/bf03193744.
8
Visual language discrimination in infancy.
Science. 2007 May 25;316(5828):1159. doi: 10.1126/science.1137686.
9
Is neocortex essentially multisensory?
Trends Cogn Sci. 2006 Jun;10(6):278-85. doi: 10.1016/j.tics.2006.04.008. Epub 2006 May 18.
10
An acquired deficit of audiovisual speech processing.
Brain Lang. 2006 Jul;98(1):66-73. doi: 10.1016/j.bandl.2006.02.001. Epub 2006 Apr 4.

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验