Suppr超能文献

婴儿视听语音感知研究中的混淆因素

Sources of Confusion in Infant Audiovisual Speech Perception Research.

作者信息

Shaw Kathleen E, Bortfeld Heather

机构信息

Department of Psychology, University of Connecticut Storrs, CT, USA.

Psychological Sciences, University of California, Merced Merced, CA, USA ; Haskins Laboratories New Haven, CT, USA.

出版信息

Front Psychol. 2015 Dec 15;6:1844. doi: 10.3389/fpsyg.2015.01844. eCollection 2015.

Abstract

Speech is a multimodal stimulus, with information provided in both the auditory and visual modalities. The resulting audiovisual signal provides relatively stable, tightly correlated cues that support speech perception and processing in a range of contexts. Despite the clear relationship between spoken language and the moving mouth that produces it, there remains considerable disagreement over how sensitive early language learners-infants-are to whether and how sight and sound co-occur. Here we examine sources of this disagreement, with a focus on how comparisons of data obtained using different paradigms and different stimuli may serve to exacerbate misunderstanding.

摘要

言语是一种多模态刺激,通过听觉和视觉两种模态提供信息。由此产生的视听信号提供了相对稳定、紧密相关的线索,这些线索在一系列情境中支持言语感知和处理。尽管口语与产生口语的活动嘴部之间存在明显的关系,但对于早期语言学习者——婴儿——对视觉和声音是否同时出现以及如何同时出现的敏感程度,仍然存在相当大的分歧。在这里,我们研究这种分歧的根源,重点关注使用不同范式和不同刺激获得的数据比较如何可能加剧误解。

相似文献

1
Sources of Confusion in Infant Audiovisual Speech Perception Research.
Front Psychol. 2015 Dec 15;6:1844. doi: 10.3389/fpsyg.2015.01844. eCollection 2015.
2
Speech-specific audiovisual integration modulates induced theta-band oscillations.
PLoS One. 2019 Jul 16;14(7):e0219744. doi: 10.1371/journal.pone.0219744. eCollection 2019.
3
Development of the Mechanisms Underlying Audiovisual Speech Perception Benefit.
Brain Sci. 2021 Jan 5;11(1):49. doi: 10.3390/brainsci11010049.
4
Degrading phonetic information affects matching of audiovisual speech in adults, but not in infants.
Cognition. 2014 Jan;130(1):31-43. doi: 10.1016/j.cognition.2013.09.006. Epub 2013 Oct 18.
5
Language experience influences audiovisual speech integration in unimodal and bimodal bilingual infants.
Dev Sci. 2019 Jan;22(1):e12701. doi: 10.1111/desc.12701. Epub 2018 Jul 16.
6
Exploring audiovisual speech perception in monolingual and bilingual children in Uzbekistan.
J Exp Child Psychol. 2024 Mar;239:105808. doi: 10.1016/j.jecp.2023.105808. Epub 2023 Nov 15.
7
Modeling the Development of Audiovisual Cue Integration in Speech Perception.
Brain Sci. 2017 Mar 21;7(3):32. doi: 10.3390/brainsci7030032.
8
Effects of congruent and incongruent visual cues on speech perception and brain activity in cochlear implant users.
Brain Struct Funct. 2015 Mar;220(2):1109-25. doi: 10.1007/s00429-013-0704-6. Epub 2014 Jan 9.
9
Spatiotemporal dynamics of audiovisual speech processing.
Neuroimage. 2008 Jan 1;39(1):423-35. doi: 10.1016/j.neuroimage.2007.08.035. Epub 2007 Aug 31.
10
Audiovisual speech perception: Moving beyond McGurk.
J Acoust Soc Am. 2022 Dec;152(6):3216. doi: 10.1121/10.0015262.

引用本文的文献

1
Infant attention to rhythmic audiovisual synchrony is modulated by stimulus properties.
Front Psychol. 2024 Jul 2;15:1393295. doi: 10.3389/fpsyg.2024.1393295. eCollection 2024.
2
Development of the Mechanisms Underlying Audiovisual Speech Perception Benefit.
Brain Sci. 2021 Jan 5;11(1):49. doi: 10.3390/brainsci11010049.
3
Infants and Adults Use Visual Cues to Improve Detection and Discrimination of Speech in Noise.
J Speech Lang Hear Res. 2019 Oct 25;62(10):3860-3875. doi: 10.1044/2019_JSLHR-H-19-0106. Epub 2019 Oct 16.
4
Modality-independent recruitment of inferior frontal cortex during speech processing in human infants.
Dev Cogn Neurosci. 2018 Nov;34:130-138. doi: 10.1016/j.dcn.2018.10.002. Epub 2018 Oct 30.
5
Emergence of a hierarchical brain during infancy reflected by stepwise functional connectivity.
Hum Brain Mapp. 2017 May;38(5):2666-2682. doi: 10.1002/hbm.23552. Epub 2017 Mar 6.

本文引用的文献

1
Infants' preference for native audiovisual speech dissociated from congruency preference.
PLoS One. 2015 Apr 30;10(4):e0126059. doi: 10.1371/journal.pone.0126059. eCollection 2015.
2
Perception of the multisensory coherence of fluent audiovisual speech in infancy: its emergence and the role of experience.
J Exp Child Psychol. 2015 Feb;130:147-62. doi: 10.1016/j.jecp.2014.10.006. Epub 2014 Nov 11.
3
Attention to the mouth and gaze following in infancy predict language development.
J Child Lang. 2015 Nov;42(6):1173-90. doi: 10.1017/S0305000914000725. Epub 2014 Nov 18.
4
Phonetic matching of auditory and visual speech develops during childhood: evidence from sine-wave speech.
J Exp Child Psychol. 2015 Jan;129:157-64. doi: 10.1016/j.jecp.2014.08.002. Epub 2014 Sep 23.
5
Infant perceptual development for faces and spoken words: an integrated approach.
Dev Psychobiol. 2014 Nov;56(7):1454-81. doi: 10.1002/dev.21243. Epub 2014 Aug 4.
6
The construct of the multisensory temporal binding window and its dysregulation in developmental disabilities.
Neuropsychologia. 2014 Nov;64:105-23. doi: 10.1016/j.neuropsychologia.2014.08.005. Epub 2014 Aug 13.
7
Cross-modal matching of audio-visual German and French fluent speech in infancy.
PLoS One. 2014 Feb 20;9(2):e89275. doi: 10.1371/journal.pone.0089275. eCollection 2014.
9
Degrading phonetic information affects matching of audiovisual speech in adults, but not in infants.
Cognition. 2014 Jan;130(1):31-43. doi: 10.1016/j.cognition.2013.09.006. Epub 2013 Oct 18.
10

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验