Suppr超能文献

视听言语不仅仅是其各部分的总和:听觉-视觉超加性补偿了与年龄相关的可听言语和唇读言语可懂度下降。

Audiovisual speech is more than the sum of its parts: Auditory-visual superadditivity compensates for age-related declines in audible and lipread speech intelligibility.

机构信息

Department of Otolaryngology-Head and Neck Surgery.

出版信息

Psychol Aging. 2021 Jun;36(4):520-530. doi: 10.1037/pag0000613.

Abstract

Multisensory input can improve perception of ambiguous unisensory information. For example, speech heard in noise can be more accurately identified when listeners see a speaker's articulating face. Importantly, these multisensory effects can be superadditive to listeners' ability to process unisensory speech, such that audiovisual speech identification is better than the sum of auditory-only and visual-only speech identification. Age-related declines in auditory and visual speech perception have been hypothesized to be concomitant with stronger cross-sensory influences on audiovisual speech identification, but little evidence exists to support this. Currently, studies do not account for the multisensory superadditive benefit of auditory-visual input in their metrics of the auditory or visual influence on audiovisual speech perception. Here we treat multisensory superadditivity as independent from unisensory auditory and visual processing. In the current investigation, older and younger adults identified auditory, visual, and audiovisual speech in noisy listening conditions. Performance across these conditions was used to compute conventional metrics of the auditory and visual influence on audiovisual speech identification and a metric of auditory-visual superadditivity. Consistent with past work, auditory and visual speech identification declined with age, audiovisual speech identification was preserved, and no age-related differences in the auditory or visual influence on audiovisual speech identification were observed. However, we found that auditory-visual superadditivity improved with age. The novel findings suggest that multisensory superadditivity is independent of unisensory processing. As auditory and visual speech identification decline with age, compensatory changes in multisensory superadditivity may preserve audiovisual speech identification in older adults. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

摘要

多感官输入可以改善对模棱两可的单感官信息的感知。例如,当听众看到说话者的发音面部时,听到的噪声中的语音可以更准确地识别。重要的是,这些多感官效应可以增强听众处理单语音的能力,使得视听语音识别优于仅听觉和仅视觉语音识别的总和。人们假设,与听觉和视觉语音感知相关的年龄相关下降伴随着对视听语音识别的更强的跨感官影响,但几乎没有证据支持这一点。目前,研究在其视听语音感知的听觉或视觉影响的度量标准中,没有考虑听觉-视觉输入的多感官超加性益处。在这里,我们将多感官超加性视为独立于单感官听觉和视觉处理的因素。在当前的研究中,老年人和年轻人在嘈杂的听力条件下识别听觉、视觉和视听语音。使用这些条件下的表现来计算视听语音识别的听觉和视觉影响的常规度量标准和听觉-视觉超加性的度量标准。与过去的工作一致,听觉和视觉语音识别随年龄下降,视听语音识别得以保留,并且在听觉或视觉对视听语音识别的影响方面没有观察到与年龄相关的差异。然而,我们发现听觉-视觉超加性随年龄增长而提高。新的发现表明,多感官超加性独立于单感官处理。随着年龄的增长,听觉和视觉语音识别下降,多感官超加性的补偿变化可能会使老年人的视听语音识别保持不变。(PsycInfo 数据库记录(c)2021 APA,保留所有权利)。

相似文献

2
The timecourse of multisensory speech processing in unilaterally stimulated cochlear implant users revealed by ERPs.
Neuroimage Clin. 2022;34:102982. doi: 10.1016/j.nicl.2022.102982. Epub 2022 Mar 4.
5
Aging, audiovisual integration, and the principle of inverse effectiveness.
Ear Hear. 2010 Oct;31(5):636-44. doi: 10.1097/AUD.0b013e3181ddf7ff.
6
Inverse effectiveness and multisensory interactions in visual event-related potentials with audiovisual speech.
Brain Topogr. 2012 Jul;25(3):308-26. doi: 10.1007/s10548-012-0220-7. Epub 2012 Feb 25.
7
Prediction and constraint in audiovisual speech perception.
Cortex. 2015 Jul;68:169-81. doi: 10.1016/j.cortex.2015.03.006. Epub 2015 Mar 20.
8
Left Motor δ Oscillations Reflect Asynchrony Detection in Multisensory Speech Perception.
J Neurosci. 2022 Mar 16;42(11):2313-2326. doi: 10.1523/JNEUROSCI.2965-20.2022. Epub 2022 Jan 27.
9
Human amygdala response to unisensory and multisensory emotion input: No evidence for superadditivity from intracranial recordings.
Neuropsychologia. 2019 Aug;131:9-24. doi: 10.1016/j.neuropsychologia.2019.05.027. Epub 2019 May 31.
10
Early auditory cortical processing predicts auditory speech in noise identification and lipreading.
Neuropsychologia. 2021 Oct 15;161:108012. doi: 10.1016/j.neuropsychologia.2021.108012. Epub 2021 Aug 30.

引用本文的文献

1
Increases in sensory noise predict attentional disruptions to audiovisual speech perception.
Front Hum Neurosci. 2023 Jan 4;16:1027335. doi: 10.3389/fnhum.2022.1027335. eCollection 2022.
3
Early auditory cortical processing predicts auditory speech in noise identification and lipreading.
Neuropsychologia. 2021 Oct 15;161:108012. doi: 10.1016/j.neuropsychologia.2021.108012. Epub 2021 Aug 30.

本文引用的文献

2
The Principle of Inverse Effectiveness in Audiovisual Speech Perception.
Front Hum Neurosci. 2019 Sep 26;13:335. doi: 10.3389/fnhum.2019.00335. eCollection 2019.
3
Age Differences in the Effects of Speaking Rate on Auditory, Visual, and Auditory-Visual Speech Perception.
Ear Hear. 2020 May/Jun;41(3):549-560. doi: 10.1097/AUD.0000000000000776.
5
Increased Functional Brain Network Efficiency During Audiovisual Temporal Asynchrony Integration Task in Aging.
Front Aging Neurosci. 2018 Oct 9;10:316. doi: 10.3389/fnagi.2018.00316. eCollection 2018.
6
Changes in multisensory integration across the life span.
Psychol Aging. 2018 May;33(3):545-558. doi: 10.1037/pag0000244.
7
Does hearing aid use affect audiovisual integration in mild hearing impairment?
Exp Brain Res. 2018 Apr;236(4):1161-1179. doi: 10.1007/s00221-018-5206-6. Epub 2018 Feb 16.
8
Audiovisual sentence recognition not predicted by susceptibility to the McGurk effect.
Atten Percept Psychophys. 2017 Feb;79(2):396-403. doi: 10.3758/s13414-016-1238-9.
10
Age-related differences in inhibitory control predict audiovisual speech perception.
Psychol Aging. 2015 Sep;30(3):634-46. doi: 10.1037/pag0000033. Epub 2015 Jun 29.

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验