Department of Psychology, The University of Utah, Salt Lake City.
Department of Communication Sciences and Disorders, The University of Utah, Salt Lake City.
J Speech Lang Hear Res. 2022 Jun 8;65(6):2364-2390. doi: 10.1044/2022_JSLHR-21-00416. Epub 2022 May 27.
Previous studies have suggested that the negative effects of acoustic challenge on speech memory can be attenuated with assistive text captions, particularly among older adults with hearing impairment. However, no studies have systematically examined the effects of text-captioning errors, which are common in automated speech recognition (ASR) systems.
In two experiments, we examined memory for text-captioned speech (with and without background noise) when captions had no errors (control) or had one of three common ASR errors: substitution, deletion, or insertion errors.
In both Experiment 1 (young adults with normal hearing) and Experiment 2 (older adults with varying hearing acuity), we observed similar additive effects of caption errors and background noise, such that increased background noise and the presence of captioning errors negatively impacted memory outcomes. Notably, the negative effects of captioning errors were largest among older adults with increased hearing thresholds, suggesting that older adults with hearing loss may show an increased reliance on text captions compared to adults with normal hearing.
Our findings show that even a single-word error can be deleterious to memory for text-captioned speech, especially in older adults with hearing loss. Therefore, to produce the greatest benefit to memory, it is crucial that text captions are accurate.
先前的研究表明，辅助性文本字幕可以减轻听力障碍的老年人所面临的语音记忆的声学挑战的负面影响。然而，目前还没有研究系统地检验自动语音识别（ASR）系统中常见的文本字幕错误的影响。
在两项实验中，我们研究了在有（无背景噪声）和无（控制）三种常见 ASR 错误（替代、删除和插入错误）的情况下，对文本字幕语音的记忆。
在实验 1（听力正常的年轻人）和实验 2（听力不同的老年人）中，我们都观察到字幕错误和背景噪声的附加效应相似，即增加的背景噪声和字幕错误的存在会对记忆结果产生负面影响。值得注意的是，字幕错误的负面影响在听力阈值增加的老年人中最大，这表明与听力正常的成年人相比，听力损失的老年人可能更加依赖于文本字幕。
我们的发现表明，即使是一个单词的错误也会对文本字幕语音的记忆产生不利影响，尤其是在听力损失的老年人中。因此，为了使记忆得到最大程度的提升，准确的文本字幕至关重要。
