Department of Speech Pathology and Audiology, University of South Alabama, 5721 USA Drive North, Mobile, Alabama 36688, USA.
Department of Speech and Hearing Science, University of Illinois Urbana-Champaign, 901 South Sixth Street, Champaign, Illinois 61820, USA
JASA Express Lett. 2023 Feb;3(2):025202. doi: 10.1121/10.0017215.
This study examined the effect of modality onset asynchrony and response processing time for the recognition of text-supplemented speech. Speech and text were periodically interrupted by noise or black bars, respectively, to preserve 50% of the sentence and presented in unimodal and multimodal conditions. Sentence recognition and response errors were assessed for responses made simultaneous with the stimulus or after its presentation. Increased processing time allowed for the cognitive repair of initial response errors in working memory. Text-supplemented speech was best recognized with minimal temporal asynchrony. Overall, text supplementation facilitated the recognition of degraded speech when provided sufficient processing time.
本研究考察了模态起始异步和响应处理时间对文本补充语音识别的影响。语音和文本分别由噪声或黑色条带周期性中断，以保留句子的 50%，并在单模态和多模态条件下呈现。对于与刺激同时或在刺激呈现后做出的反应，评估了句子识别和反应错误。增加处理时间允许在工作记忆中对初始反应错误进行认知修复。在最小时间异步的情况下，文本补充语音的识别效果最佳。总的来说，当提供足够的处理时间时，文本补充有助于改善语音的可懂度。
