Gijbels Liesbeth, Lee Adrian K C, Yeatman Jason D
Department of Speech & Hearing Sciences, University of Washington, Seattle, Washington, USA.
University of Washington, Institute for Learning & Brain Sciences, Seattle, Washington, USA.
Dev Sci. 2024 Jan;27(1):e13431. doi: 10.1111/desc.13431. Epub 2023 Jul 4.
As reading is inherently a multisensory, audiovisual (AV) process where visual symbols (i.e., letters) are connected to speech sounds, the question has been raised whether individuals with reading difficulties, like children with developmental dyslexia (DD), have broader impairments in multisensory processing. This question has been posed before, yet it remains unanswered due to (a) the complexity and contentious etiology of DD along with (b) lack of consensus on developmentally appropriate AV processing tasks. We created an ecologically valid task for measuring multisensory AV processing by leveraging the natural phenomenon that speech perception improves when listeners are provided visual information from mouth movements (particularly when the auditory signal is degraded). We designed this AV processing task with low cognitive and linguistic demands such that children with and without DD would have equal unimodal (auditory and visual) performance. We then collected data in a group of 135 children (age 6.5-15) with an AV speech perception task to answer the following questions: (1) How do AV speech perception benefits manifest in children, with and without DD? (2) Do children all use the same perceptual weights to create AV speech perception benefits, and (3) what is the role of phonological processing in AV speech perception? We show that children with and without DD have equal AV speech perception benefits on this task, but that children with DD rely less on auditory processing in more difficult listening situations to create these benefits and weigh both incoming information streams differently. Lastly, any reported differences in speech perception in children with DD might be better explained by differences in phonological processing than differences in reading skills. RESEARCH HIGHLIGHTS: Children with versus without developmental dyslexia have equal audiovisual speech perception benefits, regardless of their phonological awareness or reading skills. Children with developmental dyslexia rely less on auditory performance to create audiovisual speech perception benefits. Individual differences in speech perception in children might be better explained by differences in phonological processing than differences in reading skills.
由于阅读本质上是一个多感官的视听过程,其中视觉符号(即字母)与语音相联系,因此有人提出疑问,像患有发育性阅读障碍(DD)的儿童这样有阅读困难的个体,在多感官处理方面是否存在更广泛的损伤。这个问题之前就已提出,但由于(a)DD病因的复杂性和争议性,以及(b)在适合发育阶段的视听处理任务上缺乏共识,所以仍然没有答案。我们利用这样一种自然现象创建了一个用于测量多感官视听处理的生态有效任务,即当听众从口部动作获得视觉信息时(特别是当听觉信号退化时),语音感知会得到改善。我们设计这个视听处理任务时,使其认知和语言要求较低,这样患有和未患有DD的儿童在单模态(听觉和视觉)表现上会相当。然后我们通过一个视听语音感知任务收集了135名6.5至15岁儿童的数据,以回答以下问题:(1)患有和未患有DD的儿童在视听语音感知方面的益处如何体现?(2)儿童在创造视听语音感知益处时是否都使用相同的感知权重?以及(3)语音处理在视听语音感知中起什么作用?我们发现,患有和未患有DD的儿童在这项任务上有同等的视听语音感知益处,但患有DD的儿童在更困难的听力情况下,为创造这些益处而对听觉处理的依赖较少,并且对两种传入信息流的权衡有所不同。最后,与阅读技能差异相比,语音处理差异可能能更好地解释DD儿童在语音感知方面报告的任何差异。研究亮点:患有与未患有发育性阅读障碍的儿童有同等的视听语音感知益处,无论其语音意识或阅读技能如何。患有发育性阅读障碍的儿童在创造视听语音感知益处时对听觉表现的依赖较少。与阅读技能差异相比,语音处理差异可能能更好地解释儿童在语音感知方面的个体差异。