Hintz Florian, Voeten Cesko C, Dobó Dorottya, Lukics Krisztina Sára, Lukács Ágnes
Deutscher Sprachatlas, Philipps University of Marburg, Pilgrimstein 16, 35032, Marburg, Germany.
Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands.
Sci Rep. 2024 Aug 1;14(1):17797. doi: 10.1038/s41598-024-68674-3.
Individuals exhibit massive variability in general cognitive skills that affect language processing. This variability is partly developmental. Here, we recruited a large sample of participants (N = 487), ranging from 9 to 90 years of age, and examined the involvement of nonverbal processing speed (assessed using visual and auditory reaction time tasks) and working memory (assessed using forward and backward Digit Span tasks) in a visual world task. Participants saw two objects on the screen and heard a sentence that referred to one of them. In half of the sentences, the target object could be predicted based on verb-selectional restrictions. We observed evidence for anticipatory processing on predictable compared to non-predictable trials. Visual and auditory processing speed had main effects on sentence comprehension and facilitated predictive processing, as evidenced by an interaction. We observed only weak evidence for the involvement of working memory in predictive sentence comprehension. Age had a nonlinear main effect (younger adults responded faster than children and older adults), but it did not differentially modulate predictive and non-predictive processing, nor did it modulate the involvement of processing speed and working memory. Our results contribute to delineating the cognitive skills that are involved in language-vision interactions.
个体在影响语言处理的一般认知技能方面表现出巨大的变异性。这种变异性部分是发育性的。在这里,我们招募了大量参与者(N = 487),年龄从9岁到90岁不等,并在视觉世界任务中考察了非言语处理速度(使用视觉和听觉反应时任务进行评估)和工作记忆(使用顺背和倒背数字广度任务进行评估)的参与情况。参与者在屏幕上看到两个物体,并听到一个指代其中一个物体的句子。在一半的句子中,目标物体可以根据动词选择限制来预测。与不可预测的试验相比,我们观察到了可预测试验中预期处理的证据。视觉和听觉处理速度对句子理解有主效应,并促进了预测性处理,这一点通过交互作用得到了证明。我们仅观察到工作记忆参与预测性句子理解的微弱证据。年龄有非线性主效应(年轻成年人比儿童和老年人反应更快),但它并没有差异调节预测性和非预测性处理,也没有调节处理速度和工作记忆的参与情况。我们的结果有助于描绘语言 - 视觉交互中涉及的认知技能。