Lindfors Hanna, Hansson Kristina, Pakulak Eric, Cohn Neil, Andersson Annika
Linnaeus Language Processing Lab, Department of Swedish, Linnaeus University, Växjö, Sweden.
Logopedics, Phoniatrics and Audiology, Department of Clinical Sciences, Lund University, Lund, Sweden.
Front Psychol. 2024 Jan 12;14:1253509. doi: 10.3389/fpsyg.2023.1253509. eCollection 2023.
There is a misconception that pictures are easy to comprehend, which is problematic in pedagogical practices that include pictures. For example, if a child has difficulties with verbal narration to picture sequences, it may be interpreted as specific to spoken language even though the child may have additional difficulties with comprehension of visual narratives in the form of picture sequences. The purpose of the present study was therefore to increase our understanding of semantic processing in the pictorial domain in relation to semantic processing in the verbal domain, focusing on 9-13 years-old children with typical language development. To this end, we measured electrical brain responses (event related potentials, ERPs) in 17 children to (i) pictures (panels) that were predicted versus unpredicted in sequences of panels that conveyed visual narratives and (ii) words that were predicted versus unpredicted in sentences that conveyed verbal narratives. Results demonstrated similarities as there were no significant difference in the magnitude of the N400 effect across domains. The only difference between domains was the predicted difference in distribution, that is, a more posterior N400 effect in the verbal domain than in the pictorial domain. The study contributes to an increased understanding of the complexity of processing of visual narratives and its shared features with processing of verbal narratives, which should be considered in pedagogical practices.
有一种误解认为图片易于理解,这在包含图片的教学实践中是有问题的。例如,如果一个孩子在对图片序列进行口头叙述时有困难,这可能会被解释为特定于口语,尽管这个孩子可能在理解图片序列形式的视觉叙述方面还有其他困难。因此,本研究的目的是加深我们对图像领域语义处理与语言领域语义处理之间关系的理解,重点关注语言发展正常的9至13岁儿童。为此,我们测量了17名儿童对(i)在传达视觉叙述的图片组(面板)序列中可预测与不可预测的图片(面板)以及(ii)在传达语言叙述的句子中可预测与不可预测的单词的脑电反应(事件相关电位,ERP)。结果显示出相似性,因为跨领域的N400效应幅度没有显著差异。领域之间唯一的差异是分布上的预测差异,即语言领域的N400效应比图像领域更靠后。该研究有助于加深对视觉叙述处理的复杂性及其与语言叙述处理的共同特征的理解,这在教学实践中应予以考虑。