Department of Communication Sciences and Disorders, University of Vermont, 489 Main St, Burlington, VT, 05405, USA.
Department of Communication and Cognition, Tilburg School of Humanities and Digital Sciences, Tilburg Center for Cognition and Communication (TiCC), Tilburg University, Tilburg, The Netherlands.
Psychon Bull Rev. 2024 Feb;31(1):89-103. doi: 10.3758/s13423-023-02334-x. Epub 2023 Aug 14.
Understanding visual narrative sequences, as found in comics, is known to recruit similar cognitive mechanisms to verbal language. As measured by event-related potentials (ERPs), these manifest as initial negativities (N400, LAN) and subsequent positivities (P600). While these components are thought to index discrete processing stages, they differentially arise across participants for any given stimulus. In language contexts, proficiency modulates brain responses, with smaller N400 effects and larger P600 effects appearing with increasing proficiency. In visual narratives, recent work has also emphasized the role of proficiency in neural response patterns. We thus explored whether individual differences in proficiency modulate neural responses to visual narrative sequencing in similar ways as in language. We combined ERP data from 12 studies examining semantic and/or grammatical processing of visual narrative sequences. Using linear mixed effects modeling, we demonstrate differential effects of visual language proficiency and "age of acquisition" on N400 and P600 responses. Our results align with those reported in language contexts, providing further evidence for the similarity of linguistic and visual narrative processing, and emphasize the role of both proficiency and age of acquisition in visual narrative comprehension.
理解漫画中的视觉叙事序列被认为与理解言语语言需要类似的认知机制。通过事件相关电位(ERP)测量,这些机制表现为初始负向波(N400、LAN)和随后的正向波(P600)。虽然这些成分被认为可以标记离散的加工阶段,但对于任何给定的刺激,它们在不同的参与者中表现出不同的模式。在语言语境中,熟练程度调节大脑反应,随着熟练程度的提高,N400 效应减小,P600 效应增大。在视觉叙事中,最近的研究也强调了熟练程度在神经反应模式中的作用。因此,我们探讨了个体在视觉叙事序列加工中的熟练程度差异是否以类似于语言的方式调节神经反应。我们结合了 12 项研究的 ERP 数据,这些研究考察了视觉叙事序列的语义和/或语法处理。使用线性混合效应模型,我们证明了视觉语言熟练程度和“习得年龄”对 N400 和 P600 反应的差异影响。我们的结果与语言语境中的报告一致,进一步证明了语言和视觉叙事处理的相似性,并强调了熟练程度和习得年龄在视觉叙事理解中的作用。