Department of Communication and Cognition, Tilburg School of Humanities and Digital Sciences, Tilburg Center for Cognition and Communication, Tilburg University, P.O. Box 90153, 5000, Tilburg, LE, Netherlands.
Department of Psychology, University of Essex, Colchester, UK.
Mem Cognit. 2022 Oct;50(7):1381-1398. doi: 10.3758/s13421-022-01294-2. Epub 2022 Mar 2.
Compositionality is a primary feature of language, but graphics can also create combinatorial meaning, like with items above faces (e.g., lightbulbs to mean inspiration). We posit that these "upfixes" (i.e., upwards affixes) involve a productive schema enabling both stored and novel face-upfix dyads. In two experiments, participants viewed either conventional (e.g., lightbulb) or unconventional (e.g., clover-leaves) upfixes with faces which either matched (e.g., lightbulb/smile) or mismatched (e.g., lightbulb/frown). In Experiment 1, matching dyads sponsored higher comprehensibility ratings and faster response times, modulated by conventionality. In Experiment 2, event-related brain potentials (ERPs) revealed conventional upfixes, regardless of matching, evoked larger N250s, indicating perceptual expertise, but mismatching and unconventional dyads elicited larger semantic processing costs (N400) than conventional-matching dyads. Yet mismatches evoked a late negativity, suggesting congruent novel dyads remained construable compared with violations. These results support that combinatorial graphics involve a constrained productive schema, similar to the lexicon of language.
组合性是语言的主要特征,但图形也可以创造组合意义,例如在面部上方的物品(例如,灯泡表示灵感)。我们假设这些“上缀”(即向上的缀词)涉及一种生产性模式,既能存储又能创造新颖的面向上缀对。在两项实验中,参与者观看了带有面孔的常规(例如,灯泡)或非常规(例如,三叶草叶)上缀,这些面孔要么匹配(例如,灯泡/微笑),要么不匹配(例如,灯泡/皱眉)。在实验 1 中,匹配的对偶对赞助了更高的理解度评分和更快的反应时间,这受到常规性的调节。在实验 2 中,事件相关的脑电位(ERPs)显示,无论匹配与否,常规的上缀都会引起更大的 N250,表明具有感知专业知识,但不匹配和非常规的对偶对比常规匹配的对偶对引起更大的语义处理成本(N400)。然而,不匹配会引起晚期负性,表明与违反相比,一致的新对偶对仍然可以构建。这些结果支持组合图形涉及一种受约束的生产性模式,类似于语言的词汇。