Department of Psychology, University at Albany, State University of New York, 1400 Washington Avenue, Albany, NY, 12222, USA.
Psychon Bull Rev. 2021 Jun;28(3):978-991. doi: 10.3758/s13423-020-01864-y. Epub 2021 Jan 28.
Emojis have many functions that support reading. Most obviously, they convey semantic information and support reading comprehension (Lo, CyberPsychology & Behavior, 11[5], 595-597, 2008; Riordan, Computers in Human Behavior, 76, 75-86, 2017b). However, it is undetermined whether emojis recruit the same perceptual and cognitive processes for identification and integration during reading as do words. To investigate whether emojis are processed like words, we used eye tracking to examine the time course of semantic processing of emojis during reading. Materials consisted of sentences containing a target word (e.g., coffee in the sentence "My tall coffee is just the right temperature") when there was no emoji present and when there was a semantically congruent (i.e., synonymous) emoji (e.g., the cup of coffee emoji, ) or an incongruent emoji (e.g., the beer mug emoji, ) present at the end of the sentence. Similar to congruency effects with words, congruent emojis were fixated for shorter periods and were less likely to be refixated than were incongruent emojis. In addition, congruent emojis were more frequently skipped than incongruent emojis, which suggests that semantic aspects of emoji processing begin in the parafovea. Finally, the presence of an emoji, relative to its absence increased target-word skipping rates and reduced total time on target words. We discuss the implications of our findings for models of eye-movement control during reading.
表情符号具有支持阅读的多种功能。最明显的是,它们传达语义信息并支持阅读理解(Lo,CyberPsychology & Behavior,11[5],595-597,2008;Riordan,Computers in Human Behavior,76,75-86,2017b)。然而,表情符号在阅读过程中是否与单词一样,通过相同的感知和认知过程来识别和整合,目前还不确定。为了研究表情符号是否像单词一样被处理,我们使用眼动追踪来检查阅读过程中表情符号语义处理的时间进程。材料由包含目标词的句子组成(例如,句子“我的高咖啡温度正好”中的“咖啡”),当句子中没有表情符号和有语义一致(即同义词)的表情符号(例如,杯子咖啡表情符号,)或不一致的表情符号(例如,啤酒杯表情符号,)时。与单词的一致性效应相似,一致的表情符号注视时间更短,重新注视的可能性更小,而不一致的表情符号则相反。此外,与不一致的表情符号相比,一致的表情符号更频繁地被跳过,这表明表情符号处理的语义方面开始于视场之外。最后,与不存在表情符号相比,存在表情符号会增加目标词的跳过率,并减少目标词的总注视时间。我们讨论了我们的发现对阅读过程中眼动控制模型的影响。