Subramanian Ramanathan, Shankar Divya, Sebe Nicu, Melcher David
Advanced Digital Sciences Center (ADSC), University of Illinois at Urbana-Champaign, Singapore.
J Vis. 2014 Mar 26;14(3):31. doi: 10.1167/14.3.31.
A basic question in vision research regards where people look in complex scenes and how this influences their performance in various tasks. Previous studies with static images have demonstrated a close link between where people look and what they remember. Here, we examined the pattern of eye movements when participants watched neutral and emotional clips from Hollywood-style movies. Participants answered multiple-choice memory questions concerning visual and auditory scene details immediately upon viewing 1-min-long neutral or emotional movie clips. Fixations were more narrowly focused for emotional clips, and immediate memory for object details was worse compared to matched neutral scenes, implying preferential attention to emotional events. Although we found the expected correlation between where people looked and what they remembered for neutral clips, this relationship broke down for emotional clips. When participants were subsequently presented with key frames (static images) extracted from the movie clips such that presentation duration of the target objects (TOs) corresponding to the multiple-choice questions was matched and the earlier questions were repeated, more fixations were observed on the TOs, and memory performance also improved significantly, confirming that emotion modulates the relationship between gaze position and memory performance. Finally, in a long-term memory test, old/new recognition performance was significantly better for emotional scenes as compared to neutral scenes. Overall, these results are consistent with the hypothesis that emotional content draws eye fixations and strengthens memory for the scene gist while weakening encoding of peripheral scene details.
视觉研究中的一个基本问题是,人们在复杂场景中看向何处,以及这如何影响他们在各种任务中的表现。先前对静态图像的研究表明,人们的注视位置与他们的记忆之间存在紧密联系。在此,我们研究了参与者观看好莱坞风格电影中的中性和情感片段时的眼动模式。参与者在观看1分钟长的中性或情感电影片段后,立即回答有关视觉和听觉场景细节的多项选择题。对于情感片段,注视点更为集中,与匹配的中性场景相比,对物体细节的即时记忆更差,这意味着对情感事件的优先关注。虽然我们发现人们的注视位置与他们对中性片段的记忆之间存在预期的相关性,但这种关系在情感片段中却不成立。当随后向参与者展示从电影片段中提取的关键帧(静态图像),使与多项选择题对应的目标物体(TOs)的呈现持续时间相匹配,并重复之前的问题时,在TOs上观察到更多的注视,记忆表现也显著提高,这证实了情感会调节注视位置与记忆表现之间的关系。最后,在一项长期记忆测试中,与中性场景相比,情感场景的旧/新识别表现明显更好。总体而言,这些结果与以下假设一致:情感内容吸引眼球注视,增强对场景主旨的记忆,同时削弱对周边场景细节的编码。