Department of Biomedical Engineering, The City College of New York, New York, NY, USA.
Departments of Psychiatry and Neurology, Columbia University College of Physicians and Surgeons, New York, NY, USA.
Nat Commun. 2023 May 22;14(1):2910. doi: 10.1038/s41467-023-38576-5.
Our continuous visual experience in daily life is dominated by change. Previous research has focused on visual change due to stimulus motion, eye movements or unfolding events, but not their combined impact across the brain, or their interactions with semantic novelty. We investigate the neural responses to these sources of novelty during film viewing. We analyzed intracranial recordings in humans across 6328 electrodes from 23 individuals. Responses associated with saccades and film cuts were dominant across the entire brain. Film cuts at semantic event boundaries were particularly effective in the temporal and medial temporal lobe. Saccades to visual targets with high visual novelty were also associated with strong neural responses. Specific locations in higher-order association areas showed selectivity to either high or low-novelty saccades. We conclude that neural activity associated with film cuts and eye movements is widespread across the brain and is modulated by semantic novelty.
在日常生活中，我们的连续视觉体验主要由变化主导。之前的研究主要集中在由于刺激运动、眼球运动或展开事件引起的视觉变化，但没有研究它们在大脑中的综合影响，也没有研究它们与语义新颖性的相互作用。我们在观看电影时研究了这些新颖来源的神经反应。我们分析了来自 23 个人的 6328 个电极的颅内记录。在整个大脑中，与扫视和电影剪辑相关的反应占主导地位。在语义事件边界处的电影剪辑在颞叶和内侧颞叶中尤为有效。对具有高视觉新颖性的视觉目标的扫视也与强烈的神经反应相关。在高级联想区域的特定位置显示出对高或低新颖性扫视的选择性。我们得出结论，与电影剪辑和眼球运动相关的神经活动在整个大脑中广泛存在，并受语义新颖性的调节。
