Carricarte Tony, Xie Siying, Singer Johannes, Trampel Robert, Huber Laurentius, Weiskopf Nikolaus, Cichy Radoslaw M
Department of Education and Psychology, Freie Universität Berlin, 14195 Berlin, Germany.
Einstein Center for Neurosciences Berlin, Charité - Universitätsmedizin Berlin, 10117 Berlin, Germany.
bioRxiv. 2025 May 16:2025.05.13.653501. doi: 10.1101/2025.05.13.653501.
Visual object perception is mediated by information flow between regions of the ventral visual stream along feedforward and feedback anatomical connections. However, feedforward and feedback signals during naturalistic vision are rapid and overlapping, complicating their identification and precise functional specification. Here we recorded human layer-specific fMRI responses to naturalistic object images in early visual cortex (EVC) and lateral occipital complex (LOC) to isolate feedforward and feedback information signals spatially by their cortical layer specific termination pattern. We combined these layer-specific fMRI responses with electroencephalography (EEG) responses for the same images to segregate feedforward and feedback signals in both time and space. Feedforward signals emerge early in the middle layers of EVC and LOC, followed by feedback signals in the superficial layer of both regions, and the deep layer of EVC. Comparing the identified dynamics in LOC to a visual deep neural network (DNN), revealed that early feedforward signals in LOC encode medium complexity features, whereas later feedback signals increase the representational format to high complexity features. Together this specifies the spatiotemporal dynamics and functional role of feedforward and feedback information flow mediating visual object perception.
视觉对象感知是由腹侧视觉流区域之间沿着前馈和反馈解剖连接的信息流介导的。然而,在自然视觉过程中的前馈和反馈信号快速且重叠,这使得它们的识别和精确功能规范变得复杂。在这里,我们记录了人类早期视觉皮层(EVC)和外侧枕叶复合体(LOC)对自然对象图像的层特异性功能磁共振成像反应,以通过其皮层层特异性终止模式在空间上分离前馈和反馈信息信号。我们将这些层特异性功能磁共振成像反应与相同图像的脑电图(EEG)反应相结合,以在时间和空间上分离前馈和反馈信号。前馈信号在EVC和LOC的中间层早期出现,随后在两个区域的表层以及EVC的深层出现反馈信号。将在LOC中识别出的动态与视觉深度神经网络(DNN)进行比较,结果表明LOC中的早期前馈信号编码中等复杂度的特征,而后期的反馈信号将表征形式增加到高复杂度的特征。这共同确定了介导视觉对象感知的前馈和反馈信息流的时空动态和功能作用。