Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck Society, 60528 Frankfurt, Germany; Donders Centre for Neuroscience, Department of Neuroinformatics, Radboud University Nijmegen, 6525 AJ Nijmegen, the Netherlands.
Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck Society, 60528 Frankfurt, Germany.
Neuron. 2022 Apr 6;110(7):1240-1257.e8. doi: 10.1016/j.neuron.2022.01.002. Epub 2022 Feb 3.
Predictive coding is an important candidate theory of self-supervised learning in the brain. Its central idea is that sensory responses result from comparisons between bottom-up inputs and contextual predictions, a process in which rates and synchronization may play distinct roles. We recorded from awake macaque V1 and developed a technique to quantify stimulus predictability for natural images based on self-supervised, generative neural networks. We find that neuronal firing rates were mainly modulated by the contextual predictability of higher-order image features, which correlated strongly with human perceptual similarity judgments. By contrast, V1 gamma (γ)-synchronization increased monotonically with the contextual predictability of low-level image features and emerged exclusively for larger stimuli. Consequently, γ-synchronization was induced by natural images that are highly compressible and low-dimensional. Natural stimuli with low predictability induced prominent, late-onset beta (β)-synchronization, likely reflecting cortical feedback. Our findings reveal distinct roles of synchronization and firing rates in the predictive coding of natural images.
预测编码是大脑中自我监督学习的一个重要候选理论。其核心思想是,感觉反应是由自上而下的输入与上下文预测之间的比较产生的,在这个过程中,速率和同步可能起着不同的作用。我们在清醒的猕猴 V1 中进行了记录,并开发了一种基于自我监督、生成性神经网络的技术来量化自然图像的刺激可预测性。我们发现,神经元的发放率主要受到高阶图像特征的上下文可预测性的调制,这种调制与人类感知相似性判断有很强的相关性。相比之下,V1 的γ-同步随低水平图像特征的上下文可预测性单调增加,并且只出现在较大的刺激中。因此,γ-同步是由高度可压缩和低维的自然图像诱导产生的。低可预测性的自然刺激会诱导出显著的、迟发性β-同步,可能反映了皮层反馈。我们的发现揭示了同步和发放率在自然图像预测编码中的不同作用。