• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

稀疏编码模型在学习自然图像的稀疏编码时可能会表现出稀疏性降低的现象。

Sparse coding models can exhibit decreasing sparseness while learning sparse codes for natural images.

机构信息

Department of Physics, University of California, Berkeley, Berkeley, California, United States of America.

出版信息

PLoS Comput Biol. 2013;9(8):e1003182. doi: 10.1371/journal.pcbi.1003182. Epub 2013 Aug 29.

DOI:10.1371/journal.pcbi.1003182
PMID:24009489
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC3757070/
Abstract

The sparse coding hypothesis has enjoyed much success in predicting response properties of simple cells in primary visual cortex (V1) based solely on the statistics of natural scenes. In typical sparse coding models, model neuron activities and receptive fields are optimized to accurately represent input stimuli using the least amount of neural activity. As these networks develop to represent a given class of stimulus, the receptive fields are refined so that they capture the most important stimulus features. Intuitively, this is expected to result in sparser network activity over time. Recent experiments, however, show that stimulus-evoked activity in ferret V1 becomes less sparse during development, presenting an apparent challenge to the sparse coding hypothesis. Here we demonstrate that some sparse coding models, such as those employing homeostatic mechanisms on neural firing rates, can exhibit decreasing sparseness during learning, while still achieving good agreement with mature V1 receptive field shapes and a reasonably sparse mature network state. We conclude that observed developmental trends do not rule out sparseness as a principle of neural coding per se: a mature network can perform sparse coding even if sparseness decreases somewhat during development. To make comparisons between model and physiological receptive fields, we introduce a new nonparametric method for comparing receptive field shapes using image registration techniques.

摘要

稀疏编码假说在基于自然场景的统计数据预测初级视觉皮层 (V1) 中简单细胞的反应特性方面取得了很大的成功。在典型的稀疏编码模型中,模型神经元的活动和感受野被优化为使用最少的神经活动来准确表示输入刺激。随着这些网络的发展来表示给定类别的刺激,感受野得到了改进,从而捕获最重要的刺激特征。直观地说,这预计会导致网络活动随时间变得更加稀疏。然而,最近的实验表明,雪貂 V1 中由刺激引起的活动在发育过程中变得不那么稀疏,这对稀疏编码假说提出了明显的挑战。在这里,我们证明了一些稀疏编码模型,例如那些对神经元发射率使用同型机制的模型,在学习过程中可以表现出稀疏性的降低,同时仍然与成熟 V1 感受野形状和相当稀疏的成熟网络状态很好地吻合。我们的结论是,观察到的发展趋势本身并不排除稀疏性作为神经编码的原则:即使在发育过程中稀疏性略有降低,成熟的网络也可以进行稀疏编码。为了在模型和生理感受野之间进行比较,我们引入了一种新的非参数方法,使用图像配准技术比较感受野形状。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1e48/3757070/4825888fe678/pcbi.1003182.g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1e48/3757070/a12a951a1dc2/pcbi.1003182.g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1e48/3757070/8b9ae745fe6f/pcbi.1003182.g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1e48/3757070/4e2b42abcfb5/pcbi.1003182.g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1e48/3757070/d5dcddb9a0a0/pcbi.1003182.g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1e48/3757070/4467c28bf91c/pcbi.1003182.g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1e48/3757070/4825888fe678/pcbi.1003182.g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1e48/3757070/a12a951a1dc2/pcbi.1003182.g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1e48/3757070/8b9ae745fe6f/pcbi.1003182.g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1e48/3757070/4e2b42abcfb5/pcbi.1003182.g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1e48/3757070/d5dcddb9a0a0/pcbi.1003182.g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1e48/3757070/4467c28bf91c/pcbi.1003182.g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1e48/3757070/4825888fe678/pcbi.1003182.g006.jpg

相似文献

1
Sparse coding models can exhibit decreasing sparseness while learning sparse codes for natural images.稀疏编码模型在学习自然图像的稀疏编码时可能会表现出稀疏性降低的现象。
PLoS Comput Biol. 2013;9(8):e1003182. doi: 10.1371/journal.pcbi.1003182. Epub 2013 Aug 29.
2
Natural image sequences constrain dynamic receptive fields and imply a sparse code.自然图像序列限制动态感受野并暗示稀疏编码。
Brain Res. 2013 Nov 6;1536:53-67. doi: 10.1016/j.brainres.2013.07.056. Epub 2013 Aug 8.
3
Replicating receptive fields of simple and complex cells in primary visual cortex in a neuronal network model with temporal and population sparseness and reliability.在具有时间和群体稀疏性和可靠性的初级视觉皮层神经元网络模型中复制简单和复杂细胞的感受野。
Neural Comput. 2012 Oct;24(10):2700-25. doi: 10.1162/NECO_a_00341. Epub 2012 Jul 30.
4
A sparse coding model with synaptically local plasticity and spiking neurons can account for the diverse shapes of V1 simple cell receptive fields.一种具有突触局部可塑性和放电神经元的稀疏编码模型可以解释 V1 简单细胞感受野的各种形状。
PLoS Comput Biol. 2011 Oct;7(10):e1002250. doi: 10.1371/journal.pcbi.1002250. Epub 2011 Oct 27.
5
Visual nonclassical receptive field effects emerge from sparse coding in a dynamical system.视觉非经典感受野效应源于动态系统中的稀疏编码。
PLoS Comput Biol. 2013;9(8):e1003191. doi: 10.1371/journal.pcbi.1003191. Epub 2013 Aug 29.
6
A network that uses few active neurones to code visual input predicts the diverse shapes of cortical receptive fields.一个使用少量活跃神经元对视觉输入进行编码的网络能够预测皮质感受野的多种形状。
J Comput Neurosci. 2007 Apr;22(2):135-46. doi: 10.1007/s10827-006-0003-9.
7
Inhibitory interneurons decorrelate excitatory cells to drive sparse code formation in a spiking model of V1.在 V1 的尖峰模型中,抑制性中间神经元去相关兴奋性细胞,以驱动稀疏编码的形成。
J Neurosci. 2013 Mar 27;33(13):5475-85. doi: 10.1523/JNEUROSCI.4188-12.2013.
8
Sparse coding can predict primary visual cortex receptive field changes induced by abnormal visual input.稀疏编码可以预测异常视觉输入引起的初级视觉皮层感受野的变化。
PLoS Comput Biol. 2013;9(5):e1003005. doi: 10.1371/journal.pcbi.1003005. Epub 2013 May 9.
9
Sparse coding and decorrelation in primary visual cortex during natural vision.自然视觉过程中初级视觉皮层的稀疏编码与去相关
Science. 2000 Feb 18;287(5456):1273-6. doi: 10.1126/science.287.5456.1273.
10
Sparse coding in striate and extrastriate visual cortex.纹状和皮层外视皮质中的稀疏编码。
J Neurophysiol. 2011 Jun;105(6):2907-19. doi: 10.1152/jn.00594.2010. Epub 2011 Apr 6.

引用本文的文献

1
Sensory coding and contrast invariance emerge from the control of plastic inhibition over emergent selectivity.感觉编码和对比不变性源于对涌现选择性的可塑性抑制的控制。
PLoS Comput Biol. 2021 Nov 29;17(11):e1009566. doi: 10.1371/journal.pcbi.1009566. eCollection 2021 Nov.
2
Adaptation of spontaneous activity in the developing visual cortex.发育中的视觉皮层中自发性活动的适应。
Elife. 2021 Mar 16;10:e61619. doi: 10.7554/eLife.61619.
3
Dysregulation of excitatory neural firing replicates physiological and functional changes in aging visual cortex.

本文引用的文献

1
Inhibitory interneurons decorrelate excitatory cells to drive sparse code formation in a spiking model of V1.在 V1 的尖峰模型中,抑制性中间神经元去相关兴奋性细胞,以驱动稀疏编码的形成。
J Neurosci. 2013 Mar 27;33(13):5475-85. doi: 10.1523/JNEUROSCI.4188-12.2013.
2
Sparse codes for speech predict spectrotemporal receptive fields in the inferior colliculus.稀疏编码预测下丘脑中的语音频谱时间感受野。
PLoS Comput Biol. 2012;8(7):e1002594. doi: 10.1371/journal.pcbi.1002594. Epub 2012 Jul 12.
3
A sparse coding model with synaptically local plasticity and spiking neurons can account for the diverse shapes of V1 simple cell receptive fields.
兴奋性神经放电失调复制了衰老视觉皮层的生理和功能变化。
PLoS Comput Biol. 2021 Jan 26;17(1):e1008620. doi: 10.1371/journal.pcbi.1008620. eCollection 2021 Jan.
4
On the Sparse Structure of Natural Sounds and Natural Images: Similarities, Differences, and Implications for Neural Coding.论自然声音与自然图像的稀疏结构:相似性、差异及其对神经编码的启示
Front Comput Neurosci. 2019 Jun 26;13:39. doi: 10.3389/fncom.2019.00039. eCollection 2019.
5
Using deep learning to probe the neural code for images in primary visual cortex.利用深度学习探究初级视觉皮层中图像的神经编码。
J Vis. 2019 Apr 1;19(4):29. doi: 10.1167/19.4.29.
6
Speed-Selectivity in Retinal Ganglion Cells is Sharpened by Broad Spatial Frequency, Naturalistic Stimuli.视网膜神经节细胞的速度选择性通过宽空间频率、自然刺激得到增强。
Sci Rep. 2019 Jan 24;9(1):456. doi: 10.1038/s41598-018-36861-8.
7
Cumulative inhibition in neural networks.神经网络中的累积抑制
Cogn Process. 2019 Feb;20(1):87-102. doi: 10.1007/s10339-018-0888-z. Epub 2018 Nov 3.
8
Beauty is in the efficient coding of the beholder.美存在于观察者高效的编码中。
R Soc Open Sci. 2016 Mar 2;3(3):160027. doi: 10.1098/rsos.160027. eCollection 2016 Mar.
9
Diversity priors for learning early visual features.用于学习早期视觉特征的多样性先验。
Front Comput Neurosci. 2015 Aug 12;9:104. doi: 10.3389/fncom.2015.00104. eCollection 2015.
10
Network Anisotropy Trumps Noise for Efficient Object Coding in Macaque Inferior Temporal Cortex.在猕猴颞下皮质中,网络各向异性在有效物体编码方面胜过噪声。
J Neurosci. 2015 Jul 8;35(27):9889-99. doi: 10.1523/JNEUROSCI.4595-14.2015.
一种具有突触局部可塑性和放电神经元的稀疏编码模型可以解释 V1 简单细胞感受野的各种形状。
PLoS Comput Biol. 2011 Oct;7(10):e1002250. doi: 10.1371/journal.pcbi.1002250. Epub 2011 Oct 27.
4
Too many cooks? Intrinsic and synaptic homeostatic mechanisms in cortical circuit refinement.太多厨子?皮层回路精炼中的固有和突触动态平衡机制。
Annu Rev Neurosci. 2011;34:89-103. doi: 10.1146/annurev-neuro-060909-153238.
5
Spontaneous cortical activity reveals hallmarks of an optimal internal model of the environment.自发性皮层活动揭示了环境最佳内部模型的特征。
Science. 2011 Jan 7;331(6013):83-7. doi: 10.1126/science.1195870.
6
Role of homeostasis in learning sparse representations.内稳态在学习稀疏表示中的作用。
Neural Comput. 2010 Jul;22(7):1812-36. doi: 10.1162/neco.2010.05-08-795.
7
Synaptic and network mechanisms of sparse and reliable visual cortical activity during nonclassical receptive field stimulation.非经典感受野刺激时视觉皮层稀疏且可靠活动的突触和网络机制。
Neuron. 2010 Jan 14;65(1):107-21. doi: 10.1016/j.neuron.2009.12.005.
8
Sparsification of neuronal activity in the visual cortex at eye-opening.睁眼时视觉皮层神经元活动的稀疏化
Proc Natl Acad Sci U S A. 2009 Sep 1;106(35):15049-54. doi: 10.1073/pnas.0907660106. Epub 2009 Aug 14.
9
The sparseness of neuronal responses in ferret primary visual cortex.雪貂初级视觉皮层中神经元反应的稀疏性。
J Neurosci. 2009 Feb 25;29(8):2355-70. doi: 10.1523/JNEUROSCI.3869-08.2009.
10
Sparse representation of sounds in the unanesthetized auditory cortex.未麻醉听觉皮层中声音的稀疏表示
PLoS Biol. 2008 Jan;6(1):e16. doi: 10.1371/journal.pbio.0060016.