• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

神经网络中的 Skye 斜栅产生的类脑错觉。

Brain-like illusion produced by Skye's Oblique Grating in deep neural networks.

机构信息

Graduate School of Engineering, Kochi University of Technology, Kami, Kochi, Japan.

School of Information, Kochi University of Technology, Kami, Kochi, Japan.

出版信息

PLoS One. 2024 Feb 23;19(2):e0299083. doi: 10.1371/journal.pone.0299083. eCollection 2024.

DOI:10.1371/journal.pone.0299083
PMID:38394261
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC10889903/
Abstract

The analogy between the brain and deep neural networks (DNNs) has sparked interest in neuroscience. Although DNNs have limitations, they remain valuable for modeling specific brain characteristics. This study used Skye's Oblique Grating illusion to assess DNNs' relevance to brain neural networks. We collected data on human perceptual responses to a series of visual illusions. This data was then used to assess how DNN responses to these illusions paralleled or differed from human behavior. We performed two analyses:(1) We trained DNNs to perform horizontal vs. non-horizontal classification on images with bars tilted different degrees (non-illusory images) and tested them on images with horizontal bars with different illusory strengths measured by human behavior (illusory images), finding that DNNs showed human-like illusions; (2) We performed representational similarity analysis to assess whether illusory representation existed in different layers within DNNs, finding that DNNs showed illusion-like responses to illusory images. The representational similarity between real tilted images and illusory images was calculated, which showed the highest values in the early layers and decreased layer-by-layer. Our findings suggest that DNNs could serve as potential models for explaining the mechanism of visual illusions in human brain, particularly those that may originate in early visual areas like the primary visual cortex (V1). While promising, further research is necessary to understand the nuanced differences between DNNs and human visual pathways.

摘要

大脑和深度神经网络(DNN)之间的类比引起了神经科学的兴趣。尽管 DNN 存在局限性,但它们对于模拟特定的大脑特征仍然具有价值。本研究使用 Skye 的斜栅错觉来评估 DNN 与大脑神经网络的相关性。我们收集了人类对一系列视觉错觉的感知反应数据。然后,我们使用这些数据来评估 DNN 对这些错觉的反应与人类行为的相似程度或差异程度。我们进行了两项分析:(1)我们训练 DNN 对具有不同倾斜角度的条形的图像进行水平与非水平分类(非错觉图像),并在具有不同错觉强度的水平条形图像上对其进行测试(错觉图像),发现 DNN 表现出类人错觉;(2)我们进行了表示相似性分析,以评估 DNN 内部不同层中是否存在错觉表示,发现 DNN 对错觉图像表现出类似错觉的反应。计算了真实倾斜图像和错觉图像之间的表示相似性,结果表明在早期层中值最高,并且逐层降低。我们的研究结果表明,DNN 可以作为解释人类大脑中视觉错觉机制的潜在模型,特别是那些可能起源于初级视觉皮层(V1)等早期视觉区域的模型。尽管前景广阔,但仍需要进一步研究以了解 DNN 和人类视觉通路之间的细微差异。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/be3c/10889903/824c61398f6b/pone.0299083.g014.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/be3c/10889903/5e62e59c08e1/pone.0299083.g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/be3c/10889903/01f52b86995f/pone.0299083.g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/be3c/10889903/11db7bb8949a/pone.0299083.g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/be3c/10889903/964c5753b882/pone.0299083.g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/be3c/10889903/a5560dbcdf83/pone.0299083.g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/be3c/10889903/a602e86db293/pone.0299083.g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/be3c/10889903/9d74dd3af7d8/pone.0299083.g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/be3c/10889903/16e8fe326576/pone.0299083.g008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/be3c/10889903/1176d96387c6/pone.0299083.g009.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/be3c/10889903/4db842b9ea76/pone.0299083.g010.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/be3c/10889903/52ba6e54c080/pone.0299083.g011.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/be3c/10889903/9df9f7e87de0/pone.0299083.g012.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/be3c/10889903/5b2a0873b534/pone.0299083.g013.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/be3c/10889903/824c61398f6b/pone.0299083.g014.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/be3c/10889903/5e62e59c08e1/pone.0299083.g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/be3c/10889903/01f52b86995f/pone.0299083.g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/be3c/10889903/11db7bb8949a/pone.0299083.g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/be3c/10889903/964c5753b882/pone.0299083.g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/be3c/10889903/a5560dbcdf83/pone.0299083.g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/be3c/10889903/a602e86db293/pone.0299083.g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/be3c/10889903/9d74dd3af7d8/pone.0299083.g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/be3c/10889903/16e8fe326576/pone.0299083.g008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/be3c/10889903/1176d96387c6/pone.0299083.g009.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/be3c/10889903/4db842b9ea76/pone.0299083.g010.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/be3c/10889903/52ba6e54c080/pone.0299083.g011.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/be3c/10889903/9df9f7e87de0/pone.0299083.g012.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/be3c/10889903/5b2a0873b534/pone.0299083.g013.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/be3c/10889903/824c61398f6b/pone.0299083.g014.jpg

相似文献

1
Brain-like illusion produced by Skye's Oblique Grating in deep neural networks.神经网络中的 Skye 斜栅产生的类脑错觉。
PLoS One. 2024 Feb 23;19(2):e0299083. doi: 10.1371/journal.pone.0299083. eCollection 2024.
2
Deep Convolutional Neural Networks Outperform Feature-Based But Not Categorical Models in Explaining Object Similarity Judgments.在解释物体相似性判断方面,深度卷积神经网络的表现优于基于特征的模型,但不优于分类模型。
Front Psychol. 2017 Oct 9;8:1726. doi: 10.3389/fpsyg.2017.01726. eCollection 2017.
3
Representation of illusory and physical rotations in human MST: A cortical site for the pinna illusion.人类中颞叶沟回(MST)中虚幻旋转与实际旋转的表征:耳廓错觉的一个皮质位点。
Hum Brain Mapp. 2016 Jun;37(6):2097-113. doi: 10.1002/hbm.23156. Epub 2016 Mar 4.
4
Reconstructing visual illusory experiences from human brain activity.从人类大脑活动中重建视觉幻觉体验。
Sci Adv. 2023 Nov 17;9(46):eadj3906. doi: 10.1126/sciadv.adj3906. Epub 2023 Nov 15.
5
ImageNet-trained deep neural networks exhibit illusion-like response to the Scintillating grid.基于 ImageNet 训练的深度神经网络对闪烁网格表现出类似幻觉的反应。
J Vis. 2021 Oct 5;21(11):15. doi: 10.1167/jov.21.11.15.
6
Going with the Flow: The Neural Mechanisms Underlying Illusions of Complex-Flow Motion.随波逐流:复杂流动运动错觉的神经机制。
J Neurosci. 2019 Apr 3;39(14):2664-2685. doi: 10.1523/JNEUROSCI.2112-18.2019. Epub 2019 Feb 18.
7
Deep Neural Networks and Visuo-Semantic Models Explain Complementary Components of Human Ventral-Stream Representational Dynamics.深度神经网络和视语义模型解释了人类腹侧流表象动态的互补组成部分。
J Neurosci. 2023 Mar 8;43(10):1731-1741. doi: 10.1523/JNEUROSCI.1424-22.2022. Epub 2023 Feb 9.
8
The Poggendorff illusion driven by real and illusory contour: Behavioral and neural mechanisms.由真实轮廓和虚幻轮廓驱动的波根多夫错觉:行为和神经机制。
Neuropsychologia. 2016 May;85:24-34. doi: 10.1016/j.neuropsychologia.2016.03.005. Epub 2016 Mar 5.
9
Directional harmonic theory: a computational Gestalt model to account for illusory contour and vertex formation.定向谐波理论:一种用于解释错觉轮廓和顶点形成的计算格式塔模型。
Perception. 2003;32(4):423-48. doi: 10.1068/p5011.
10
Brain hierarchy score: Which deep neural networks are hierarchically brain-like?脑层级分数:哪些深度神经网络在层级上类似大脑?
iScience. 2021 Aug 21;24(9):103013. doi: 10.1016/j.isci.2021.103013. eCollection 2021 Sep 24.

本文引用的文献

1
Are Deep Neural Networks Adequate Behavioral Models of Human Visual Perception?深度神经网络是否足以作为人类视觉感知的行为模型?
Annu Rev Vis Sci. 2023 Sep 15;9:501-524. doi: 10.1146/annurev-vision-120522-031739. Epub 2023 Mar 31.
2
Deep problems with neural network models of human vision.人类视觉神经网络模型的深层问题。
Behav Brain Sci. 2022 Dec 1;46:e385. doi: 10.1017/S0140525X22002813.
3
The human primary visual cortex (V1) encodes the perceived position of static but not moving objects.人类初级视觉皮层(V1)编码感知到的静态物体的位置,但不能编码移动的物体。
Commun Biol. 2022 Mar 1;5(1):181. doi: 10.1038/s42003-022-03136-y.
4
ImageNet-trained deep neural networks exhibit illusion-like response to the Scintillating grid.基于 ImageNet 训练的深度神经网络对闪烁网格表现出类似幻觉的反应。
J Vis. 2021 Oct 5;21(11):15. doi: 10.1167/jov.21.11.15.
5
Brain hierarchy score: Which deep neural networks are hierarchically brain-like?脑层级分数:哪些深度神经网络在层级上类似大脑?
iScience. 2021 Aug 21;24(9):103013. doi: 10.1016/j.isci.2021.103013. eCollection 2021 Sep 24.
6
Qualitative similarities and differences in visual object representations between brains and deep networks.大脑和深度网络中视觉目标表示的定性相似性和差异性。
Nat Commun. 2021 Mar 25;12(1):1872. doi: 10.1038/s41467-021-22078-3.
7
Individual differences among deep neural network models.深度神经网络模型的个体差异。
Nat Commun. 2020 Nov 12;11(1):5725. doi: 10.1038/s41467-020-19632-w.
8
Integrative Benchmarking to Advance Neurally Mechanistic Models of Human Intelligence.综合基准测试以推进人类智能的神经机制模型。
Neuron. 2020 Nov 11;108(3):413-423. doi: 10.1016/j.neuron.2020.07.040. Epub 2020 Sep 11.
9
Decoding and mapping task states of the human brain via deep learning.通过深度学习对人类大脑的解码和任务状态进行映射。
Hum Brain Mapp. 2020 Apr 15;41(6):1505-1519. doi: 10.1002/hbm.24891. Epub 2019 Dec 9.
10
Deep learning-Using machine learning to study biological vision.深度学习——利用机器学习研究生物视觉。
J Vis. 2018 Dec 3;18(13):2. doi: 10.1167/18.13.2.