• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

微妙的对抗性图像操纵会影响人类和机器的感知。

Subtle adversarial image manipulations influence both human and machine perception.

机构信息

Google, Mountain View, CA, USA.

Department of Cognitive Science, University of California, San Diego, CA, USA.

出版信息

Nat Commun. 2023 Aug 15;14(1):4933. doi: 10.1038/s41467-023-40499-0.

DOI:10.1038/s41467-023-40499-0
PMID:37582834
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC10427626/
Abstract

Although artificial neural networks (ANNs) were inspired by the brain, ANNs exhibit a brittleness not generally observed in human perception. One shortcoming of ANNs is their susceptibility to adversarial perturbations-subtle modulations of natural images that result in changes to classification decisions, such as confidently mislabelling an image of an elephant, initially classified correctly, as a clock. In contrast, a human observer might well dismiss the perturbations as an innocuous imaging artifact. This phenomenon may point to a fundamental difference between human and machine perception, but it drives one to ask whether human sensitivity to adversarial perturbations might be revealed with appropriate behavioral measures. Here, we find that adversarial perturbations that fool ANNs similarly bias human choice. We further show that the effect is more likely driven by higher-order statistics of natural images to which both humans and ANNs are sensitive, rather than by the detailed architecture of the ANN.

摘要

尽管人工神经网络 (ANNs) 受到大脑的启发,但它们表现出的脆性在人类感知中并不常见。ANNs 的一个缺点是它们容易受到对抗性扰动的影响——这些扰动是对自然图像的细微调制,会导致分类决策发生变化,例如自信地将最初被正确分类为大象的图像错误地标为时钟。相比之下,人类观察者可能会认为这些扰动是无害的成像伪影。这种现象可能表明人类和机器感知之间存在根本差异,但它促使人们思考是否可以通过适当的行为测量来揭示人类对对抗性扰动的敏感性。在这里,我们发现,欺骗 ANN 的对抗性扰动同样会影响人类的选择。我们进一步表明,这种效应更可能是由人类和 ANN 都敏感的自然图像的高阶统计驱动的,而不是由 ANN 的详细结构驱动的。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0383/10427626/b809ce937313/41467_2023_40499_Fig4_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0383/10427626/6ab03a66f521/41467_2023_40499_Fig1_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0383/10427626/3db39180a60b/41467_2023_40499_Fig2_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0383/10427626/9e8dd34758b2/41467_2023_40499_Fig3_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0383/10427626/b809ce937313/41467_2023_40499_Fig4_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0383/10427626/6ab03a66f521/41467_2023_40499_Fig1_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0383/10427626/3db39180a60b/41467_2023_40499_Fig2_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0383/10427626/9e8dd34758b2/41467_2023_40499_Fig3_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0383/10427626/b809ce937313/41467_2023_40499_Fig4_HTML.jpg

相似文献

1
Subtle adversarial image manipulations influence both human and machine perception.微妙的对抗性图像操纵会影响人类和机器的感知。
Nat Commun. 2023 Aug 15;14(1):4933. doi: 10.1038/s41467-023-40499-0.
2
Extreme image transformations affect humans and machines differently.极端的图像变换对人和机器的影响不同。
Biol Cybern. 2023 Oct;117(4-5):331-343. doi: 10.1007/s00422-023-00968-7. Epub 2023 Jun 13.
3
Generative Perturbation Network for Universal Adversarial Attacks on Brain-Computer Interfaces.生成式扰动网络:针对脑机接口的通用对抗攻击
IEEE J Biomed Health Inform. 2023 Nov;27(11):5622-5633. doi: 10.1109/JBHI.2023.3303494. Epub 2023 Nov 7.
4
Estimation with Uncertainty via Conditional Generative Adversarial Networks.基于条件生成对抗网络的不确定性估计。
Sensors (Basel). 2021 Sep 15;21(18):6194. doi: 10.3390/s21186194.
5
Uni-image: Universal image construction for robust neural model.Uni-image:用于稳健神经模型的通用图像构建。
Neural Netw. 2020 Aug;128:279-287. doi: 10.1016/j.neunet.2020.05.018. Epub 2020 May 21.
6
Robust image classification against adversarial attacks using elastic similarity measures between edge count sequences.使用边缘计数序列之间的弹性相似性度量来进行对抗攻击的鲁棒图像分类。
Neural Netw. 2020 Aug;128:61-72. doi: 10.1016/j.neunet.2020.04.030. Epub 2020 Apr 30.
7
Attack to Fool and Explain Deep Networks.攻击与解释深度神经网络
IEEE Trans Pattern Anal Mach Intell. 2022 Oct;44(10):5980-5995. doi: 10.1109/TPAMI.2021.3083769. Epub 2022 Sep 14.
8
Rethinking the performance comparison between SNNS and ANNS.重新思考 SNNS 和 ANNS 的性能比较。
Neural Netw. 2020 Jan;121:294-307. doi: 10.1016/j.neunet.2019.09.005. Epub 2019 Sep 19.
9
Artificial neural network detects human uncertainty.人工神经网络可检测人类的不确定性。
Chaos. 2018 Mar;28(3):033607. doi: 10.1063/1.5002892.
10
Adversarial attack on deep learning-based dermatoscopic image recognition systems: Risk of misdiagnosis due to undetectable image perturbations.深度学习的皮肤病学图像识别系统的对抗攻击:由于不可检测的图像干扰而导致误诊的风险。
Medicine (Baltimore). 2020 Dec 11;99(50):e23568. doi: 10.1097/MD.0000000000023568.

本文引用的文献

1
Selectivity and robustness of sparse coding networks.稀疏编码网络的选择性和鲁棒性。
J Vis. 2020 Nov 2;20(12):10. doi: 10.1167/jov.20.12.10.
2
Performance vs. competence in human-machine comparisons.人机比较中的表现与能力。
Proc Natl Acad Sci U S A. 2020 Oct 27;117(43):26562-26571. doi: 10.1073/pnas.1905334117. Epub 2020 Oct 13.
3
What do adversarial images tell us about human vision?对抗图像能告诉我们人类视觉什么?
Elife. 2020 Sep 2;9:e55978. doi: 10.7554/eLife.55978.
4
Deep Neural Networks for Modeling Visual Perceptual Learning.深度神经网络在视觉感知学习建模中的应用。
J Neurosci. 2018 Jul 4;38(27):6028-6044. doi: 10.1523/JNEUROSCI.1620-17.2018. Epub 2018 May 23.
5
Using goal-driven deep learning models to understand sensory cortex.利用目标驱动的深度学习模型理解感觉皮层。
Nat Neurosci. 2016 Mar;19(3):356-65. doi: 10.1038/nn.4244.
6
Deep neural networks rival the representation of primate IT cortex for core visual object recognition.深度神经网络在核心视觉目标识别方面可与灵长类动物的颞下皮质表征相媲美。
PLoS Comput Biol. 2014 Dec 18;10(12):e1003963. doi: 10.1371/journal.pcbi.1003963. eCollection 2014 Dec.
7
Deep supervised, but not unsupervised, models may explain IT cortical representation.深度监督模型而非无监督模型可能解释IT皮层表征。
PLoS Comput Biol. 2014 Nov 6;10(11):e1003915. doi: 10.1371/journal.pcbi.1003915. eCollection 2014 Nov.
8
Performance-optimized hierarchical models predict neural responses in higher visual cortex.性能优化的层次模型预测高级视觉皮层中的神经反应。
Proc Natl Acad Sci U S A. 2014 Jun 10;111(23):8619-24. doi: 10.1073/pnas.1403112111. Epub 2014 May 8.
9
Conducting behavioral research on Amazon's Mechanical Turk.在亚马逊的 Mechanical Turk 上进行行为研究。
Behav Res Methods. 2012 Mar;44(1):1-23. doi: 10.3758/s13428-011-0124-6.
10
Receptive fields, binocular interaction and functional architecture in the cat's visual cortex.猫视觉皮层中的感受野、双眼相互作用及功能结构
J Physiol. 1962 Jan;160(1):106-54. doi: 10.1113/jphysiol.1962.sp006837.