• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

交织洞察:用于细粒度视觉识别的高阶特征交互

Interweaving Insights: High-Order Feature Interaction for Fine-Grained Visual Recognition.

作者信息

Sikdar Arindam, Liu Yonghuai, Kedarisetty Siddhardha, Zhao Yitian, Ahmed Amr, Behera Ardhendu

机构信息

Department of Computer Science, Edge Hill University, Ormskirk, UK.

Department of Aerospace Engineering, Technion-Israel Institute of Technology, Haifa, Israel.

出版信息

Int J Comput Vis. 2025;133(4):1755-1779. doi: 10.1007/s11263-024-02260-y. Epub 2024 Oct 20.

DOI:10.1007/s11263-024-02260-y
PMID:40160952
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC11953118/
Abstract

This paper presents a novel approach for Fine-Grained Visual Classification (FGVC) by exploring Graph Neural Networks (GNNs) to facilitate high-order feature interactions, with a specific focus on constructing both inter- and intra-region graphs. Unlike previous FGVC techniques that often isolate global and local features, our method combines both features seamlessly during learning via graphs. Inter-region graphs capture long-range dependencies to recognize global patterns, while intra-region graphs delve into finer details within specific regions of an object by exploring high-dimensional convolutional features. A key innovation is the use of shared GNNs with an attention mechanism coupled with the Approximate Personalized Propagation of Neural Predictions (APPNP) message-passing algorithm, enhancing information propagation efficiency for better discriminability and simplifying the model architecture for computational efficiency. Additionally, the introduction of residual connections improves performance and training stability. Comprehensive experiments showcase state-of-the-art results on benchmark FGVC datasets, affirming the efficacy of our approach. This work underscores the potential of GNN in modeling high-level feature interactions, distinguishing it from previous FGVC methods that typically focus on singular aspects of feature representation. Our source code is available at https://github.com/Arindam-1991/I2-HOFI.

摘要

本文提出了一种用于细粒度视觉分类(FGVC)的新方法,通过探索图神经网络(GNN)来促进高阶特征交互,特别关注构建区域间和区域内的图。与以往常常孤立全局和局部特征的FGVC技术不同,我们的方法在学习过程中通过图无缝地结合了这两种特征。区域间的图捕获远程依赖关系以识别全局模式,而区域内的图则通过探索高维卷积特征来深入研究对象特定区域内的更精细细节。一个关键创新是使用带有注意力机制的共享GNN,并结合神经预测的近似个性化传播(APPNP)消息传递算法,提高信息传播效率以获得更好的可辨别性,并简化模型架构以提高计算效率。此外,引入残差连接提高了性能和训练稳定性。全面的实验在基准FGVC数据集上展示了领先的结果,证实了我们方法的有效性。这项工作强调了GNN在建模高级特征交互方面的潜力,使其有别于以往通常专注于特征表示单一方面的FGVC方法。我们的源代码可在https://github.com/Arindam-1991/I2-HOFI获取。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/dc55/11953118/200b0a56ddc3/11263_2024_2260_Fig9_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/dc55/11953118/dab23248937c/11263_2024_2260_Fig1_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/dc55/11953118/09bcc646f895/11263_2024_2260_Fig2_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/dc55/11953118/5605e8c4348f/11263_2024_2260_Fig3_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/dc55/11953118/d95e968f2c76/11263_2024_2260_Fig4_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/dc55/11953118/54e1380f6ad2/11263_2024_2260_Fig5_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/dc55/11953118/986fefb4e13a/11263_2024_2260_Fig6_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/dc55/11953118/04c8b95f8e7e/11263_2024_2260_Fig7_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/dc55/11953118/bf3e1a042536/11263_2024_2260_Fig8_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/dc55/11953118/200b0a56ddc3/11263_2024_2260_Fig9_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/dc55/11953118/dab23248937c/11263_2024_2260_Fig1_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/dc55/11953118/09bcc646f895/11263_2024_2260_Fig2_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/dc55/11953118/5605e8c4348f/11263_2024_2260_Fig3_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/dc55/11953118/d95e968f2c76/11263_2024_2260_Fig4_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/dc55/11953118/54e1380f6ad2/11263_2024_2260_Fig5_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/dc55/11953118/986fefb4e13a/11263_2024_2260_Fig6_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/dc55/11953118/04c8b95f8e7e/11263_2024_2260_Fig7_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/dc55/11953118/bf3e1a042536/11263_2024_2260_Fig8_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/dc55/11953118/200b0a56ddc3/11263_2024_2260_Fig9_HTML.jpg

相似文献

1
Interweaving Insights: High-Order Feature Interaction for Fine-Grained Visual Recognition.交织洞察:用于细粒度视觉识别的高阶特征交互
Int J Comput Vis. 2025;133(4):1755-1779. doi: 10.1007/s11263-024-02260-y. Epub 2024 Oct 20.
2
SR-GNN: Spatial Relation-aware Graph Neural Network for Fine-Grained Image Categorization.SR-GNN:用于细粒度图像分类的空间关系感知图神经网络
IEEE Trans Image Process. 2022 Sep 14;PP. doi: 10.1109/TIP.2022.3205215.
3
Augmented Graph Neural Network with hierarchical global-based residual connections.基于层次全局残差连接的增强图神经网络。
Neural Netw. 2022 Jun;150:149-166. doi: 10.1016/j.neunet.2022.03.008. Epub 2022 Mar 10.
4
Significant feature suppression and cross-feature fusion networks for fine-grained visual classification.用于细粒度视觉分类的显著特征抑制与跨特征融合网络
Sci Rep. 2024 Oct 14;14(1):24051. doi: 10.1038/s41598-024-74654-4.
5
AP-CNN: Weakly Supervised Attention Pyramid Convolutional Neural Network for Fine-Grained Visual Classification.AP-CNN:用于细粒度视觉分类的弱监督注意力金字塔卷积神经网络。
IEEE Trans Image Process. 2021;30:2826-2836. doi: 10.1109/TIP.2021.3055617. Epub 2021 Feb 12.
6
SIM-OFE: Structure Information Mining and Object-Aware Feature Enhancement for Fine-Grained Visual Categorization.SIM-OFE:用于细粒度视觉分类的结构信息挖掘与目标感知特征增强
IEEE Trans Image Process. 2024;33:5312-5326. doi: 10.1109/TIP.2024.3459788. Epub 2024 Sep 27.
7
Comprehensive Graph Gradual Pruning for Sparse Training in Graph Neural Networks.用于图神经网络稀疏训练的综合图渐进式剪枝
IEEE Trans Neural Netw Learn Syst. 2024 Oct;35(10):14903-14917. doi: 10.1109/TNNLS.2023.3282049. Epub 2024 Oct 7.
8
Intra-graph and Inter-graph joint information propagation network with third-order text graph tensor for fake news detection.基于三阶文本图张量的图内与图间联合信息传播网络用于假新闻检测
Appl Intell (Dordr). 2023 Feb 15:1-18. doi: 10.1007/s10489-023-04455-1.
9
GTC: GNN-Transformer co-contrastive learning for self-supervised heterogeneous graph representation.GTC:用于自监督异构图表示的GNN-Transformer协同对比学习
Neural Netw. 2025 Jan;181:106645. doi: 10.1016/j.neunet.2024.106645. Epub 2024 Aug 16.
10
SkyMap: a generative graph model for GNN benchmarking.SkyMap:用于图神经网络基准测试的生成式图模型。
Front Artif Intell. 2024 Nov 14;7:1427534. doi: 10.3389/frai.2024.1427534. eCollection 2024.

本文引用的文献

1
Feature relocation network for fine-grained image classification.用于细粒度图像分类的特征重定位网络。
Neural Netw. 2023 Apr;161:306-317. doi: 10.1016/j.neunet.2023.01.050. Epub 2023 Feb 4.
2
SR-GNN: Spatial Relation-aware Graph Neural Network for Fine-Grained Image Categorization.SR-GNN:用于细粒度图像分类的空间关系感知图神经网络
IEEE Trans Image Process. 2022 Sep 14;PP. doi: 10.1109/TIP.2022.3205215.
3
On the Eigenvalues of Global Covariance Pooling for Fine-Grained Visual Recognition.用于细粒度视觉识别的全局协方差池化的特征值研究
IEEE Trans Pattern Anal Mach Intell. 2023 Mar;45(3):3554-3566. doi: 10.1109/TPAMI.2022.3178802. Epub 2023 Feb 3.
4
Cross-Part Learning for Fine-Grained Image Classification.用于细粒度图像分类的跨部分学习
IEEE Trans Image Process. 2022;31:748-758. doi: 10.1109/TIP.2021.3135477. Epub 2021 Dec 28.
5
Fine-Grained Image Analysis With Deep Learning: A Survey.基于深度学习的细粒度图像分析综述
IEEE Trans Pattern Anal Mach Intell. 2022 Dec;44(12):8927-8948. doi: 10.1109/TPAMI.2021.3126648. Epub 2022 Nov 7.
6
BaGFN: Broad Attentive Graph Fusion Network for High-Order Feature Interactions.BaGFN:用于高阶特征交互的广义注意力图融合网络
IEEE Trans Neural Netw Learn Syst. 2023 Aug;34(8):4499-4513. doi: 10.1109/TNNLS.2021.3116209. Epub 2023 Aug 4.
7
Multiresolution Discriminative Mixup Network for Fine-Grained Visual Categorization.用于细粒度视觉分类的多分辨率判别混合网络
IEEE Trans Neural Netw Learn Syst. 2023 Jul;34(7):3488-3500. doi: 10.1109/TNNLS.2021.3112768. Epub 2023 Jul 6.
8
Attend and Guide (AG-Net): A Keypoints-Driven Attention-Based Deep Network for Image Recognition.Attend and Guide (AG-Net):一种基于关键点驱动注意力的图像识别深度网络。
IEEE Trans Image Process. 2021;30:3691-3704. doi: 10.1109/TIP.2021.3064256. Epub 2021 Mar 17.
9
AP-CNN: Weakly Supervised Attention Pyramid Convolutional Neural Network for Fine-Grained Visual Classification.AP-CNN:用于细粒度视觉分类的弱监督注意力金字塔卷积神经网络。
IEEE Trans Image Process. 2021;30:2826-2836. doi: 10.1109/TIP.2021.3055617. Epub 2021 Feb 12.
10
Deep LSAC for Fine-Grained Recognition.
IEEE Trans Neural Netw Learn Syst. 2022 Jan;33(1):200-214. doi: 10.1109/TNNLS.2020.3027603. Epub 2022 Jan 5.