• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

一种轻量级岩石分类模型的优化方法:转移丰富的细粒度知识。

An Optimization Method for Lightweight Rock Classification Models: Transferred Rich Fine-Grained Knowledge.

作者信息

Ma Mingshuo, Gui Zhiming, Gao Zhenji, Wang Bin

机构信息

Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China.

Integrated Natural Resources Survey Center, CGS, No. 55 Yard, Honglian South Road, Xicheng District, Beijing 100055, China.

出版信息

Sensors (Basel). 2024 Jun 25;24(13):4127. doi: 10.3390/s24134127.

DOI:10.3390/s24134127
PMID:39000906
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC11244286/
Abstract

Rock image classification represents a challenging fine-grained image classification task characterized by subtle differences among closely related rock categories. Current contrastive learning methods prevalently utilized in fine-grained image classification restrict the model's capacity to discern critical features contrastively from image pairs, and are typically too large for deployment on mobile devices used for in situ rock identification. In this work, we introduce an innovative and compact model generation framework anchored by the design of a Feature Positioning Comparison Network (FPCN). The FPCN facilitates interaction between feature vectors from localized regions within image pairs, capturing both shared and distinctive features. Further, it accommodates the variable scales of objects depicted in images, which correspond to differing quantities of inherent object information, directing the network's attention to additional contextual details based on object size variability. Leveraging knowledge distillation, the architecture is streamlined, with a focus on nuanced information at activation boundaries to master the precise fine-grained decision boundaries, thereby enhancing the small model's accuracy. Empirical evidence demonstrates that our proposed method based on FPCN improves the classification accuracy mobile lightweight models by nearly 2% while maintaining the same time and space consumption.

摘要

岩石图像分类是一项具有挑战性的细粒度图像分类任务,其特点是密切相关的岩石类别之间存在细微差异。目前在细粒度图像分类中普遍使用的对比学习方法限制了模型从图像对中对比辨别关键特征的能力,并且通常规模过大,无法部署在用于现场岩石识别的移动设备上。在这项工作中,我们引入了一个创新的紧凑型模型生成框架,该框架以特征定位比较网络(FPCN)的设计为基础。FPCN促进了图像对中局部区域的特征向量之间的交互,捕捉共享特征和独特特征。此外,它适应图像中所描绘物体的可变尺度,这些尺度对应于不同数量的固有物体信息,并根据物体大小的变化引导网络关注额外的上下文细节。利用知识蒸馏,该架构得以简化,重点关注激活边界处的细微信息,以掌握精确的细粒度决策边界,从而提高小型模型的准确性。经验证据表明,我们基于FPCN提出的方法在保持相同时间和空间消耗的同时,将移动轻量级模型的分类准确率提高了近2%。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0765/11244286/dbca6e3dd210/sensors-24-04127-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0765/11244286/81306e3e46e0/sensors-24-04127-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0765/11244286/2c12ca1b5092/sensors-24-04127-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0765/11244286/c1bafd5ceb16/sensors-24-04127-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0765/11244286/c88b59e8b7ae/sensors-24-04127-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0765/11244286/056ae87147d9/sensors-24-04127-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0765/11244286/f9c94649943f/sensors-24-04127-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0765/11244286/dbca6e3dd210/sensors-24-04127-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0765/11244286/81306e3e46e0/sensors-24-04127-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0765/11244286/2c12ca1b5092/sensors-24-04127-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0765/11244286/c1bafd5ceb16/sensors-24-04127-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0765/11244286/c88b59e8b7ae/sensors-24-04127-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0765/11244286/056ae87147d9/sensors-24-04127-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0765/11244286/f9c94649943f/sensors-24-04127-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0765/11244286/dbca6e3dd210/sensors-24-04127-g007.jpg

相似文献

1
An Optimization Method for Lightweight Rock Classification Models: Transferred Rich Fine-Grained Knowledge.一种轻量级岩石分类模型的优化方法:转移丰富的细粒度知识。
Sensors (Basel). 2024 Jun 25;24(13):4127. doi: 10.3390/s24134127.
2
EPANet-KD: Efficient progressive attention network for fine-grained provincial village classification via knowledge distillation.EPANet-KD:通过知识蒸馏实现基于高效渐进注意力网络的细粒度省份-乡村分类。
PLoS One. 2024 Feb 15;19(2):e0298452. doi: 10.1371/journal.pone.0298452. eCollection 2024.
3
Fine-Grained Image Classification for Crop Disease Based on Attention Mechanism.基于注意力机制的作物病害细粒度图像分类
Front Plant Sci. 2020 Dec 22;11:600854. doi: 10.3389/fpls.2020.600854. eCollection 2020.
4
Fine-grained image classification method based on hybrid attention module.基于混合注意力模块的细粒度图像分类方法。
Front Neurorobot. 2024 May 3;18:1391791. doi: 10.3389/fnbot.2024.1391791. eCollection 2024.
5
Research on Classification of Fine-Grained Rock Images Based on Deep Learning.基于深度学习的细粒度岩石图像分类研究。
Comput Intell Neurosci. 2021 Sep 20;2021:5779740. doi: 10.1155/2021/5779740. eCollection 2021.
6
Feature relocation network for fine-grained image classification.用于细粒度图像分类的特征重定位网络。
Neural Netw. 2023 Apr;161:306-317. doi: 10.1016/j.neunet.2023.01.050. Epub 2023 Feb 4.
7
A Fine-Grained Image Classification and Detection Method Based on Convolutional Neural Network Fused with Attention Mechanism.基于卷积神经网络融合注意力机制的细粒度图像分类与检测方法。
Comput Intell Neurosci. 2022 Sep 14;2022:2974960. doi: 10.1155/2022/2974960. eCollection 2022.
8
CLIP-Driven Fine-Grained Text-Image Person Re-Identification.基于CLIP的细粒度文本-图像人物重识别
IEEE Trans Image Process. 2023;32:6032-6046. doi: 10.1109/TIP.2023.3327924. Epub 2023 Nov 7.
9
Fine-Grained Cross-Modal Semantic Consistency in Natural Conservation Image Data from a Multi-Task Perspective.从多任务视角看自然保护图像数据中的细粒度跨模态语义一致性
Sensors (Basel). 2024 May 14;24(10):3130. doi: 10.3390/s24103130.
10
KFWC: A Knowledge-Driven Deep Learning Model for Fine-grained Classification of Wet-AMD.KFWC:一种面向湿性年龄相关性黄斑变性精细分类的知识驱动深度学习模型。
Comput Methods Programs Biomed. 2023 Feb;229:107312. doi: 10.1016/j.cmpb.2022.107312. Epub 2022 Dec 15.

本文引用的文献

1
Research on Classification of Fine-Grained Rock Images Based on Deep Learning.基于深度学习的细粒度岩石图像分类研究。
Comput Intell Neurosci. 2021 Sep 20;2021:5779740. doi: 10.1155/2021/5779740. eCollection 2021.
2
Recent Advances in Large Margin Learning.近年来大间隔学习的进展
IEEE Trans Pattern Anal Mach Intell. 2022 Oct;44(10):7167-7174. doi: 10.1109/TPAMI.2021.3091717. Epub 2022 Sep 14.
3
Selective Convolutional Descriptor Aggregation for Fine-Grained Image Retrieval.选择性卷积描述符聚合用于细粒度图像检索。
IEEE Trans Image Process. 2017 Jun;26(6):2868-2881. doi: 10.1109/TIP.2017.2688133. Epub 2017 Mar 27.