• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

卷积神经网络图像检索中的相对分布熵损失函数

Relative Distribution Entropy Loss Function in CNN Image Retrieval.

作者信息

Liu Pingping, Shi Lida, Miao Zhuang, Jin Baixin, Zhou Qiuzhan

机构信息

College of Computer Science and Technology, Jilin University, Changchun 130012, China.

Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun 130012, China.

出版信息

Entropy (Basel). 2020 Mar 11;22(3):321. doi: 10.3390/e22030321.

DOI:10.3390/e22030321
PMID:33286094
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC7516778/
Abstract

Convolutional neural networks (CNN) is the most mainstream solution in the field of image retrieval. Deep metric learning is introduced into the field of image retrieval, focusing on the construction of pair-based loss function. However, most pair-based loss functions of metric learning merely take common vector similarity (such as Euclidean distance) of the final image descriptors into consideration, while neglecting other distribution characters of these descriptors. In this work, we propose relative distribution entropy (RDE) to describe the internal distribution attributes of image descriptors. We combine relative distribution entropy with the Euclidean distance to obtain the relative distribution entropy weighted distance (RDE-distance). Moreover, the RDE-distance is fused with the contrastive loss and triplet loss to build the relative distributed entropy loss functions. The experimental results demonstrate that our method attains the state-of-the-art performance on most image retrieval benchmarks.

摘要

卷积神经网络(CNN)是图像检索领域最主流的解决方案。深度度量学习被引入图像检索领域,重点在于基于对的损失函数的构建。然而,度量学习的大多数基于对的损失函数仅考虑最终图像描述符的普通向量相似度(如欧几里得距离),而忽略了这些描述符的其他分布特征。在这项工作中,我们提出相对分布熵(RDE)来描述图像描述符的内部分布属性。我们将相对分布熵与欧几里得距离相结合,得到相对分布熵加权距离(RDE-距离)。此外,RDE-距离与对比损失和三元组损失相融合,构建相对分布熵损失函数。实验结果表明,我们的方法在大多数图像检索基准上达到了当前最优的性能。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/789e/7516778/58fbbc68b7e8/entropy-22-00321-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/789e/7516778/06beddc5b270/entropy-22-00321-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/789e/7516778/bda1ca2ccbae/entropy-22-00321-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/789e/7516778/19a853292d65/entropy-22-00321-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/789e/7516778/5be86b867912/entropy-22-00321-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/789e/7516778/58fbbc68b7e8/entropy-22-00321-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/789e/7516778/06beddc5b270/entropy-22-00321-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/789e/7516778/bda1ca2ccbae/entropy-22-00321-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/789e/7516778/19a853292d65/entropy-22-00321-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/789e/7516778/5be86b867912/entropy-22-00321-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/789e/7516778/58fbbc68b7e8/entropy-22-00321-g005.jpg

相似文献

1
Relative Distribution Entropy Loss Function in CNN Image Retrieval.卷积神经网络图像检索中的相对分布熵损失函数
Entropy (Basel). 2020 Mar 11;22(3):321. doi: 10.3390/e22030321.
2
Deep metric learning for otitis media classification.用于中耳炎分类的深度度量学习。
Med Image Anal. 2021 Jul;71:102034. doi: 10.1016/j.media.2021.102034. Epub 2021 Mar 14.
3
A boosting framework for visuality-preserving distance metric learning and its application to medical image retrieval.一种保持视觉保真度的距离度量学习的提升框架及其在医学图像检索中的应用。
IEEE Trans Pattern Anal Mach Intell. 2010 Jan;32(1):30-44. doi: 10.1109/TPAMI.2008.273.
4
A novel biomedical image indexing and retrieval system via deep preference learning.一种基于深度偏好学习的新型生物医学图像索引和检索系统。
Comput Methods Programs Biomed. 2018 May;158:53-69. doi: 10.1016/j.cmpb.2018.02.003. Epub 2018 Feb 6.
5
Composed query image retrieval based on triangle area triple loss function and combining CNN with transformer.基于三角形面积三重损失函数并结合卷积神经网络(CNN)与变压器(Transformer)的合成查询图像检索
Sci Rep. 2022 Dec 2;12(1):20800. doi: 10.1038/s41598-022-25340-w.
6
Distance Field-Based Convolutional Neural Network for Edge Detection.基于距离场的卷积神经网络边缘检测。
Comput Intell Neurosci. 2022 Mar 3;2022:1712258. doi: 10.1155/2022/1712258. eCollection 2022.
7
Hierarchical Recurrent Neural Hashing for Image Retrieval With Hierarchical Convolutional Features.基于层次卷积特征的层次递归神经网络哈希图像检索
IEEE Trans Image Process. 2018;27(1):106-120. doi: 10.1109/TIP.2017.2755766.
8
3D model retrieval based on interactive attention CNN and multiple features.基于交互式注意力卷积神经网络和多特征的3D模型检索
PeerJ Comput Sci. 2023 Feb 10;9:e1227. doi: 10.7717/peerj-cs.1227. eCollection 2023.
9
Evaluation of metric and representation learning approaches: Effects of representations driven by relative distance on the performance.度量和表示学习方法的评估:由相对距离驱动的表示对性能的影响。
2023 Intell Method Syst Appl (2023). 2023 Jul;2023:545-550. doi: 10.1109/imsa58542.2023.10217475. Epub 2023 Aug 24.
10
Retrieval of brain MRI with tumor using contrastive loss based similarity on GoogLeNet encodings.基于GoogLeNet编码利用对比损失相似度检索带有肿瘤的脑部磁共振成像。
Comput Biol Med. 2020 Oct;125:103993. doi: 10.1016/j.compbiomed.2020.103993. Epub 2020 Sep 17.

本文引用的文献

1
Fine-Tuning CNN Image Retrieval with No Human Annotation.无人工标注微调卷积神经网络图像检索。
IEEE Trans Pattern Anal Mach Intell. 2019 Jul;41(7):1655-1668. doi: 10.1109/TPAMI.2018.2846566. Epub 2018 Jun 12.
2
NetVLAD: CNN Architecture for Weakly Supervised Place Recognition.NetVLAD:用于弱监督场景识别的卷积神经网络架构。
IEEE Trans Pattern Anal Mach Intell. 2018 Jun;40(6):1437-1451. doi: 10.1109/TPAMI.2017.2711011. Epub 2017 Jun 1.
3
Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition.空间金字塔池化在深度卷积网络中的视觉识别。
IEEE Trans Pattern Anal Mach Intell. 2015 Sep;37(9):1904-16. doi: 10.1109/TPAMI.2015.2389824.
4
Large-scale discovery of spatially related images.大规模发现空间相关图像。
IEEE Trans Pattern Anal Mach Intell. 2010 Feb;32(2):371-7. doi: 10.1109/TPAMI.2009.166.
5
Automatic categorization of medical images for content-based retrieval and data mining.用于基于内容的检索和数据挖掘的医学图像自动分类
Comput Med Imaging Graph. 2005 Mar-Apr;29(2-3):143-55. doi: 10.1016/j.compmedimag.2004.09.010.