• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

基于协同分割的图像共骨架化。

Image Co-Skeletonization via Co-Segmentation.

出版信息

IEEE Trans Image Process. 2021;30:2784-2797. doi: 10.1109/TIP.2021.3054464. Epub 2021 Feb 12.

DOI:10.1109/TIP.2021.3054464
PMID:33523810
Abstract

Recent advances in the joint processing of a set of images have shown its advantages over individual processing. Unlike the existing works geared towards co-segmentation or co-localization, in this article, we explore a new joint processing topic: image co-skeletonization, which is defined as joint skeleton extraction of the foreground objects in an image collection. It is well known that object skeletonization in a single natural image is challenging, because there is hardly any prior knowledge available about the object present in the image. Therefore, we resort to the idea of image co-skeletonization, hoping that the commonness prior that exists across the semantically similar images can be leveraged to have such knowledge, similar to other joint processing problems such as co-segmentation. Moreover, earlier research has found that augmenting a skeletonization process with the object's shape information is highly beneficial in capturing the image context. Having made these two observations, we propose a coupled framework for co-skeletonization and co-segmentation tasks to facilitate shape information discovery for our co-skeletonization process through the co-segmentation process. While image co-skeletonization is our primary goal, the co-segmentation process might also benefit, in turn, from exploiting skeleton outputs of the co-skeletonization process as central object seeds through such a coupled framework. As a result, both can benefit from each other synergistically. For evaluating image co-skeletonization results, we also construct a novel benchmark dataset by annotating nearly 1.8 K images and dividing them into 38 semantic categories. Although the proposed idea is essentially a weakly supervised method, it can also be employed in supervised and unsupervised scenarios. Extensive experiments demonstrate that the proposed method achieves promising results in all three scenarios.

摘要

最近在一组图像的联合处理方面的进展表明,它比单独处理具有优势。与现有的针对协同分割或协同定位的工作不同,本文探索了一个新的联合处理主题:图像协同骨骼化,它被定义为图像集合中前景对象的联合骨骼提取。众所周知,单个自然图像中的对象骨骼化具有挑战性,因为几乎没有关于图像中存在的对象的先验知识。因此,我们求助于图像协同骨骼化的想法,希望可以利用跨语义相似图像存在的共性先验来获得这种知识,类似于其他联合处理问题,如协同分割。此外,早期的研究发现,在骨骼化过程中增加对象形状信息对于捕捉图像上下文非常有益。基于这两个观察结果,我们提出了一种用于协同骨骼化和协同分割任务的耦合框架,通过协同分割过程为我们的协同骨骼化过程发现形状信息。虽然图像协同骨骼化是我们的主要目标,但协同分割过程也可以通过这种耦合框架从协同骨骼化过程的骨骼输出中作为中心对象种子来受益,从而彼此协同受益。因此,两者可以相互促进。为了评估图像协同骨骼化的结果,我们还通过注释近 1800 张图像并将其分为 38 个语义类别来构建一个新的基准数据集。尽管提出的想法本质上是一种弱监督方法,但它也可以用于监督和无监督场景。广泛的实验表明,所提出的方法在所有三个场景中都取得了有希望的结果。

相似文献

1
Image Co-Skeletonization via Co-Segmentation.基于协同分割的图像共骨架化。
IEEE Trans Image Process. 2021;30:2784-2797. doi: 10.1109/TIP.2021.3054464. Epub 2021 Feb 12.
2
Coarse-to-Fine Semantic Segmentation From Image-Level Labels.从图像级标签进行粗到细的语义分割。
IEEE Trans Image Process. 2020;29:225-236. doi: 10.1109/TIP.2019.2926748. Epub 2019 Jul 12.
3
Joint Segmentation and Recognition of Categorized Objects from Noisy Web Image Collection.从噪声网络图像集中对分类对象进行联合分割与识别
IEEE Trans Image Process. 2014 Sep;23(9):4070-4086. doi: 10.1109/TIP.2014.2339196. Epub 2014 Jul 14.
4
Knowledge-Based Topic Model for Unsupervised Object Discovery and Localization.基于知识的无监督目标发现和定位主题模型。
IEEE Trans Image Process. 2018;27(1):50-63. doi: 10.1109/TIP.2017.2718667.
5
Weakly-Supervised Image Annotation and Segmentation with Objects and Attributes.基于对象和属性的弱监督图像标注和分割。
IEEE Trans Pattern Anal Mach Intell. 2017 Dec;39(12):2525-2538. doi: 10.1109/TPAMI.2016.2645157. Epub 2016 Dec 26.
6
STC: A Simple to Complex Framework for Weakly-Supervised Semantic Segmentation.STC:一种用于弱监督语义分割的从简单到复杂的框架。
IEEE Trans Pattern Anal Mach Intell. 2017 Nov;39(11):2314-2320. doi: 10.1109/TPAMI.2016.2636150. Epub 2016 Dec 6.
7
Weakly-Supervised Learning of Category-Specific 3D Object Shapes.特定类别3D物体形状的弱监督学习
IEEE Trans Pattern Anal Mach Intell. 2021 Apr;43(4):1423-1437. doi: 10.1109/TPAMI.2019.2949562. Epub 2021 Mar 9.
8
Edge-Supervised Linear Object Skeletonization for High-Speed Camera.高速相机的边缘监督线性物体骨架化。
Sensors (Basel). 2023 Jun 19;23(12):5721. doi: 10.3390/s23125721.
9
Looking Beyond Single Images for Weakly Supervised Semantic Segmentation Learning.超越单图像进行弱监督语义分割学习
IEEE Trans Pattern Anal Mach Intell. 2024 Mar;46(3):1635-1649. doi: 10.1109/TPAMI.2022.3168530. Epub 2024 Feb 6.
10
Semantic Object Segmentation in Tagged Videos via Detection.基于检测的标记视频中的语义对象分割。
IEEE Trans Pattern Anal Mach Intell. 2018 Jul;40(7):1741-1754. doi: 10.1109/TPAMI.2017.2727049. Epub 2017 Jul 20.

引用本文的文献

1
OSC-CO: coattention and cosegmentation framework for plant state change with multiple features.OSC-CO:用于具有多种特征的植物状态变化的共同注意力和共同分割框架。
Front Plant Sci. 2023 Oct 31;14:1211409. doi: 10.3389/fpls.2023.1211409. eCollection 2023.