Suppr超能文献

基于解剖感知对比蒸馏的自训练半监督医学图像分割

Bootstrapping Semi-supervised Medical Image Segmentation with Anatomical-Aware Contrastive Distillation.

作者信息

You Chenyu, Dai Weicheng, Min Yifei, Staib Lawrence, Duncan James S

机构信息

Department of Electrical Engineering, Yale University, New Haven, USA.

Department of Computer Science and Engineering, New York University, New York, USA.

出版信息

Inf Process Med Imaging. 2023 Jun;13939:641-653. doi: 10.1007/978-3-031-34048-2_49. Epub 2023 Jun 8.

Abstract

Contrastive learning has shown great promise over annotation scarcity problems in the context of medical image segmentation. Existing approaches typically assume a balanced class distribution for both labeled and unlabeled medical images. However, medical image data in reality is commonly imbalanced (., multi-class label imbalance), which naturally yields blurry contours and usually incorrectly labels rare objects. Moreover, it remains unclear whether all negative samples are equally negative. In this work, we present , an natomical-aware onrastive dstillati framework, for semi-supervised medical image segmentation. Specifically, we first develop an iterative contrastive distillation algorithm by softly labeling the negatives rather than binary supervision between positive and negative pairs. We also capture more semantically similar features from the randomly chosen negative set compared to the positives to enforce the diversity of the sampled data. Second, we raise a more important question: Can we really handle imbalanced samples to yield better performance? Hence, the in ACTION is to learn global semantic relationship across the entire dataset and local anatomical features among the neighbouring pixels with minimal additional memory footprint. During the training, we introduce anatomical contrast by actively sampling a sparse set of hard negative pixels, which can generate smoother segmentation boundaries and more accurate predictions. Extensive experiments across two benchmark datasets and different unlabeled settings show that ACTION significantly outperforms the current state-of-the-art semi-supervised methods.

摘要

对比学习在医学图像分割背景下针对标注稀缺问题已展现出巨大潜力。现有方法通常假定有标签和无标签医学图像的类别分布是平衡的。然而,现实中的医学图像数据通常是不平衡的(即多类别标签不平衡),这自然会产生模糊的轮廓,并且通常会错误地标记罕见物体。此外,目前尚不清楚所有负样本是否同样为负。在这项工作中,我们提出了一种用于半监督医学图像分割的解剖学感知对比蒸馏框架ACTION。具体而言,我们首先通过对负样本进行软标注而非对正负样本对进行二元监督来开发一种迭代对比蒸馏算法。与正样本相比,我们还从随机选择的负样本集中捕获更多语义相似特征,以增强采样数据的多样性。其次,我们提出一个更重要的问题:我们真的能处理不平衡样本以获得更好的性能吗?因此,ACTION的作用是在占用最少额外内存的情况下学习整个数据集的全局语义关系以及相邻像素之间的局部解剖特征。在训练过程中,我们通过主动采样一组稀疏的硬负像素来引入解剖学对比,这可以生成更平滑的分割边界和更准确的预测。在两个基准数据集和不同无标签设置下进行的大量实验表明,ACTION显著优于当前最先进的半监督方法。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3fd0/10322187/ec7e2a087a89/nihms-1913000-f0001.jpg

相似文献

4
ACTION++: Improving Semi-supervised Medical Image Segmentation with Adaptive Anatomical Contrast.ACTION++:利用自适应解剖对比度改进半监督医学图像分割
Med Image Comput Comput Assist Interv. 2023 Oct;14223:194-205. doi: 10.1007/978-3-031-43901-8_19. Epub 2023 Oct 1.

引用本文的文献

本文引用的文献

4
Incremental Learning Meets Transfer Learning: Application to Multi-site Prostate MRI Segmentation.增量学习与迁移学习相结合:在多站点前列腺MRI分割中的应用
Distrib Collab Fed Learn Afford AI Healthc Resour Div Glob Health (2022). 2022 Sep;13573:3-16. doi: 10.1007/978-3-031-18523-6_1. Epub 2022 Oct 7.
7
Interpolation consistency training for semi-supervised learning.半监督学习中的插值一致性训练。
Neural Netw. 2022 Jan;145:90-106. doi: 10.1016/j.neunet.2021.10.008. Epub 2021 Oct 21.
9
NuSeT: A deep learning tool for reliably separating and analyzing crowded cells.NuSeT:一种可靠分离和分析拥挤细胞的深度学习工具。
PLoS Comput Biol. 2020 Sep 14;16(9):e1008193. doi: 10.1371/journal.pcbi.1008193. eCollection 2020 Sep.

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验