Suppr超能文献

通过自我监督和分布校准提升少样本罕见皮肤病分类

Boosting few-shot rare skin disease classification via self-supervision and distribution calibration.

作者信息

Fu Wen, Chen Jie, Zhou Li

机构信息

Institute of Microelectronics of Chinese Academy of Sciences, Beijing, 100029 China.

University of Chinese Academy of Sciences, Beijing, 100049 China.

出版信息

Biomed Eng Lett. 2024 May 20;14(4):877-889. doi: 10.1007/s13534-024-00383-2. eCollection 2024 Jul.

Abstract

Due to the difficulty in obtaining clinical samples and the high cost of labeling, rare skin diseases are characterized by data scarcity, making training deep neural networks for classification challenging. In recent years, few-shot learning has emerged as a promising solution, enabling models to recognize unseen disease classes by limited labeled samples. However, most existing methods ignored the fine-grained nature of rare skin diseases, resulting in poor performance when generalizing to highly similar classes. Moreover, the distributions learned from limited labeled data are biased, severely impairing the model's generalizability. This paper proposes a self-supervision distribution calibration network (SS-DCN) to address the above issues. Specifically, SS-DCN adopts a multi-task learning framework during pre-training. By introducing self-supervised tasks to aid in supervised learning, the model can learn more discriminative and transferable visual representations. Furthermore, SS-DCN applied an enhanced distribution calibration (EDC) strategy, which utilizes the statistics of base classes with sufficient samples to calibrate the bias distribution of novel classes with few-shot samples. By generating more samples from the calibrated distribution, EDC can provide sufficient supervision for subsequent classifier training. The proposed method is evaluated on three public skin disease datasets(i.e., ISIC2018, Derm7pt, and SD198), achieving significant performance improvements over state-of-the-art methods.

摘要

由于获取临床样本困难且标记成本高昂,罕见皮肤病的特点是数据稀缺,这使得训练用于分类的深度神经网络具有挑战性。近年来,少样本学习作为一种有前景的解决方案出现,使模型能够通过有限的标记样本识别未见的疾病类别。然而,大多数现有方法忽略了罕见皮肤病的细粒度性质,导致在推广到高度相似的类别时性能不佳。此外,从有限标记数据中学到的分布存在偏差,严重损害了模型的泛化能力。本文提出了一种自监督分布校准网络(SS-DCN)来解决上述问题。具体来说,SS-DCN在预训练期间采用多任务学习框架。通过引入自监督任务来辅助监督学习,模型可以学习到更具判别力和可转移的视觉表示。此外,SS-DCN应用了一种增强分布校准(EDC)策略,该策略利用具有足够样本的基础类别的统计信息来校准具有少样本的新类别偏差分布。通过从校准分布中生成更多样本,EDC可以为后续分类器训练提供足够的监督。所提出的方法在三个公共皮肤病数据集(即ISIC2018、Derm7pt和SD198)上进行了评估,与现有方法相比取得了显著的性能提升。

相似文献

1
Boosting few-shot rare skin disease classification via self-supervision and distribution calibration.
Biomed Eng Lett. 2024 May 20;14(4):877-889. doi: 10.1007/s13534-024-00383-2. eCollection 2024 Jul.
3
Bridging the Gap Between Few-Shot and Many-Shot Learning via Distribution Calibration.
IEEE Trans Pattern Anal Mach Intell. 2022 Dec;44(12):9830-9843. doi: 10.1109/TPAMI.2021.3132021. Epub 2022 Nov 7.
4
FEGGNN: Feature-Enhanced Gated Graph Neural Network for robust few-shot skin disease classification.
Comput Biol Med. 2025 May;189:109902. doi: 10.1016/j.compbiomed.2025.109902. Epub 2025 Mar 9.
5
Self-supervised learning for remote sensing scene classification under the few shot scenario.
Sci Rep. 2023 Jan 9;13(1):433. doi: 10.1038/s41598-022-27313-5.
6
Dual-Channel Prototype Network for Few-Shot Pathology Image Classification.
IEEE J Biomed Health Inform. 2024 Jul;28(7):4132-4144. doi: 10.1109/JBHI.2024.3386197. Epub 2024 Jul 2.
8
Self-augmentation: Generalizing deep networks to unseen classes for few-shot learning.
Neural Netw. 2021 Jun;138:140-149. doi: 10.1016/j.neunet.2021.02.007. Epub 2021 Feb 17.
9
SCL: Self-supervised contrastive learning for few-shot image classification.
Neural Netw. 2023 Aug;165:19-30. doi: 10.1016/j.neunet.2023.05.037. Epub 2023 May 24.
10
Proposal Distribution Calibration for Few-Shot Object Detection.
IEEE Trans Neural Netw Learn Syst. 2025 Jan;36(1):1911-1918. doi: 10.1109/TNNLS.2023.3331648. Epub 2025 Jan 7.

引用本文的文献

1
Rare but not to be overlooked: Epidemiology and strategies for rare dermatological diseases in China.
Intractable Rare Dis Res. 2025 Aug 31;14(3):151-161. doi: 10.5582/irdr.2025.01039.

本文引用的文献

1
Dynamic Subcluster-Aware Network for Few-Shot Skin Disease Classification.
IEEE Trans Neural Netw Learn Syst. 2025 Jan;36(1):1872-1883. doi: 10.1109/TNNLS.2023.3336765. Epub 2025 Jan 7.
2
Medical Tumor Image Classification Based on Few-Shot Learning.
IEEE/ACM Trans Comput Biol Bioinform. 2024 Jul-Aug;21(4):715-724. doi: 10.1109/TCBB.2023.3282226. Epub 2024 Aug 9.
3
Meta-learning with implicit gradients in a few-shot setting for medical image segmentation.
Comput Biol Med. 2022 Apr;143:105227. doi: 10.1016/j.compbiomed.2022.105227. Epub 2022 Jan 12.
4
Refined Residual Deep Convolutional Network for Skin Lesion Classification.
J Digit Imaging. 2022 Apr;35(2):258-280. doi: 10.1007/s10278-021-00552-0. Epub 2022 Jan 11.
5
7-Point Checklist and Skin Lesion Classification using Multi-Task Multi-Modal Neural Nets.
IEEE J Biomed Health Inform. 2018 Apr 9. doi: 10.1109/JBHI.2018.2824327.

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验