一种基于元学习模型的少样本糖尿病视网膜病变分类的困难感知与任务增强方法。

A difficulty-aware and task-augmentation method based on meta-learning model for few-shot diabetic retinopathy classification.

作者信息

Liu Xueyao, Dong Xueyuan, Li Tuo, Zou Xiaofeng, Cheng Chen, Jiang Zekun, Gao Zhumin, Duan Sixu, Chen Meirong, Liu Tingting, Huang Pu, Li Dengwang, Lu Hua

机构信息

Shandong Key Laboratory of Medical Physics and Image Processing, Shandong Institute of Industrial Technology for Health Sciences and Precision Medicine, School of Physics and Electronics, Shandong Normal University, Jinan, China.

Shandong Yunhai Guochuang Cloud Computing Equipment Industry Innovation Co., Ltd., Jinan, China.

出版信息

Quant Imaging Med Surg. 2024 Jan 3;14(1):861-876. doi: 10.21037/qims-23-567. Epub 2024 Jan 2.

Abstract

BACKGROUND

Accurate classification techniques are essential for the early diagnosis and treatment of patients with diabetic retinopathy (DR). However, the limited amount of annotated DR data poses a challenge for existing deep-learning models. This article proposes a difficulty-aware and task-augmentation method based on meta-learning (DaTa-ML) model for few-shot DR classification with fundus images.

METHODS

The difficulty-aware (Da) method operates by dynamically modifying the cross-entropy loss function applied to learning tasks. This methodology has the ability to intelligently down-weight simpler tasks, while simultaneously prioritizing more challenging tasks. These adjustments occur automatically and aim to optimize the learning process. Additionally, the task-augmentation (Ta) method is used to enhance the meta-training process by augmenting the number of tasks through image rotation and improving the feature-extraction capability. To implement the expansion of the meta-training tasks, various task instances can be sampled during the meta-training stage. Ultimately, the proposed Ta method was introduced to optimize the initialization parameters and enhance the meta-generalization performance of the model. The DaTa-ML model showed promising results by effectively addressing the challenges associated with few-shot DR classification.

RESULTS

The Asia Pacific Tele-Ophthalmology Society (APTOS) 2019 blindness detection data set was used to evaluate the DaTa-ML model. The results showed that with only 1% of the training data (5-way, 20-shot) and a single update step (training time reduced by 90%), the DaTa-ML model had an accuracy rate of 89.6% on the test data, which is a 1.7% improvement over the transfer-learning method [i.e., residual neural network (ResNet)50 pre-trained on ImageNet], and a 16.8% improvement over scratch-built models (i.e., ResNet50 without pre-trained weights), despite having fewer trainable parameters (the parameters used by the DaTa-ML model are only 0.47% of the ResNet50 parameters).

CONCLUSIONS

The DaTa-ML model provides a more efficient DR classification solution with little annotated data and has significant advantages over state-of-the-art methods. Thus, it could be used to guide and assist ophthalmologists to determine the severity of DR.

摘要

背景

准确的分类技术对于糖尿病视网膜病变(DR)患者的早期诊断和治疗至关重要。然而,有限的带注释DR数据量给现有的深度学习模型带来了挑战。本文提出了一种基于元学习(DaTa-ML)模型的难度感知和任务增强方法,用于眼底图像的少样本DR分类。

方法

难度感知(Da)方法通过动态修改应用于学习任务的交叉熵损失函数来运行。这种方法能够智能地降低简单任务的权重,同时优先处理更具挑战性的任务。这些调整会自动进行,旨在优化学习过程。此外,任务增强(Ta)方法用于通过图像旋转增加任务数量和提高特征提取能力来增强元训练过程。为了实现元训练任务的扩展,可以在元训练阶段对各种任务实例进行采样。最终,引入所提出的Ta方法来优化初始化参数并提高模型的元泛化性能。DaTa-ML模型通过有效应对少样本DR分类相关挑战显示出了有前景的结果。

结果

使用亚太远程眼科学会(APTOS)2019年失明检测数据集对DaTa-ML模型进行评估。结果表明,仅使用1%的训练数据(5分类,每类20个样本)和单个更新步骤(训练时间减少90%),DaTa-ML模型在测试数据上的准确率为89.

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9094/10784049/dd354ebadb5d/qims-14-01-861-f1.jpg

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索