Nguyen Toan Duc, Le Duc-Tai, Bum Junghyun, Kim Seongho, Song Su Jeong, Choo Hyunseung
Department of AI Systems Engineering, Sungkyunkwan University, Suwon 16419, Republic of Korea.
College of Computing and Informatics, Sungkyunkwan University, Suwon 16419, Republic of Korea.
Bioengineering (Basel). 2023 Sep 16;10(9):1089. doi: 10.3390/bioengineering10091089.
Self-supervised learning has been successful in computer vision, and its application to medical imaging has shown great promise. This study proposes a novel self-supervised learning method for medical image classification, specifically targeting ultra-wide-field fundus images (UFI). The proposed method utilizes contrastive learning to pre-train a deep learning model and then fine-tune it with a small set of labeled images. This approach reduces the reliance on labeled data, which is often limited and costly to obtain, and has the potential to improve disease detection in UFI. This method employs two contrastive learning techniques, namely bi-lateral contrastive learning and multi-modality pre-training, to form positive pairs using the data correlation. Bi-lateral learning fuses multiple views of the same patient's images, and multi-modality pre-training leverages the complementary information between UFI and conventional fundus images (CFI) to form positive pairs. The results show that the proposed contrastive learning method achieves state-of-the-art performance with an area under the receiver operating characteristic curve (AUC) score of 86.96, outperforming other approaches. The findings suggest that self-supervised learning is a promising direction for medical image analysis, with potential applications in various clinical settings.
自监督学习在计算机视觉领域已取得成功,其在医学成像中的应用也展现出巨大潜力。本研究提出了一种用于医学图像分类的新型自监督学习方法,特别针对超广角眼底图像(UFI)。所提出的方法利用对比学习对深度学习模型进行预训练,然后使用一小部分标记图像对其进行微调。这种方法减少了对标记数据的依赖,而标记数据通常获取有限且成本高昂,并且有可能改善UFI中的疾病检测。该方法采用了两种对比学习技术,即双边对比学习和多模态预训练,利用数据相关性形成正样本对。双边学习融合了同一患者图像的多个视图,多模态预训练利用UFI与传统眼底图像(CFI)之间的互补信息形成正样本对。结果表明,所提出的对比学习方法在接收器操作特征曲线(AUC)得分方面达到了86.96的最先进性能,优于其他方法。研究结果表明,自监督学习是医学图像分析的一个有前途的方向,在各种临床环境中具有潜在应用。