School of Computer, Electronics and Information, Guangxi University, Nanning, Guangxi, 530004, China.
Center for Machine Vision and Signal Analysis, University of Oulu, Oulu FI-90014, Finland.
Comput Methods Programs Biomed. 2024 Nov;256:108384. doi: 10.1016/j.cmpb.2024.108384. Epub 2024 Aug 23.
Medicine image classification are important methods of traditional medical image analysis, but the trainable data in medical image classification is highly imbalanced and the accuracy of medical image classification models is low. In view of the above two common problems in medical image classification. This study aims to: (i) effectively solve the problem of poor training effect caused by the imbalance of class imbalanced data sets. (ii) propose a network framework suitable for improving medical image classification results, which needs to be superior to existing methods.
In this paper, we put in the diffusion model multi-scale feature fusion network (DMSFF), which mainly uses the diffusion generation model to overcome imbalanced classes (DMOIC) on highly imbalanced medical image datasets. At the same time, it is processed according to the cropped image augmentation strategy through cropping (IASTC). Based on this, we use the new dataset to design a multi-scale feature fusion network (MSFF) that can fully utilize multiple hierarchical features. The DMSFF network can effectively solve the problems of small and imbalanced samples and low accuracy in medical image classification.
We evaluated the performance of the DMSFF network on highly imbalanced medical image classification datasets APTOS2019 and ISIC2018. Compared with other classification models, our proposed DMSFF network achieved significant improvements in classification accuracy and F1 score on two datasets, reaching 0.872, 0.731, and 0.906, 0.836, respectively.
Our newly proposed DMSFF architecture outperforms existing methods on two datasets, and verifies the effectiveness of generative model inverse balance for imbalance class datasets and feature enhancement by multi-scale feature fusion. Further, the method can be applied to other class imbalanced data sets where the results will be improved.
医学图像分类是传统医学图像分析的重要方法,但医学图像分类中的可训练数据高度不平衡,医学图像分类模型的准确性较低。针对医学图像分类中的上述两个常见问题,本研究旨在:(i)有效解决因类不平衡数据集不平衡而导致的训练效果不佳的问题。(ii)提出一种适合提高医学图像分类结果的网络框架,需要优于现有方法。
本文中,我们提出了扩散模型多尺度特征融合网络(DMSFF),该网络主要使用扩散生成模型来克服高度不平衡的医学图像数据集上的不平衡类(DMOIC)。同时,通过裁剪(IASTC)对裁剪后的图像进行处理。在此基础上,我们使用新的数据集设计了一种能够充分利用多层次特征的多尺度特征融合网络(MSFF)。DMSFF 网络可以有效地解决医学图像分类中小样本和不平衡样本数量少、准确率低的问题。
我们在高度不平衡的医学图像分类数据集 APTOS2019 和 ISIC2018 上评估了 DMSFF 网络的性能。与其他分类模型相比,我们提出的 DMSFF 网络在两个数据集上的分类准确率和 F1 得分都有显著提高,分别达到 0.872、0.731 和 0.906、0.836。
我们新提出的 DMSFF 架构在两个数据集上优于现有方法,验证了生成模型反平衡对不平衡类数据集和多尺度特征融合增强特征的有效性。此外,该方法可以应用于其他类不平衡数据集,结果将得到改善。