Department of Control Science and Engineering, Harbin Institute of Technology, Harbin, PR China.
Department of Control Science and Engineering, Harbin Institute of Technology, Harbin, PR China.
Med Image Anal. 2021 Jan;67:101819. doi: 10.1016/j.media.2020.101819. Epub 2020 Sep 28.
With the development of deep learning, its application in diagnosis of benign and malignant thyroid nodules has been widely concerned. However, it is difficult to obtain medical images, resulting in insufficient number of data, which contradicts the large amount of data required for acquiring effective deep learning diagnostic models. A multi-view ensemble learning based on voting mechanism is proposed herein to boost the performance of the models trained by small-dataset thyroid nodule ultrasound images. The method integrates three kinds of diagnosis results which are obtained from 3-view dataset which is composed of thyroid nodule ultrasound images, medical features extracted based on U-Net output and useful features selected by mRMR from the statistical features and texture features. To obtain preliminary diagnosis results, the images are utilized for training GoogleNet. For improving the results, supplementary methods were proposed based on the medical features and the selected features. To analyze the contribution of these features and acquire two groups of diagnosis results, the designed Xgboost classifier is utilized for obtaining two groups of features respectively. Subsequently, the boosting final results are obtained through majority voting mechanism. Furthermore, the proposed method is utilized to diagnose sequence images (the images extracted by frame from videos) to solve the poor results caused by slight differences. Finally, better final results are obtained for both of the normal dataset and the sequence dataset (consisting of sequence images). Compared with the accuracies obtained by only training deep learning models with small datasets, the diagnostic accuracies of the above two datasets are improved to 92.11% and 92.54% respectively by utilizing the proposed method.
随着深度学习的发展,其在甲状腺良恶性结节诊断中的应用受到广泛关注。然而,医学图像的获取较为困难,导致数据量不足,与获取有效深度学习诊断模型所需的大量数据相矛盾。本文提出了一种基于投票机制的多视图集成学习方法,以提高基于小数据集甲状腺结节超声图像训练的模型的性能。该方法集成了三种诊断结果,这三种结果是从由甲状腺结节超声图像组成的三视图数据集、基于 U-Net 输出提取的医学特征和从统计特征和纹理特征中选择的有用特征中获得的。为了获得初步诊断结果,使用图像来训练 GoogleNet。为了提高结果,基于医学特征和选择的特征提出了补充方法。为了分析这些特征的贡献并获得两组诊断结果,设计了 Xgboost 分类器分别获取两组特征。随后,通过多数投票机制获得提升的最终结果。此外,该方法还用于诊断序列图像(从视频中提取的帧图像),以解决由于细微差异导致的结果不佳的问题。最后,无论是正常数据集还是序列数据集(由序列图像组成),都获得了更好的最终结果。与仅使用小数据集训练深度学习模型获得的准确率相比,利用所提出的方法,上述两个数据集的诊断准确率分别提高到 92.11%和 92.54%。