University of Shanghai for Science and Technology, School of Opto-Electronic Information and Computer Engineering, Department of Control Science and Engineering, 516 War Industrial Road, Shanghai 200093, China.
University of Shanghai for Science and Technology, School of Opto-Electronic Information and Computer Engineering, Department of Control Science and Engineering, 516 War Industrial Road, Shanghai 200093, China.
Comput Methods Programs Biomed. 2024 Sep;254:108278. doi: 10.1016/j.cmpb.2024.108278. Epub 2024 Jun 11.
BACKGROUND AND OBJECTIVE: Training convolutional neural networks based on large amount of labeled data has made great progress in the field of image segmentation. However, in medical image segmentation tasks, annotating the data is expensive and time-consuming because pixel-level annotation requires experts in the relevant field. Currently, the combination of consistent regularization and pseudo labeling-based semi-supervised methods has shown good performance in image segmentation. However, in the training process, a portion of low-confidence pseudo labels are generated by the model. And the semi-supervised segmentation method still has the problem of distribution bias between labeled and unlabeled data. The objective of this study is to address the challenges of semi-supervised learning and improve the segmentation accuracy of semi-supervised models on medical images. METHODS: To address these issues, we propose an Uncertainty-based Region Clipping Algorithm for semi-supervised medical image segmentation, which consists of two main modules. A module is introduced to compute the uncertainty of two sub-networks predictions with diversity using Monte Carlo Dropout, allowing the model to gradually learn from more reliable targets. To retain model diversity, we use different loss functions for different branches and use Non-Maximum Suppression in one of the branches. The other module is proposed to generate new samples by masking the low-confidence pixels in the original image based on uncertainty information. New samples are fed into the model to facilitate the model to generate pseudo labels with high confidence and enlarge the training data distribution. RESULTS: Comprehensive experiments on the combination of two benchmarks ACDC and BraTS2019 show that our proposed model outperforms state-of-the-art methods in terms of Dice, HD95 and ASD. The results reach an average Dice score of 87.86 % and a HD95 score of 4.214 mm on ACDC dataset. For the brain tumor segmentation, the results reach an average Dice score of 84.79 % and a HD score of 10.13 mm. CONCLUSIONS: Our proposed method improves the accuracy of semi-supervised medical image segmentation. Extensive experiments on two public medical image datasets including 2D and 3D modalities demonstrate the superiority of our model. The code is available at: https://github.com/QuintinDong/URCA.
背景与目的:基于大量标注数据训练卷积神经网络,在图像分割领域取得了很大进展。然而,在医学图像分割任务中,由于像素级标注需要相关领域的专家,因此数据标注既昂贵又耗时。目前,一致性正则化和基于伪标注的半监督方法的结合在图像分割中表现出了良好的性能。然而,在训练过程中,模型会生成一部分置信度较低的伪标签。并且,半监督分割方法仍然存在标注数据和未标注数据之间的分布偏差问题。本研究的目的是解决半监督学习中的挑战,提高半监督模型在医学图像上的分割精度。
方法:为了解决这些问题,我们提出了一种基于不确定性的区域裁剪算法用于半监督医学图像分割,该算法主要包括两个模块。第一个模块引入了一种使用蒙特卡罗随机丢包来计算两个子网络预测的不确定性和多样性的方法,使模型能够逐步从更可靠的目标中学习。为了保留模型的多样性,我们在不同的分支上使用不同的损失函数,并在其中一个分支上使用非极大值抑制。另一个模块是基于不确定性信息提出的,用于在原始图像中屏蔽低置信度像素来生成新的样本。将新的样本输入到模型中,有助于模型生成具有高置信度的伪标签,并扩大训练数据的分布。
结果:在两个基准数据集 ACDC 和 BraTS2019 的综合实验中,我们提出的模型在 Dice、HD95 和 ASD 方面均优于最先进的方法。在 ACDC 数据集上,该模型的平均 Dice 分数达到 87.86%,HD95 分数达到 4.214mm。对于脑肿瘤分割,该模型的平均 Dice 分数达到 84.79%,HD 分数达到 10.13mm。
结论:我们提出的方法提高了半监督医学图像分割的准确性。在两个包括 2D 和 3D 模态的公共医学图像数据集上的广泛实验证明了我们模型的优越性。代码可在 https://github.com/QuintinDong/URCA 上获取。
Comput Methods Programs Biomed. 2024-9
Comput Methods Programs Biomed. 2022-11
Comput Biol Med. 2024-3
Comput Med Imaging Graph. 2024-7
Phys Med Biol. 2024-3-13