College of Computer Science, Chongqing University, Chongqing 400044, People's Republic of China.
School of Artificial Intelligence, Chongqing University of Technology, Chongqing 400050, People's Republic of China.
Phys Med Biol. 2023 Oct 4;68(20). doi: 10.1088/1361-6560/acf90f.
. Although convolutional neural networks (CNN) and Transformers have performed well in many medical image segmentation tasks, they rely on large amounts of labeled data for training. The annotation of medical image data is expensive and time-consuming, so it is common to use semi-supervised learning methods that use a small amount of labeled data and a large amount of unlabeled data to improve the performance of medical imaging segmentation.. This work aims to enhance the segmentation performance of medical images using a triple-teacher cross-learning semi-supervised medical image segmentation with shape perception and multi-scale consistency regularization. To effectively leverage the information from unlabeled data, we design a multi-scale semi-supervised method for three-teacher cross-learning based on shape perception, called Semi-TMS. The three teacher models engage in cross-learning with each other, where Teacher A and Teacher C utilize a CNN architecture, while Teacher B employs a transformer model. The cross-learning module consisting of Teacher A and Teacher C captures local and global information, generates pseudo-labels, and performs cross-learning using prediction results. Multi-scale consistency regularization is applied separately to the CNN and Transformer to improve accuracy. Furthermore, the low uncertainty output probabilities from Teacher A or Teacher C are utilized as input to Teacher B, enhancing the utilization of prior knowledge and overall segmentation robustness.. Experimental evaluations on two public datasets demonstrate that the proposed method outperforms some existing semi-segmentation models, implicitly capturing shape information and effectively improving the utilization and accuracy of unlabeled data through multi-scale consistency.. With the widespread utilization of medical imaging in clinical diagnosis, our method is expected to be a potential auxiliary tool, assisting clinicians and medical researchers in their diagnoses.
. 虽然卷积神经网络(CNN)和转换器在许多医学图像分割任务中表现出色,但它们依赖于大量的标记数据进行训练。医学图像数据的注释既昂贵又耗时,因此通常使用半监督学习方法,这些方法使用少量标记数据和大量未标记数据来提高医学成像分割的性能。. 本研究旨在通过具有形状感知和多尺度一致性正则化的三重教师交叉学习半监督医学图像分割来增强医学图像的分割性能。为了有效地利用未标记数据中的信息,我们设计了一种基于形状感知的三教师交叉学习的多尺度半监督方法,称为 Semi-TMS。三个教师模型相互进行交叉学习,其中教师 A 和教师 C 采用 CNN 架构,而教师 B 则采用转换器模型。由教师 A 和教师 C 组成的交叉学习模块捕获局部和全局信息,生成伪标签,并使用预测结果进行交叉学习。对 CNN 和 Transformer 分别应用多尺度一致性正则化以提高准确性。此外,教师 A 或教师 C 的低不确定性输出概率被用作教师 B 的输入,从而增强了先验知识的利用和整体分割的稳健性。. 在两个公共数据集上的实验评估表明,所提出的方法优于一些现有的半分割模型,通过多尺度一致性有效地捕获形状信息并利用未标记数据,从而提高了利用和准确性。. 随着医学成像在临床诊断中的广泛应用,我们的方法有望成为一种潜在的辅助工具,帮助临床医生和医学研究人员进行诊断。