Department of Colorectal Surgery, The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, Guangdong Province 510655, China; Guangdong Provincial Key Laboratory of Colorectal and Pelvic Floor Diseases, The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, Guangdong Province 510655, China.
SenseTime Research, Shanghai, China.
Med Image Anal. 2022 Aug;80:102515. doi: 10.1016/j.media.2022.102515. Epub 2022 Jun 17.
Since segmentation labeling is usually time-consuming and annotating medical images requires professional expertise, it is laborious to obtain a large-scale, high-quality annotated segmentation dataset. We propose a novel weakly- and semi-supervised framework named SOUSA (Segmentation Only Uses Sparse Annotations), aiming at learning from a small set of sparse annotated data and a large amount of unlabeled data. The proposed framework contains a teacher model and a student model. The student model is weakly supervised by scribbles and a Geodesic distance map derived from scribbles. Meanwhile, a large amount of unlabeled data with various perturbations are fed to student and teacher models. The consistency of their output predictions is imposed by Mean Square Error (MSE) loss and a carefully designed Multi-angle Projection Reconstruction (MPR) loss. Extensive experiments are conducted to demonstrate the robustness and generalization ability of our proposed method. Results show that our method outperforms weakly- and semi-supervised state-of-the-art methods on multiple datasets. Furthermore, our method achieves a competitive performance with some fully supervised methods with dense annotation when the size of the dataset is limited.
由于分割标注通常很耗时,并且标注医学图像需要专业知识,因此很难获得大规模、高质量的标注分割数据集。我们提出了一种名为 SOUSA(仅使用稀疏标注进行分割)的新型弱监督和半监督框架,旨在从小规模的稀疏标注数据和大量未标注数据中进行学习。该框架包含一个教师模型和一个学生模型。学生模型由涂鸦和从涂鸦中得出的测地距离图进行弱监督。同时,大量具有各种扰动的未标注数据被馈送到学生和教师模型中。它们输出预测的一致性通过均方误差(MSE)损失和精心设计的多角度投影重建(MPR)损失来施加。进行了广泛的实验以证明我们提出的方法的鲁棒性和泛化能力。结果表明,我们的方法在多个数据集上优于弱监督和半监督的最新方法。此外,当数据集规模有限时,我们的方法在密集标注的一些全监督方法中具有竞争力的性能。