Adiga V Sukesh, Dolz Jose, Lombaert Herve
Computer and Software Engineering Department, ETS Montreal, 1100 Notre Dame St. W., Montreal QC, H3C 1K3, Canada.
Computer and Software Engineering Department, ETS Montreal, 1100 Notre Dame St. W., Montreal QC, H3C 1K3, Canada.
Med Image Anal. 2024 Jan;91:103011. doi: 10.1016/j.media.2023.103011. Epub 2023 Oct 30.
Semi-supervised learning relaxes the need of large pixel-wise labeled datasets for image segmentation by leveraging unlabeled data. A prominent way to exploit unlabeled data is to regularize model predictions. Since the predictions of unlabeled data can be unreliable, uncertainty-aware schemes are typically employed to gradually learn from meaningful and reliable predictions. Uncertainty estimation methods, however, rely on multiple inferences from the model predictions that must be computed for each training step, which is computationally expensive. Moreover, these uncertainty maps capture pixel-wise disparities and do not consider global information. This work proposes a novel method to estimate segmentation uncertainty by leveraging global information from the segmentation masks. More precisely, an anatomically-aware representation is first learnt to model the available segmentation masks. The learnt representation thereupon maps the prediction of a new segmentation into an anatomically-plausible segmentation. The deviation from the plausible segmentation aids in estimating the underlying pixel-level uncertainty in order to further guide the segmentation network. The proposed method consequently estimates the uncertainty using a single inference from our representation, thereby reducing the total computation. We evaluate our method on two publicly available segmentation datasets of left atria in cardiac MRIs and of multiple organs in abdominal CTs. Our anatomically-aware method improves the segmentation accuracy over the state-of-the-art semi-supervised methods in terms of two commonly used evaluation metrics.
半监督学习通过利用未标记数据,放宽了对用于图像分割的大型逐像素标记数据集的需求。利用未标记数据的一种突出方法是对模型预测进行正则化。由于未标记数据的预测可能不可靠,通常采用不确定性感知方案从有意义且可靠的预测中逐步学习。然而,不确定性估计方法依赖于从模型预测进行的多次推理,而每次训练步骤都必须计算这些推理,这在计算上是昂贵的。此外,这些不确定性图捕获逐像素差异,而不考虑全局信息。这项工作提出了一种通过利用分割掩码中的全局信息来估计分割不确定性的新方法。更准确地说,首先学习一种解剖学感知表示来对可用的分割掩码进行建模。随后,学习到的表示将新分割的预测映射到解剖学上合理的分割中。与合理分割的偏差有助于估计潜在的像素级不确定性,以便进一步指导分割网络。因此,所提出的方法使用从我们的表示进行的单次推理来估计不确定性,从而减少了总计算量。我们在两个公开可用的分割数据集上评估了我们的方法,一个是心脏磁共振成像中心房的数据集,另一个是腹部计算机断层扫描中多个器官的数据集。在两个常用的评估指标方面,我们的解剖学感知方法比当前最先进的半监督方法提高了分割精度。