Nihalaani Rachaell, Kataria Tushar, Adams Jadie, Elhabian Shireen Y
Kahlert School of Computing, University of Utah, Salt Lake City, USA.
Scientific Computing and Imaging Institute, University of Utah, Salt Lake City, USA.
Med Image Comput Comput Assist Interv. 2024 Oct;15010:273-285. doi: 10.1007/978-3-031-72117-5_26. Epub 2024 Oct 3.
Supervised methods for 3D anatomy segmentation demonstrate superior performance but are often limited by the availability of annotated data. This limitation has led to a growing interest in self-supervised approaches in tandem with the abundance of available unannotated data. Slice propagation has emerged as a self-supervised approach that leverages slice registration as a self-supervised task to achieve full anatomy segmentation with minimal supervision. This approach significantly reduces the need for domain expertise, time, and the cost associated with building fully annotated datasets required for training segmentation networks. However, this shift toward reduced supervision via deterministic networks raises concerns about the trustworthiness and reliability of predictions, especially when compared with more accurate supervised approaches. To address this concern, we propose integrating calibrated uncertainty quantification (UQ) into slice propagation methods, which would provide insights into the model's predictive reliability and confidence levels. Incorporating uncertainty measures enhances user confidence in self-supervised approaches, thereby improving their practical applicability. We conducted experiments on three datasets for 3D abdominal segmentation using five UQ methods. The results illustrate that incorporating UQ improves not only model trustworthiness but also segmentation accuracy. Furthermore, our analysis reveals various failure modes of slice propagation methods that might not be immediately apparent to end-users. This study opens up new research avenues to improve the accuracy and trustworthiness of slice propagation methods.
用于三维解剖分割的监督方法表现出卓越的性能,但往往受到标注数据可用性的限制。这种限制使得人们对自监督方法的兴趣日益浓厚,与此同时,可用的未标注数据也大量存在。切片传播已成为一种自监督方法,它将切片配准作为自监督任务,以在最少监督的情况下实现完整的解剖分割。这种方法显著减少了对领域专业知识、时间以及构建训练分割网络所需的完全标注数据集相关成本的需求。然而,这种通过确定性网络减少监督的转变引发了对预测的可信度和可靠性的担忧,特别是与更精确的监督方法相比时。为了解决这一问题,我们建议将校准后的不确定性量化(UQ)集成到切片传播方法中,这将深入了解模型的预测可靠性和置信水平。纳入不确定性度量可增强用户对自监督方法的信心,从而提高其实际适用性。我们使用五种UQ方法在三个用于三维腹部分割的数据集上进行了实验。结果表明,纳入UQ不仅提高了模型的可信度,还提高了分割精度。此外,我们的分析揭示了切片传播方法的各种故障模式,这些模式可能对最终用户来说并不立即明显。这项研究开辟了新的研究途径,以提高切片传播方法的准确性和可信度。