Hasan S M Kamrul, Linte Cristian A
Biomedical Modeling, Visualization and Image-guided Navigation (BiMVisIGN) Lab, RIT.
Center for Imaging Science, Rochester Institute of Technology, NY, USA.
Proc SPIE Int Soc Opt Eng. 2022 Feb-Mar;12034. doi: 10.1117/12.2612269. Epub 2022 Apr 4.
While deep learning has shown potential in solving a variety of medical image analysis problems including segmentation, registration, motion estimation, etc., their applications in the real-world clinical setting are still not affluent due to the lack of reliability caused by the failures of deep learning models in prediction. Furthermore, deep learning models need a large number of labeled datasets. In this work, we propose a novel method that incorporates uncertainty estimation to detect failures in the segmentation masks generated by CNNs. Our study further showcases the potential of our model to evaluate the correlation between the uncertainty and the segmentation errors for a given model. Furthermore, we introduce a multi-task cross-task learning consistency approach to enforce the correlation between the pixel-level (segmentation) and the geometric-level (distance map) tasks. Our extensive experimentation with varied quantities of labeled data in the training sets justifies the effectiveness of our model for the segmentation and uncertainty estimation of the left ventricle (LV), right ventricle (RV), and myocardium (Myo) at end-diastole (ED) and end-systole (ES) phases from cine MRI images available through the MICCAI 2017 ACDC Challenge Dataset. Our study serves as a proof-of-concept of how uncertainty measure correlates with the erroneous segmentation generated by different deep learning models, further showcasing the potential of our model to flag low-quality segmentation from a given model in our future study.
虽然深度学习在解决包括分割、配准、运动估计等各种医学图像分析问题方面已显示出潜力,但由于深度学习模型预测失败导致缺乏可靠性,其在实际临床环境中的应用仍然并不丰富。此外,深度学习模型需要大量的标记数据集。在这项工作中,我们提出了一种新颖的方法,该方法结合不确定性估计来检测由卷积神经网络(CNN)生成的分割掩码中的失败情况。我们的研究进一步展示了我们的模型在评估给定模型的不确定性与分割误差之间相关性方面的潜力。此外,我们引入了一种多任务跨任务学习一致性方法,以加强像素级(分割)和几何级(距离图)任务之间的相关性。我们在训练集中使用不同数量的标记数据进行了广泛的实验,证明了我们的模型对于通过MICCAI 2017 ACDC挑战数据集获得的心脏电影磁共振成像(cine MRI)图像在舒张末期(ED)和收缩末期(ES)阶段的左心室(LV)、右心室(RV)和心肌(Myo)的分割和不确定性估计的有效性。我们的研究作为一个概念验证,展示了不确定性度量如何与不同深度学习模型生成的错误分割相关联,进一步展示了我们的模型在未来研究中标记给定模型的低质量分割的潜力。