IEEE Trans Med Imaging. 2019 Dec;38(12):2755-2767. doi: 10.1109/TMI.2019.2913311. Epub 2019 Apr 25.
Detecting acoustic shadows in ultrasound images is important in many clinical and engineering applications. Real-time feedback of acoustic shadows can guide sonographers to a standardized diagnostic viewing plane with minimal artifacts and can provide additional information for other automatic image analysis algorithms. However, automatically detecting shadow regions using learning-based algorithms is challenging because pixel-wise ground truth annotation of acoustic shadows is subjective and time consuming. In this paper, we propose a weakly supervised method for automatic confidence estimation of acoustic shadow regions. Our method is able to generate a dense shadow-focused confidence map. In our method, a shadow-seg module is built to learn general shadow features for shadow segmentation, based on global image-level annotations as well as a small number of coarse pixel-wise shadow annotations. A transfer function is introduced to extend the obtained binary shadow segmentation to a reference confidence map. In addition, a confidence estimation network is proposed to learn the mapping between input images and the reference confidence maps. This network is able to predict shadow confidence maps directly from input images during inference. We use evaluation metrics such as DICE, inter-class correlation, and so on, to verify the effectiveness of our method. Our method is more consistent than human annotation and outperforms the state-of-the-art quantitatively in shadow segmentation and qualitatively in confidence estimation of shadow regions. Furthermore, we demonstrate the applicability of our method by integrating shadow confidence maps into tasks such as ultrasound image classification, multi-view image fusion, and automated biometric measurements.
在许多临床和工程应用中,检测超声图像中的声影是很重要的。声影的实时反馈可以指导超声医师以最小伪影达到标准化的诊断观察平面,并为其他自动图像分析算法提供附加信息。然而,使用基于学习的算法自动检测阴影区域具有挑战性,因为声影的逐像素地面实况注释是主观的且耗时的。在本文中,我们提出了一种用于自动估计声影区域置信度的弱监督方法。我们的方法能够生成密集的阴影聚焦置信度图。在我们的方法中,基于全局图像级注释以及少量粗粒度像素级阴影注释,构建了一个阴影分割模块来学习用于阴影分割的通用阴影特征。引入了一个转移函数将获得的二进制阴影分割扩展到参考置信图。此外,提出了一个置信度估计网络,以学习输入图像与参考置信图之间的映射。在推理过程中,该网络能够直接从输入图像预测阴影置信度图。我们使用 DICE、类间相关等评估指标来验证我们方法的有效性。我们的方法比人工注释更一致,并且在阴影分割方面的定量表现优于最先进的方法,在阴影区域置信度估计方面的定性表现也优于最先进的方法。此外,我们通过将阴影置信度图集成到超声图像分类、多视图图像融合和自动生物特征测量等任务中,展示了我们方法的适用性。