College of Intelligence Science and Technology, National University of Defense Technology, No. 109 Deya Road, Changsha, Hunan 410073, China.
Department of Computer Science, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599-3175, USA.
Med Image Anal. 2022 Nov;82:102626. doi: 10.1016/j.media.2022.102626. Epub 2022 Sep 24.
Semantic instance segmentation is crucial for many medical image analysis applications, including computational pathology and automated radiation therapy. Existing methods for this task can be roughly classified into two categories: (1) proposal-based methods and (2) proposal-free methods. However, in medical images, the irregular shape-variations and crowding instances (e.g., nuclei and cells) make it hard for the proposal-based methods to achieve robust instance localization. On the other hand, ambiguous boundaries caused by the low-contrast nature of medical images (e.g., CT images) challenge the accuracy of the proposal-free methods. To tackle these issues, we propose a proposal-free segmentation network with discriminative deep supervision (DDS), which at the same time allows us to gain the power of the proposal-based method. The DDS module is interleaved with a carefully designed proposal-free segmentation backbone in our network. Consequently, the features learned by the backbone network become more sensitive to instance localization. Also, with the proposed DDS module, robust pixel-wise instance-level cues (especially structural information) are introduced for semantic segmentation. Extensive experiments on three datasets, i.e., a nuclei dataset, a pelvic CT image dataset, and a synthetic dataset, demonstrate the superior performance of the proposed algorithm compared to the previous works.
语义实例分割对于许多医学图像分析应用至关重要,包括计算病理学和自动放射治疗。用于此任务的现有方法大致可以分为两类:(1)基于提议的方法和(2)无提议的方法。然而,在医学图像中,不规则的形状变化和拥挤实例(例如,核和细胞)使得基于提议的方法难以实现稳健的实例定位。另一方面,医学图像的低对比度性质(例如 CT 图像)导致的边界不明确挑战了无提议方法的准确性。为了解决这些问题,我们提出了一种具有判别深度监督(DDS)的无提议分割网络,同时允许我们获得基于提议的方法的优势。DDS 模块与我们网络中精心设计的无提议分割骨干交错。因此,骨干网络学习的特征对实例定位变得更加敏感。此外,通过所提出的 DDS 模块,为语义分割引入了稳健的像素级实例级线索(特别是结构信息)。在三个数据集上的广泛实验,即核数据集、骨盆 CT 图像数据集和合成数据集,证明了所提出的算法相对于先前的工作具有优越的性能。