IEEE J Biomed Health Inform. 2024 Sep;28(9):5410-5421. doi: 10.1109/JBHI.2024.3409382. Epub 2024 Sep 5.
Delineating 3D blood vessels of various anatomical structures is essential for clinical diagnosis and treatment, however, is challenging due to complex structure variations and varied imaging conditions. Although recent supervised deep learning models have demonstrated their superior capacity in automatic 3D vessel segmentation, the reliance on expensive 3D manual annotations and limited capacity for annotation reuse among different vascular structures hinder their clinical applications. To avoid the repetitive and costly annotating process for each vascular structure and make full use of existing annotations, this paper proposes a novel 3D shape-guided local discrimination (3D-SLD) model for 3D vascular segmentation under limited guidance from public 2D vessel annotations. The primary hypothesis is that 3D vessels are composed of semantically similar voxels and often exhibit tree-shaped morphology. Accordingly, the 3D region discrimination loss is firstly proposed to learn the discriminative representation measuring voxel-wise similarities and cluster semantically consistent voxels to form the candidate 3D vascular segmentation in unlabeled images. Secondly, the shape distribution from existing 2D structure-agnostic vessel annotations is introduced to guide the 3D vessels with the tree-shaped morphology by the adversarial shape constraint loss. Thirdly, to enhance training stability and prediction credibility, the highlighting-reviewing-summarizing (HRS) mechanism is proposed. This mechanism involves summarizing historical models to maintain temporal consistency and identifying credible pseudo labels as reliable supervision signals. Only guided by public 2D coronary artery annotations, our method achieves results comparable to SOTA barely-supervised methods in 3D cerebrovascular segmentation, and the best DSC in 3D hepatic vessel segmentation, demonstrating the effectiveness of our method.
描绘各种解剖结构的三维血管对于临床诊断和治疗至关重要,但由于结构变化复杂和成像条件多样,这一任务具有挑战性。尽管最近的监督深度学习模型在自动三维血管分割方面表现出了卓越的能力,但它们依赖于昂贵的三维手动标注,并且在不同血管结构之间的标注复用能力有限,这限制了它们的临床应用。为了避免对每个血管结构进行重复且昂贵的标注过程,并充分利用现有的标注,本文提出了一种新颖的三维形状引导局部判别(3D-SLD)模型,用于在公共二维血管标注的有限指导下进行三维血管分割。主要假设是三维血管由语义相似的体素组成,并且通常呈现树状形态。因此,首先提出三维区域判别损失,以学习用于测量体素间相似性的判别表示,并将语义一致的体素聚类为候选三维血管分割,以在未标注图像中形成。其次,通过对抗形状约束损失,引入现有的二维结构无偏血管标注的形状分布来引导具有树状形态的三维血管。第三,为了增强训练稳定性和预测可信度,提出了突出-回顾-总结(HRS)机制。该机制涉及总结历史模型以保持时间一致性,并识别可信的伪标签作为可靠的监督信号。仅在公共二维冠状动脉标注的指导下,我们的方法在三维脑血管分割方面的结果可与几乎无监督方法的 SOTA 相媲美,并且在三维肝血管分割方面取得了最佳的 DSC,证明了我们方法的有效性。