IEEE Trans Image Process. 2021;30:9429-9441. doi: 10.1109/TIP.2021.3125490. Epub 2021 Nov 16.
Accurate coronary lumen segmentation on coronary-computed tomography angiography (CCTA) images is crucial for quantification of coronary stenosis and the subsequent computation of fractional flow reserve. Many factors including difficulty in labeling coronary lumens, various morphologies in stenotic lesions, thin structures and small volume ratio with respect to the imaging field complicate the task. In this work, we fused the continuity topological information of centerlines which are easily accessible, and proposed a novel weakly supervised model, Examinee-Examiner Network (EE-Net), to overcome the challenges in automatic coronary lumen segmentation. First, the EE-Net was proposed to address the fracture in segmentation caused by stenoses by combining the semantic features of lumens and the geometric constraints of continuous topology obtained from the centerlines. Then, a Centerline Gaussian Mask Module was proposed to deal with the insensitiveness of the network to the centerlines. Subsequently, a weakly supervised learning strategy, Examinee-Examiner Learning, was proposed to handle the weakly supervised situation with few lumen labels by using our EE-Net to guide and constrain the segmentation with customized prior conditions. Finally, a general network layer, Drop Output Layer, was proposed to adapt to the class imbalance by dropping well-segmented regions and weights the classes dynamically. Extensive experiments on two different data sets demonstrated that our EE-Net has good continuity and generalization ability on coronary lumen segmentation task compared with several widely used CNNs such as 3D-UNet. The results revealed our EE-Net with great potential for achieving accurate coronary lumen segmentation in patients with coronary artery disease. Code at http://github.com/qiyaolei/Examinee-Examiner-Network.
准确的冠状动脉管腔分割是冠状动脉计算机断层血管造影(CCTA)图像分析的关键,这对于冠状动脉狭窄的定量评估和随后计算血流储备分数至关重要。许多因素增加了冠状动脉管腔自动分割的难度,包括冠状动脉管腔难以标记、狭窄病变的多种形态、管腔较细、相对于成像视野的体积比小等。在这项工作中,我们融合了易于获取的中心线的拓扑连续性信息,并提出了一种新的弱监督模型,名为考生-考官网络(EE-Net),以克服自动冠状动脉管腔分割中的挑战。首先,EE-Net 被提出用于解决由狭窄引起的分割断裂问题,通过将管腔的语义特征与中心线获得的连续拓扑的几何约束相结合。然后,提出了中心线高斯掩模模块来解决网络对中心线不敏感的问题。随后,提出了一种弱监督学习策略,考生-考官学习,通过使用我们的 EE-Net 来指导和约束分割,并使用定制的先验条件,利用少量的管腔标签来处理弱监督情况。最后,提出了一个通用的网络层,丢弃输出层,通过丢弃分割良好的区域和动态加权类来适应类不平衡。在两个不同的数据集上的广泛实验表明,与 3D-UNet 等几个广泛使用的 CNN 相比,我们的 EE-Net 在冠状动脉管腔分割任务上具有更好的连续性和泛化能力。结果表明,我们的 EE-Net 在实现冠心病患者的冠状动脉管腔准确分割方面具有很大的潜力。代码位于 http://github.com/qiyaolei/Examinee-Examiner-Network。