School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China.
Department of Cardiology, Ren Ji Hospital, School of Medicine, Shanghai Jiao Tong University, Shanghai 200127, China.
Neural Netw. 2020 Aug;128:172-187. doi: 10.1016/j.neunet.2020.05.005. Epub 2020 May 13.
Accurately segmenting contrast-filled vessels from X-ray coronary angiography (XCA) image sequence is an essential step for the diagnosis and therapy of coronary artery disease. However, developing automatic vessel segmentation is particularly challenging due to the overlapping structures, low contrast and the presence of complex and dynamic background artifacts in XCA images. This paper develops a novel encoder-decoder deep network architecture which exploits the several contextual frames of 2D+t sequential images in a sliding window centered at current frame to segment 2D vessel masks from the current frame. The architecture is equipped with temporal-spatial feature extraction in encoder stage, feature fusion in skip connection layers and channel attention mechanism in decoder stage. In the encoder stage, a series of 3D convolutional layers are employed to hierarchically extract temporal-spatial features. Skip connection layers subsequently fuse the temporal-spatial feature maps and deliver them to the corresponding decoder stages. To efficiently discriminate vessel features from the complex and noisy backgrounds in the XCA images, the decoder stage effectively utilizes channel attention blocks to refine the intermediate feature maps from skip connection layers for subsequently decoding the refined features in 2D ways to produce the segmented vessel masks. Furthermore, Dice loss function is implemented to train the proposed deep network in order to tackle the class imbalance problem in the XCA data due to the wide distribution of complex background artifacts. Extensive experiments by comparing our method with other state-of-the-art algorithms demonstrate the proposed method's superior performance over other methods in terms of the quantitative metrics and visual validation. To facilitate the reproductive research in XCA community, we publicly release our dataset and source codes at https://github.com/Binjie-Qin/SVS-net.
从 X 射线冠状动脉造影 (XCA) 图像序列中准确分割增强的血管是诊断和治疗冠状动脉疾病的重要步骤。然而,由于 XCA 图像中存在重叠结构、对比度低以及复杂和动态的背景伪影,开发自动血管分割特别具有挑战性。本文提出了一种新的编解码器深度网络架构,该架构利用 2D+t 时变图像序列的多个上下文帧,以滑动窗口的方式在当前帧的中心对当前帧的 2D 血管掩模进行分割。该架构在编码器阶段配备了时空特征提取,在跳跃连接层中进行特征融合,并在解码器阶段采用通道注意力机制。在编码器阶段,采用一系列 3D 卷积层对时空特征进行分层提取。跳跃连接层随后融合时空特征图,并将其传递到相应的解码器阶段。为了从 XCA 图像中复杂和嘈杂的背景中有效区分血管特征,解码器阶段有效地利用通道注意力块来细化来自跳跃连接层的中间特征图,以便随后以 2D 方式解码细化特征,生成分割的血管掩模。此外,为了解决 XCA 数据中由于复杂背景伪影分布广泛而导致的类别不平衡问题,实施了 Dice 损失函数来训练所提出的深度网络。通过与其他最先进的算法进行比较,对我们的方法进行了广泛的实验,结果表明,在所提出的方法在定量指标和视觉验证方面优于其他方法。为了促进 XCA 社区的重复性研究,我们在 https://github.com/Binjie-Qin/SVS-net 上公开了我们的数据集和源代码。