Tan Yubo, Yang Kai-Fu, Zhao Shi-Xuan, Li Yong-Jie
IEEE Trans Med Imaging. 2022 Sep;41(9):2238-2251. doi: 10.1109/TMI.2022.3161681. Epub 2022 Aug 31.
The morphology of retinal vessels is closely associated with many kinds of ophthalmic diseases. Although huge progress in retinal vessel segmentation has been achieved with the advancement of deep learning, some challenging issues remain. For example, vessels can be disturbed or covered by other components presented in the retina (such as optic disc or lesions). Moreover, some thin vessels are also easily missed by current methods. In addition, existing fundus image datasets are generally tiny, due to the difficulty of vessel labeling. In this work, a new network called SkelCon is proposed to deal with these problems by introducing skeletal prior and contrastive loss. A skeleton fitting module is developed to preserve the morphology of the vessels and improve the completeness and continuity of thin vessels. A contrastive loss is employed to enhance the discrimination between vessels and background. In addition, a new data augmentation method is proposed to enrich the training samples and improve the robustness of the proposed model. Extensive validations were performed on several popular datasets (DRIVE, STARE, CHASE, and HRF), recently developed datasets (UoA-DR, IOSTAR, and RC-SLO), and some challenging clinical images (from RFMiD and JSIEC39 datasets). In addition, some specially designed metrics for vessel segmentation, including connectivity, overlapping area, consistency of vessel length, revised sensitivity, specificity, and accuracy were used for quantitative evaluation. The experimental results show that, the proposed model achieves state-of-the-art performance and significantly outperforms compared methods when extracting thin vessels in the regions of lesions or optic disc. Source code is available at https://www.github.com/tyb311/SkelCon.
视网膜血管的形态与多种眼科疾病密切相关。尽管随着深度学习的发展,视网膜血管分割已取得巨大进展,但仍存在一些具有挑战性的问题。例如,血管可能会被视网膜中出现的其他成分(如视盘或病变)干扰或覆盖。此外,一些细血管也很容易被当前方法遗漏。此外,由于血管标注困难,现有的眼底图像数据集通常很小。在这项工作中,提出了一种名为SkelCon的新网络,通过引入骨骼先验和对比损失来处理这些问题。开发了一个骨骼拟合模块来保留血管的形态,提高细血管的完整性和连续性。采用对比损失来增强血管与背景之间的区分度。此外,还提出了一种新的数据增强方法来丰富训练样本,提高所提模型的鲁棒性。在几个流行的数据集(DRIVE、STARE、CHASE和HRF)、最近开发的数据集(UoA-DR、IOSTAR和RC-SLO)以及一些具有挑战性的临床图像(来自RFMiD和JSIEC39数据集)上进行了广泛的验证。此外,还使用了一些专门为血管分割设计的指标,包括连通性、重叠面积、血管长度一致性、修正的敏感性、特异性和准确性进行定量评估。实验结果表明,所提模型在病变区域或视盘区域提取细血管时达到了当前最优性能,并且明显优于对比方法。源代码可在https://www.github.com/tyb311/SkelCon获取。