Xu Jianguo, Shen Jianxin, Wan Cheng, Jiang Qin, Yan Zhipeng, Yang Weihua
College of Mechanical and Electrical Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing, China.
College of Electronic and Information Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing, China.
Front Med (Lausanne). 2022 Mar 3;9:821565. doi: 10.3389/fmed.2022.821565. eCollection 2022.
The location of retinal vessels is an important prerequisite for Central Serous Chorioretinopathy (CSC) Laser Surgery, which does not only assist the ophthalmologist in marking the location of the leakage point (LP) on the fundus color image but also avoids the damage of the laser spot to the vessel tissue, as well as the low efficiency of the surgery caused by the absorption of laser energy by retinal vessels. In acquiring an excellent intra- and cross-domain adaptability, the existing deep learning (DL)-based vessel segmentation scheme must be driven by big data, which makes the densely annotated work tedious and costly.
This paper aims to explore a new vessel segmentation method with a few samples and annotations to alleviate the above problems. Firstly, a key solution is presented to transform the vessel segmentation scene into the few-shot learning task, which lays a foundation for the vessel segmentation task with a few samples and annotations. Then, we improve the existing few-shot learning framework as our baseline model to adapt to the vessel segmentation scenario. Next, the baseline model is upgraded from the following three aspects: (1) A multi-scale class prototype extraction technique is designed to obtain more sufficient vessel features for better utilizing the information from the support images; (2) The multi-scale vessel features of the query images, inferred by the support image class prototype information, are gradually fused to provide more effective guidance for the vessel extraction tasks; and (3) A multi-scale attention module is proposed to promote the consideration of the global information in the upgraded model to assist vessel localization. Concurrently, the integrated framework is further conceived to appropriately alleviate the low performance of a single model in the cross-domain vessel segmentation scene, enabling to boost the domain adaptabilities of both the baseline and the upgraded models.
Extensive experiments showed that the upgraded operation could further improve the performance of vessel segmentation significantly. Compared with the listed methods, both the baseline and the upgraded models achieved competitive results on the three public retinal image datasets (i.e., CHASE_DB, DRIVE, and STARE). In the practical application of private CSC datasets, the integrated scheme partially enhanced the domain adaptabilities of the two proposed models.
视网膜血管的位置是中心性浆液性脉络膜视网膜病变(CSC)激光手术的重要前提条件,这不仅有助于眼科医生在眼底彩色图像上标记渗漏点(LP)的位置,还能避免激光光斑对血管组织的损伤,以及视网膜血管吸收激光能量导致的手术效率低下。在获得出色的域内和跨域适应性方面,现有的基于深度学习(DL)的血管分割方案必须由大数据驱动,这使得密集标注工作繁琐且成本高昂。
本文旨在探索一种使用少量样本和标注的新血管分割方法,以缓解上述问题。首先,提出了一种关键解决方案,将血管分割场景转化为少样本学习任务,为少量样本和标注的血管分割任务奠定基础。然后,我们改进现有的少样本学习框架作为基线模型,以适应血管分割场景。接下来,从以下三个方面对基线模型进行升级:(1)设计多尺度类原型提取技术,以获取更充分的血管特征,从而更好地利用来自支持图像的信息;(2)由支持图像类原型信息推断出的查询图像的多尺度血管特征逐步融合,为血管提取任务提供更有效的指导;(3)提出多尺度注意力模块,以促进升级模型中对全局信息的考虑,辅助血管定位。同时,进一步构思集成框架,以适当缓解单个模型在跨域血管分割场景中的低性能问题,从而提高基线模型和升级模型的域适应性。
大量实验表明,升级操作可显著进一步提高血管分割性能。与所列方法相比,基线模型和升级模型在三个公共视网膜图像数据集(即CHASE_DB、DRIVE和STARE)上均取得了有竞争力的结果。在私有CSC数据集的实际应用中,集成方案部分提高了所提出的两个模型的域适应性。