Meng Yanda, Zhang Hongrun, Zhao Yitian, Gao Dongxu, Hamill Barbra, Patri Godhuli, Peto Tunde, Madhusudhan Savita, Zheng Yalin
IEEE Trans Med Imaging. 2023 Feb;42(2):416-429. doi: 10.1109/TMI.2022.3203318. Epub 2023 Feb 2.
Glaucoma is a progressive eye disease that results in permanent vision loss, and the vertical cup to disc ratio (vCDR) in colour fundus images is essential in glaucoma screening and assessment. Previous fully supervised convolution neural networks segment the optic disc (OD) and optic cup (OC) from color fundus images and then calculate the vCDR offline. However, they rely on a large set of labeled masks for training, which is expensive and time-consuming to acquire. To address this, we propose a weakly and semi-supervised graph-based network that investigates geometric associations and domain knowledge between segmentation probability maps (PM), modified signed distance function representations (mSDF), and boundary region of interest characteristics (B-ROI) in three aspects. Firstly, we propose a novel Dual Adaptive Graph Convolutional Network (DAGCN) to reason the long-range features of the PM and the mSDF w.r.t. the regional uniformity. Secondly, we propose a dual consistency regularization-based semi-supervised learning paradigm. The regional consistency between the PM and the mSDF, and the marginal consistency between the derived B-ROI from each of them boost the proposed model's performance due to the inherent geometric associations. Thirdly, we exploit the task-specific domain knowledge via the oval shapes of OD & OC, where a differentiable vCDR estimating layer is proposed. Furthermore, without additional annotations, the supervision on vCDR serves as weakly-supervisions for segmentation tasks. Experiments on six large-scale datasets demonstrate our model's superior performance on OD & OC segmentation and vCDR estimation. The implementation code has been made available.https://github.com/smallmax00/Dual_Adaptive_Graph_Reasoning.
青光眼是一种会导致永久性视力丧失的进行性眼病,彩色眼底图像中的垂直杯盘比(vCDR)在青光眼筛查和评估中至关重要。以往的全监督卷积神经网络从彩色眼底图像中分割出视盘(OD)和视杯(OC),然后离线计算vCDR。然而,它们依赖大量带标签的掩码进行训练,获取这些掩码既昂贵又耗时。为了解决这个问题,我们提出了一种基于弱监督和半监督的图网络,该网络从三个方面研究分割概率图(PM)、修正符号距离函数表示(mSDF)和感兴趣边界区域特征(B-ROI)之间的几何关联和领域知识。首先,我们提出了一种新颖的双自适应图卷积网络(DAGCN),以推断PM和mSDF关于区域均匀性的长程特征。其次,我们提出了一种基于双一致性正则化的半监督学习范式。由于固有的几何关联,PM和mSDF之间的区域一致性以及从它们各自导出的B-ROI之间的边缘一致性提高了所提出模型的性能。第三,我们通过OD和OC的椭圆形利用特定任务的领域知识,在此提出了一个可微的vCDR估计层。此外,在没有额外注释的情况下,对vCDR的监督作为分割任务的弱监督。在六个大规模数据集上的实验证明了我们的模型在OD和OC分割以及vCDR估计方面的优越性能。实现代码已公开。https://github.com/smallmax00/Dual_Adaptive_Graph_Reasoning