Department of Computer Science and Information Engineering, National Chung Cheng University, Chiayi Taiwan.
Department of Ophthalmology, Taipei Veterans General Hospital, Taipei, Taiwan.
Transl Vis Sci Technol. 2022 Feb 1;11(2):6. doi: 10.1167/tvst.11.2.6.
To differentiate polypoidal choroidal vasculopathy (PCV) from choroidal neovascularization (CNV) and to determine the extent of PCV from fluorescein angiography (FA) using attention-based deep learning networks.
We build two deep learning networks for diagnosis of PCV using FA, one for detection and one for segmentation. Attention-gated convolutional neural network (AG-CNN) differentiates PCV from other types of wet age-related macular degeneration. Gradient-weighted class activation map (Grad-CAM) is generated to highlight important regions in the image for making the prediction, which offers explainability of the network. Attention-gated recurrent neural network (AG-PCVNet) for spatiotemporal prediction is applied for segmentation of PCV.
AG-CNN is validated with a dataset containing 167 FA sequences of PCV and 70 FA sequences of CNV. AG-CNN achieves a classification accuracy of 82.80% at image-level, and 86.21% at patient-level for PCV. Grad-CAM shows that regions contributing to decision-making have on average 21.91% agreement with pathological regions identified by experts. AG-PCVNet is validated with 56 PCV sequences from the EVEREST-I study and achieves a balanced accuracy of 81.132% and dice score of 0.54.
The developed software provides a means of performing detection and segmentation of PCV on FA images for the first time. This study is a promising step in changing the diagnostic procedure of PCV and therefore improving the detection rate of PCV using FA alone.
The developed deep learning system enables early diagnosis of PCV using FA to assist the physician in choosing the best treatment for optimal visual prognosis.
利用基于注意力的深度学习网络,从荧光素血管造影(FA)中区分息肉样脉络膜血管病变(PCV)和脉络膜新生血管(CNV),并确定 PCV 的程度。
我们构建了两个使用 FA 诊断 PCV 的深度学习网络,一个用于检测,一个用于分割。注意力门控卷积神经网络(AG-CNN)将 PCV 与其他类型的湿性年龄相关性黄斑变性区分开来。生成梯度加权类激活图(Grad-CAM),突出图像中重要的预测区域,从而提供网络的可解释性。应用注意力门控循环神经网络(AG-PCVNet)进行时空预测,对 PCV 进行分割。
AG-CNN 在包含 167 例 PCV 和 70 例 CNV 的 FA 序列数据集上进行了验证。AG-CNN 在图像级别上的分类准确率为 82.80%,在患者级别上的准确率为 86.21%,用于 PCV。Grad-CAM 表明,对决策有贡献的区域与专家确定的病理区域的平均一致性为 21.91%。AG-PCVNet 在 EVEREST-I 研究中的 56 例 PCV 序列上进行了验证,其平衡准确率为 81.132%,骰子分数为 0.54。
所开发的软件首次提供了在 FA 图像上对 PCV 进行检测和分割的方法。这项研究是改变 PCV 诊断程序的一个有前途的步骤,因此可以提高仅使用 FA 检测 PCV 的检出率。
所开发的深度学习系统能够使用 FA 对 PCV 进行早期诊断,以帮助医生选择最佳治疗方案,获得最佳的视觉预后。