Lu Li, Ren Peifang, Tang Xuyuan, Yang Ming, Yuan Minjie, Yu Wangshu, Huang Jiani, Zhou Enliang, Lu Lixian, He Qin, Zhu Miaomiao, Ke Genjie, Han Wei
Department of Ophthalmology, Eye Center of the Second Affiliated Hospital, School of Medicine, Zhejiang University, Hangzhou, China.
Department of Ophthalmology, The First Affiliated Hospital, School of Medicine, Zhejiang University, Hangzhou, China.
Front Cell Dev Biol. 2021 Oct 15;9:719262. doi: 10.3389/fcell.2021.719262. eCollection 2021.
Pathologic myopia (PM) associated with myopic maculopathy (MM) and "Plus" lesions is a major cause of irreversible visual impairment worldwide. Therefore, we aimed to develop a series of deep learning algorithms and artificial intelligence (AI)-models for automatic PM identification, MM classification, and "Plus" lesion detection based on retinal fundus images. Consecutive 37,659 retinal fundus images from 32,419 patients were collected. After excluding 5,649 ungradable images, a total dataset of 32,010 color retinal fundus images was manually graded for training and cross-validation according to the META-PM classification. We also retrospectively recruited 1,000 images from 732 patients from the three other hospitals in Zhejiang Province, serving as the external validation dataset. The area under the receiver operating characteristic curve (AUC), sensitivity, specificity, accuracy, and quadratic-weighted kappa score were calculated to evaluate the classification algorithms. The precision, recall, and F1-score were calculated to evaluate the object detection algorithms. The performance of all the algorithms was compared with the experts' performance. To better understand the algorithms and clarify the direction of optimization, misclassification and visualization heatmap analyses were performed. In five-fold cross-validation, algorithm I achieved robust performance, with accuracy = 97.36% (95% CI: 0.9697, 0.9775), AUC = 0.995 (95% CI: 0.9933, 0.9967), sensitivity = 93.92% (95% CI: 0.9333, 0.9451), and specificity = 98.19% (95% CI: 0.9787, 0.9852). The macro-AUC, accuracy, and quadratic-weighted kappa were 0.979, 96.74% (95% CI: 0.963, 0.9718), and 0.988 (95% CI: 0.986, 0.990) for algorithm II. Algorithm III achieved an accuracy of 0.9703 to 0.9941 for classifying the "Plus" lesions and an F1-score of 0.6855 to 0.8890 for detecting and localizing lesions. The performance metrics in external validation dataset were comparable to those of the experts and were slightly inferior to those of cross-validation. Our algorithms and AI-models were confirmed to achieve robust performance in real-world conditions. The application of our algorithms and AI-models has promise for facilitating clinical diagnosis and healthcare screening for PM on a large scale.
病理性近视(PM)合并近视性黄斑病变(MM)及“加”征病变是全球不可逆视力损害的主要原因。因此,我们旨在基于视网膜眼底图像开发一系列深度学习算法和人工智能(AI)模型,用于自动识别病理性近视、对近视性黄斑病变进行分类以及检测“加”征病变。收集了来自32419例患者的连续37659张视网膜眼底图像。在排除5649张无法分级的图像后,根据META-PM分类对总共32010张彩色视网膜眼底图像数据集进行人工分级,用于训练和交叉验证。我们还回顾性地从浙江省其他三家医院的732例患者中招募了1000张图像,作为外部验证数据集。计算受试者操作特征曲线下面积(AUC)、敏感性、特异性、准确性和二次加权kappa评分,以评估分类算法。计算精确率、召回率和F1分数,以评估目标检测算法。将所有算法的性能与专家的性能进行比较。为了更好地理解算法并明确优化方向,进行了错误分类和可视化热图分析。在五折交叉验证中,算法I表现出稳健的性能,准确性 = 97.36%(95%CI:0.9697,0.9775),AUC = 0.995(95%CI:0.9933,0.9967),敏感性 = 93.92%(95%CI:0.9333,),特异性 = 98.19%(95%CI:0.9787,0.9852)。算法II的宏AUC、准确性和二次加权kappa分别为0.979、96.74%(95%CI:0.963,0.9718)和0.988(95%CI:0.986,0.990)。算法III对“加”征病变分类的准确性为0.9703至0.9941,检测和定位病变的F1分数为0.6855至0.8890。外部验证数据集中的性能指标与专家的相当,略逊于交叉验证的指标。我们的算法和AI模型在实际条件下被证实具有稳健的性能。我们的算法和AI模型的应用有望促进病理性近视的临床诊断和大规模医疗筛查。