Department of Ophthalmology, Kim's Eye Hospital, Seoul, South Korea.
Kim's Eye Hospital Data Center, Seoul, South Korea.
PLoS One. 2024 Oct 30;19(10):e0310097. doi: 10.1371/journal.pone.0310097. eCollection 2024.
To establish a deep learning artificial intelligence model to predict the risk of long-term fellow eye neovascularization in unilateral type 3 macular neovascularization (MNV).
This retrospective study included 217 patients (199 in the training/validation of the AI model and 18 in the testing set) with a diagnosis of unilateral type 3 MNV. The purpose of the AI model was to predict fellow eye neovascularization within 24 months after the initial diagnosis. The data used to train the AI model included a baseline fundus image and horizontal/vertical cross-hair scan optical coherence tomography images in the fellow eye. The neural network of this study for AI-learning was based on the visual geometry group with modification. The precision, recall, accuracy, and the area under the curve values of receiver operating characteristics (AUCROC) were calculated for the AI model. The accuracy of an experienced (examiner 1) and less experienced (examiner 2) human examiner was also evaluated.
The incidence of fellow eye neovascularization over 24 months was 28.6% in the training/validation set and 38.9% in the testing set (P = 0.361). In the AI model, precision was 0.562, recall was 0.714, accuracy was 0.667, and the AUCROC was 0.675. The sensitivity, specificity, and accuracy were 0.429, 0.727, and 0.611, respectively, for examiner 1, and 0.143, 0.636, and 0.444, respectively, for examiner 2.
This is the first AI study focusing on the clinical course of type 3 MNV. While our AI model exhibited accuracy comparable to that of human examiners, overall accuracy was not high. This may partly be a result of the relatively small number of patients used for AI training, suggesting the need for future multi-center studies to improve the accuracy of the model.
建立深度学习人工智能模型,以预测单侧 3 型黄斑新生血管(MNV)患者的长期对侧眼新生血管风险。
本回顾性研究纳入了 217 名(199 名用于 AI 模型的训练/验证,18 名用于测试集)单侧 3 型 MNV 患者。AI 模型的目的是预测初次诊断后 24 个月内对侧眼的新生血管。用于 AI 模型训练的数据包括基线眼底图像和对侧眼水平/垂直十字线扫描光学相干断层扫描图像。本研究的 AI 学习神经网络基于视觉几何组并进行了修改。计算了 AI 模型的精度、召回率、准确性和受试者工作特征曲线下面积(AUCROC)值。还评估了经验丰富(检查者 1)和经验较少(检查者 2)的人类检查者的准确性。
训练/验证集和测试集中 24 个月时对侧眼新生血管的发生率分别为 28.6%和 38.9%(P=0.361)。在 AI 模型中,精度为 0.562,召回率为 0.714,准确性为 0.667,AUCROC 为 0.675。检查者 1 的灵敏度、特异性和准确性分别为 0.429、0.727 和 0.611,检查者 2 分别为 0.143、0.636 和 0.444。
这是第一项专注于 3 型 MNV 临床病程的 AI 研究。虽然我们的 AI 模型表现出与人类检查者相当的准确性,但总体准确性不高。这可能部分是由于用于 AI 训练的患者数量相对较少所致,表明需要进行未来的多中心研究以提高模型的准确性。