Department of Ophthalmology, College of Medicine, National Taiwan University, Taipei, Taiwan.
Graduate Institute of Clinical Medicine, College of Medicine, National Taiwan University, Taipei, Taiwan.
J Digit Imaging. 2021 Aug;34(4):948-958. doi: 10.1007/s10278-021-00479-6. Epub 2021 Jul 9.
The purpose of this study was to detect the presence of retinitis pigmentosa (RP) based on color fundus photographs using a deep learning model. A total of 1670 color fundus photographs from the Taiwan inherited retinal degeneration project and National Taiwan University Hospital were acquired and preprocessed. The fundus photographs were labeled RP or normal and divided into training and validation datasets (n = 1284) and a test dataset (n = 386). Three transfer learning models based on pre-trained Inception V3, Inception Resnet V2, and Xception deep learning architectures, respectively, were developed to classify the presence of RP on fundus images. The model sensitivity, specificity, and area under the receiver operating characteristic (AUROC) curve were compared. The results from the best transfer learning model were compared with the reading results of two general ophthalmologists, one retinal specialist, and one specialist in retina and inherited retinal degenerations. A total of 935 RP and 324 normal images were used to train the models. The test dataset consisted of 193 RP and 193 normal images. Among the three transfer learning models evaluated, the Xception model had the best performance, achieving an AUROC of 96.74%. Gradient-weighted class activation mapping indicated that the contrast between the periphery and the macula on fundus photographs was an important feature in detecting RP. False-positive results were mostly obtained in cases of high myopia with highly tessellated retina, and false-negative results were mostly obtained in cases of unclear media, such as cataract, that led to a decrease in the contrast between the peripheral retina and the macula. Our model demonstrated the highest accuracy of 96.00%, which was comparable with the average results of 81.50%, of the other four ophthalmologists. Moreover, the accuracy was obtained at the same level of sensitivity (95.71%), as compared to an inherited retinal disease specialist. RP is an important disease, but its early and precise diagnosis is challenging. We developed and evaluated a transfer-learning-based model to detect RP from color fundus photographs. The results of this study validate the utility of deep learning in automating the identification of RP from fundus photographs.
本研究旨在通过深度学习模型从眼底彩色照片中检测视网膜色素变性(RP)的存在。共获取并预处理了来自台湾遗传性视网膜变性项目和台湾大学医院的 1670 张眼底彩色照片。这些眼底照片被标记为 RP 或正常,并分为训练和验证数据集(n=1284)和测试数据集(n=386)。分别基于预训练的 Inception V3、Inception Resnet V2 和 Xception 深度学习架构开发了三个迁移学习模型,以对眼底图像中 RP 的存在进行分类。比较了模型的灵敏度、特异性和受试者工作特征曲线下面积(AUROC)。将最佳迁移学习模型的结果与两名普通眼科医生、一名视网膜专家和一名视网膜和遗传性视网膜变性专家的阅读结果进行了比较。共有 935 张 RP 和 324 张正常图像用于训练模型。测试数据集由 193 张 RP 和 193 张正常图像组成。在评估的三个迁移学习模型中,Xception 模型的性能最佳,AUROC 为 96.74%。梯度加权类激活映射表明,眼底照片中外周与黄斑之间的对比度是检测 RP 的一个重要特征。假阳性结果主要出现在高度格子状视网膜的高度近视病例中,而假阴性结果主要出现在白内障等导致周边视网膜与黄斑之间对比度降低的不清晰介质病例中。我们的模型显示出最高的准确性为 96.00%,与其他四名眼科医生的平均结果 81.50%相当。此外,与遗传性视网膜疾病专家相比,该模型的准确性在相同的灵敏度水平(95.71%)下获得。RP 是一种重要的疾病,但早期和准确的诊断具有挑战性。我们开发并评估了一种基于迁移学习的模型,用于从眼底彩色照片中检测 RP。本研究的结果验证了深度学习在自动化识别眼底照片中的 RP 方面的实用性。