Department of Ophthalmology, Seoul National University College of Medicine, Seoul, Korea.
Department of Ophthalmology, Jeju National University Hospital, Jeju-si, Korea.
PLoS One. 2020 Oct 1;15(10):e0239913. doi: 10.1371/journal.pone.0239913. eCollection 2020.
Optic-disc photography (ODP) has proven to be very useful for optic nerve evaluation in glaucoma. In real clinical practice, however, limited patient cooperation, small pupils, or media opacities can limit the performance of ODP. The purpose of this study was to propose a deep-learning approach for increased resolution and improved legibility of ODP by contrast, color, and brightness compensation. Each high-resolution original ODP was transformed into two counterparts: (1) down-scaled 'low-resolution ODPs', and (2) 'compensated high-resolution ODPs' produced via enhancement of the visibility of the optic disc margin and surrounding retinal vessels using a customized image post-processing algorithm. Then, the differences between these two counterparts were directly learned through a super-resolution generative adversarial network (SR-GAN). Finally, by inputting the high-resolution ODPs into SR-GAN, 4-times-up-scaled and overall-color-and-brightness-transformed 'enhanced ODPs' could be obtained. General ophthalmologists were instructed (1) to assess each ODP's image quality, and (2) to note any abnormal findings, at 1-month intervals. The image quality score for the enhanced ODPs was significantly higher than that for the original ODP, and the overall optic disc hemorrhage (DH)-detection accuracy was significantly higher with the enhanced ODPs. We expect that this novel deep-learning approach will be applied to various types of ophthalmic images.
眼底照相(ODP)已被证明在青光眼视神经评估中非常有用。然而,在实际临床实践中,由于患者配合度有限、瞳孔较小或介质混浊,ODP 的性能可能会受限。本研究旨在提出一种深度学习方法,通过对比度、颜色和亮度补偿来提高 ODP 的分辨率和清晰度。每个高分辨率原始 ODP 都转换为两个副本:(1)降采样的“低分辨率 ODP”,以及(2)通过使用定制的图像后处理算法增强视盘边缘和周围视网膜血管的可视性而生成的“补偿高分辨率 ODP”。然后,通过超分辨率生成对抗网络(SR-GAN)直接学习这两个副本之间的差异。最后,通过将高分辨率 ODP 输入到 SR-GAN 中,可以获得 4 倍放大和整体颜色和亮度变换的“增强 ODP”。普通眼科医生被指示(1)评估每个 ODP 的图像质量,(2)在 1 个月的间隔内注意任何异常发现。增强 ODP 的图像质量评分明显高于原始 ODP,增强 ODP 的总体视盘出血(DH)检测准确率也明显更高。我们期望这种新的深度学习方法将应用于各种类型的眼科图像。