Ningbo Key Laboratory of Medical Research on Blinding Eye Diseases, Ningbo Eye Institute, Ningbo Eye Hospital, Wenzhou Medical University, Ningbo 315040, China; National Clinical Research Center for Ocular Diseases, Eye Hospital, Wenzhou Medical University, Wenzhou 325027, China.
Ningbo Key Laboratory of Medical Research on Blinding Eye Diseases, Ningbo Eye Institute, Ningbo Eye Hospital, Wenzhou Medical University, Ningbo 315040, China; National Clinical Research Center for Ocular Diseases, Eye Hospital, Wenzhou Medical University, Wenzhou 325027, China.
J Biomed Inform. 2024 Sep;157:104722. doi: 10.1016/j.jbi.2024.104722. Epub 2024 Sep 5.
Keratitis is the primary cause of corneal blindness worldwide. Prompt identification and referral of patients with keratitis are fundamental measures to improve patient prognosis. Although deep learning can assist ophthalmologists in automatically detecting keratitis through a slit lamp camera, remote and underserved areas often lack this professional equipment. Smartphones, a widely available device, have recently been found to have potential in keratitis screening. However, given the limited data available from smartphones, employing traditional deep learning algorithms to construct a robust intelligent system presents a significant challenge. This study aimed to propose a meta-learning framework, cosine nearest centroid-based metric learning (CNCML), for developing a smartphone-based keratitis screening model in the case of insufficient smartphone data by leveraging the prior knowledge acquired from slit-lamp photographs.
We developed and assessed CNCML based on 13,009 slit-lamp photographs and 4,075 smartphone photographs that were obtained from 3 independent clinical centers. To mimic real-world scenarios with various degrees of sample scarcity, we used training sets of different sizes (0 to 20 photographs per class) from the HUAWEI smartphone to train CNCML. We evaluated the performance of CNCML not only on an internal test dataset but also on two external datasets that were collected by two different brands of smartphones (VIVO and XIAOMI) in another clinical center. Furthermore, we compared the performance of CNCML with that of traditional deep learning models on these smartphone datasets. The accuracy and macro-average area under the curve (macro-AUC) were utilized to evaluate the performance of models.
With merely 15 smartphone photographs per class used for training, CNCML reached accuracies of 84.59%, 83.15%, and 89.99% on three smartphone datasets, with corresponding macro-AUCs of 0.96, 0.95, and 0.98, respectively. The accuracies of CNCML on these datasets were 0.56% to 9.65% higher than those of the most competitive traditional deep learning models.
CNCML exhibited fast learning capabilities, attaining remarkable performance with a small number of training samples. This approach presents a potential solution for transitioning intelligent keratitis detection from professional devices (e.g., slit-lamp cameras) to more ubiquitous devices (e.g., smartphones), making keratitis screening more convenient and effective.
角膜炎是全球范围内导致角膜盲的主要原因。及时识别和转诊角膜炎患者是改善患者预后的基本措施。虽然深度学习可以帮助眼科医生通过裂隙灯相机自动检测角膜炎,但远程和服务不足的地区往往缺乏这种专业设备。智能手机作为一种广泛应用的设备,最近被发现具有角膜病筛查的潜力。然而,由于智能手机的数据有限,采用传统的深度学习算法来构建稳健的智能系统是一个巨大的挑战。本研究旨在提出一种基于元学习的框架,余弦最近质心度量学习(CNCML),以在智能手机数据不足的情况下,利用从裂隙灯照片中获得的先验知识,开发基于智能手机的角膜炎筛查模型。
我们基于来自 3 个独立临床中心的 13009 张裂隙灯照片和 4075 张智能手机照片开发并评估了 CNCML。为了模拟具有不同样本稀缺程度的真实场景,我们使用来自 HUAWEI 智能手机的不同大小(每类 0 到 20 张照片)的训练集来训练 CNCML。我们不仅在内部测试数据集上评估了 CNCML 的性能,还在另一个临床中心由两个不同品牌的智能手机(VIVO 和 XIAOMI)收集的两个外部数据集上评估了 CNCML 的性能。此外,我们还比较了 CNCML 与传统深度学习模型在这些智能手机数据集上的性能。使用准确率和宏观平均曲线下面积(macro-AUC)来评估模型的性能。
仅使用每类 15 张智能手机照片进行训练,CNCML 在三个智能手机数据集上的准确率分别达到 84.59%、83.15%和 89.99%,相应的 macro-AUC 分别为 0.96、0.95 和 0.98。CNCML 在这些数据集上的准确率比最具竞争力的传统深度学习模型高出 0.56%至 9.65%。
CNCML 表现出快速的学习能力,仅用少量的训练样本就能获得出色的性能。这种方法为将智能角膜炎检测从专业设备(如裂隙灯相机)转移到更普及的设备(如智能手机)提供了一种潜在的解决方案,使角膜炎筛查更加方便和有效。