Beijing Tongren Eye Center, Beijing Key Laboratory of Intraocular Tumor Diagnosis and Treatment, Beijing Ophthalmology & Visual Sciences Key Lab, Medical Artificial Intelligence Research and Verification Key Laboratory of the Ministry of Industry and Information Technology, Beijing Tongren Hospital, Capital Medical University, Beijing, China.
Beijing Institute of Ophthalmology, Beijing Tongren Eye Center, Beijing Tongren Hospital, Capital Medical University, Beijing, China.
Br J Cancer. 2023 Aug;129(3):466-474. doi: 10.1038/s41416-023-02320-z. Epub 2023 Jun 21.
Retinoblastoma is the most common intraocular malignancy in childhood. With the advanced management strategy, the globe salvage and overall survival have significantly improved, which proposes subsequent challenges regarding long-term surveillance and offspring screening. This study aimed to apply a deep learning algorithm to reduce the burden of follow-up and offspring screening.
This cohort study includes retinoblastoma patients who visited Beijing Tongren Hospital from March 2018 to January 2022 for deep learning algorism development. Clinical-suspected and treated retinoblastoma patients from February 2022 to June 2022 were prospectively collected for prospective validation. Images from the posterior pole and peripheral retina were collected, and reference standards were made according to the consensus of the multidisciplinary management team. A deep learning algorithm was trained to identify "normal fundus", "stable retinoblastoma" in which specific treatment is not required, and "active retinoblastoma" in which specific treatment is required. The performance of each classifier included sensitivity, specificity, accuracy, and cost-utility.
A total of 36,623 images were included for developing the Deep Learning Assistant for Retinoblastoma Monitoring (DLA-RB) algorithm. In internal fivefold cross-validation, DLA-RB achieved an area under curve (AUC) of 0.998 (95% confidence interval [CI] 0.986-1.000) in distinguishing normal fundus and active retinoblastoma, and 0.940 (95% CI 0.851-0.996) in distinguishing stable and active retinoblastoma. From February 2022 to June 2022, 139 eyes of 103 patients were prospectively collected. In identifying active retinoblastoma tumours from all clinical-suspected patients and active retinoblastoma from all treated retinoblastoma patients, the AUC of DLA-RB reached 0.991 (95% CI 0.970-1.000), and 0.962 (95% CI 0.915-1.000), respectively. The combination between ophthalmologists and DLA-RB significantly improved the accuracy of competent ophthalmologists and residents regarding both binary tasks. Cost-utility analysis revealed DLA-RB-based diagnosis mode is cost-effective in both retinoblastoma diagnosis and active retinoblastoma identification.
DLA-RB achieved high accuracy and sensitivity in identifying active retinoblastoma from the normal and stable retinoblastoma fundus. It can be used to surveil the activity of retinoblastoma during follow-up and screen high-risk offspring. Compared with referral procedures to ophthalmologic centres, DLA-RB-based screening and surveillance is cost-effective and can be incorporated within telemedicine programs.
This study was registered on ClinicalTrials.gov (NCT05308043).
视网膜母细胞瘤是儿童中最常见的眼内恶性肿瘤。随着先进的管理策略的应用,眼球保存和整体生存率得到了显著提高,这对长期监测和后代筛查提出了后续挑战。本研究旨在应用深度学习算法来减轻随访和后代筛查的负担。
这项队列研究纳入了 2018 年 3 月至 2022 年 1 月期间在北京同仁医院就诊的接受深度学习算法开发的视网膜母细胞瘤患者。2022 年 2 月至 6 月前瞻性收集临床疑似和治疗后的视网膜母细胞瘤患者进行前瞻性验证。采集后极部和周边视网膜图像,并根据多学科管理团队的共识制定参考标准。训练一个深度学习算法来识别“正常眼底”、不需要特定治疗的“稳定视网膜母细胞瘤”和需要特定治疗的“活跃视网膜母细胞瘤”。每个分类器的性能包括敏感性、特异性、准确性和成本效益。
共纳入 36623 张图像用于开发用于视网膜母细胞瘤监测的深度学习助手(DLA-RB)算法。在内部五重交叉验证中,DLA-RB 在区分正常眼底和活跃视网膜母细胞瘤方面的曲线下面积(AUC)为 0.998(95%置信区间[CI] 0.986-1.000),在区分稳定和活跃视网膜母细胞瘤方面的 AUC 为 0.940(95%CI 0.851-0.996)。2022 年 2 月至 6 月,前瞻性收集了 103 例患者的 139 只眼。在从所有临床疑似患者中识别活跃的视网膜母细胞瘤肿瘤和从所有治疗的视网膜母细胞瘤患者中识别活跃的视网膜母细胞瘤方面,DLA-RB 的 AUC 分别达到 0.991(95%CI 0.970-1.000)和 0.962(95%CI 0.915-1.000)。眼科医生与 DLA-RB 的结合显著提高了有能力的眼科医生和住院医师在这两个二进制任务中的准确性。成本效益分析表明,基于 DLA-RB 的诊断模式在视网膜母细胞瘤诊断和活跃视网膜母细胞瘤识别方面均具有成本效益。
DLA-RB 在从正常和稳定的视网膜母细胞瘤眼底中识别活跃的视网膜母细胞瘤方面具有较高的准确性和敏感性。它可用于在随访期间监测视网膜母细胞瘤的活动,并筛查高危后代。与转诊至眼科中心相比,基于 DLA-RB 的筛查和监测具有成本效益,可纳入远程医疗计划。
本研究在 ClinicalTrials.gov 注册(NCT05308043)。