Department of Endoscopic Diagnosis and Therapy, National Clinical Research Center for Cancer, Key Laboratory of Molecular Cancer Epidemiology of Tianjin, Tianjin's Clinical Research Center for Cancer, Key Laboratory of Cancer Prevention and Therapy, Tianjin Medical University Cancer Institute and Hospital, Tianjin Medical University, Tianjin, China.
Department of Colorectal Cancer, National Clinical Research Center for Cancer, Key Laboratory of Molecular Cancer Epidemiology of Tianjin, Tianjin's Clinical Research Center for Cancer, Key Laboratory of Cancer Prevention and Therapy, Tianjin Medical University Cancer Institute and Hospital, Tianjin Medical University, Tianjin, China.
Nat Commun. 2020 Jun 11;11(1):2961. doi: 10.1038/s41467-020-16777-6.
Colonoscopy is commonly used to screen for colorectal cancer (CRC). We develop a deep learning model called CRCNet for optical diagnosis of CRC by training on 464,105 images from 12,179 patients and test its performance on 2263 patients from three independent datasets. At the patient-level, CRCNet achieves an area under the precision-recall curve (AUPRC) of 0.882 (95% CI: 0.828-0.931), 0.874 (0.820-0.926) and 0.867 (0.795-0.923). CRCNet exceeds average endoscopists performance on recall rate across two test sets (91.3% versus 83.8%; two-sided t-test, p < 0.001 and 96.5% versus 90.3%; p = 0.006) and precision for one test set (93.7% versus 83.8%; p = 0.02), while obtains comparable recall rate on one test set and precision on the other two. At the image-level, CRCNet achieves an AUPRC of 0.990 (0.987-0.993), 0.991 (0.987-0.995), and 0.997 (0.995-0.999). Our study warrants further investigation of CRCNet by prospective clinical trials.
结肠镜检查常用于筛查结直肠癌 (CRC)。我们开发了一种名为 CRCNet 的深度学习模型,通过对来自 12179 名患者的 464105 张图像进行训练,并在来自三个独立数据集的 2263 名患者上进行测试,以评估其性能。在患者水平上,CRCNet 在精确召回曲线下面积(AUPRC)上的表现为 0.882(95%置信区间:0.828-0.931)、0.874(0.820-0.926)和 0.867(0.795-0.923)。CRCNet 在两个测试集中的召回率上超过了平均内镜医生的表现(91.3%比 83.8%;双侧 t 检验,p<0.001 和 96.5%比 90.3%;p=0.006),在一个测试集中的精度上也更高(93.7%比 83.8%;p=0.02),而在另一个测试集中的召回率和在其他两个测试集中的精度相当。在图像水平上,CRCNet 的 AUPRC 分别为 0.990(0.987-0.993)、0.991(0.987-0.995)和 0.997(0.995-0.999)。我们的研究结果表明,CRCNet 需要进一步通过前瞻性临床试验进行研究。