Department of Gastroenterology, Nanjing University Medical School Affiliated Drum Tower Hospital, Nanjing, Jiangsu, China.
Jiangsu Key Laboratory of Big Data Analysis Technology (B-DAT), Nanjing University of Information Science and Technology, Nanjing, China.
Clin Transl Gastroenterol. 2021 Aug 4;12(8):e00393. doi: 10.14309/ctg.0000000000000393.
This study aims to construct a real-time deep convolutional neural networks (DCNNs) system to diagnose early esophageal squamous cell carcinoma (ESCC) with white light imaging endoscopy.
A total of 4,002 images from 1,078 patients were used to train and cross-validate the DCNN model for diagnosing early ESCC. The performance of the model was further tested with independent internal and external validation data sets containing 1,033 images from 243 patients. The performance of the model was then compared with endoscopists. The accuracy, sensitivity, specificity, positive predictive value, negative predictive value, and Cohen kappa coefficient were measured to assess performance.
The DCNN model had excellent performance in diagnosing early ESCC with a sensitivity of 0.979, a specificity of 0.886, a positive predictive value of 0.777, a negative predictive value of 0.991, and an area under curve of 0.954 in the internal validation data set. The model also depicted a tremendously generalized performance in 2 external data sets and exhibited superior performance compared with endoscopists. The performance of the endoscopists was markedly elevated after referring to the predictions of the DCNN model. An open-accessed website of the DCNN system was established to facilitate associated research.
A real-time DCNN system, which was constructed to diagnose early ESCC, showed good performance in validation data sets. However, more prospective validation is needed to understand its true clinical significance in the real world.
本研究旨在构建一个实时深度卷积神经网络(DCNN)系统,以白光成像内镜诊断早期食管鳞状细胞癌(ESCC)。
共使用来自 1,078 名患者的 4,002 张图像来训练和交叉验证用于诊断早期 ESCC 的 DCNN 模型。使用包含 243 名患者的 1,033 张图像的独立内部和外部验证数据集进一步测试模型的性能。然后将模型的性能与内镜医生进行比较。测量准确性、敏感性、特异性、阳性预测值、阴性预测值和 Cohen kappa 系数来评估性能。
DCNN 模型在诊断早期 ESCC 方面表现出色,在内部验证数据集中的敏感性为 0.979、特异性为 0.886、阳性预测值为 0.777、阴性预测值为 0.991 和曲线下面积为 0.954。该模型在 2 个外部数据集也表现出了极好的泛化性能,并表现出优于内镜医生的性能。在参考 DCNN 模型的预测后,内镜医生的表现明显提高。建立了一个 DCNN 系统的开放访问网站,以促进相关研究。
一个用于诊断早期 ESCC 的实时 DCNN 系统在验证数据集上表现出良好的性能。然而,需要更多的前瞻性验证来了解其在现实世界中的真正临床意义。