Department of Diagnostic Imaging, Sheba Medical Center, Tel Hashomer, Israel; Sackler Medical School, Tel Aviv University, Tel Aviv, Israel; DeepVision Lab, Sheba Medical Center, Tel Hashomer, Israel.
DeepVision Lab, Sheba Medical Center, Tel Hashomer, Israel.
Gastrointest Endosc. 2020 Mar;91(3):606-613.e2. doi: 10.1016/j.gie.2019.11.012. Epub 2019 Nov 16.
The aim of our study was to develop and evaluate a deep learning algorithm for the automated detection of small-bowel ulcers in Crohn's disease (CD) on capsule endoscopy (CE) images of individual patients.
We retrospectively collected CE images of known CD patients and control subjects. Each image was labeled by an expert gastroenterologist as either normal mucosa or containing mucosal ulcers. A convolutional neural network was trained to classify images into either normal mucosa or mucosal ulcers. First, we trained the network on 5-fold randomly split images (each fold with 80% training images and 20% images testing). We then conducted 10 experiments in which images from n - 1 patients were used to train a network and images from a different individual patient were used to test the network. Results of the networks were compared for randomly split images and for individual patients. Area under the curves (AUCs) and accuracies were computed for each individual network.
Overall, our dataset included 17,640 CE images from 49 patients: 7391 images with mucosal ulcers and 10,249 images of normal mucosa. For randomly split images results were excellent, with AUCs of .99 and accuracies ranging from 95.4% to 96.7%. For individual patient-level experiments, the AUCs were also excellent (.94-.99).
Deep learning technology provides accurate and fast automated detection of mucosal ulcers on CE images. Individual patient-level analysis provided high and consistent diagnostic accuracy with shortened reading time; in the future, deep learning algorithms may augment and facilitate CE reading.
本研究旨在开发并评估一种深度学习算法,用于自动检测克罗恩病(CD)患者胶囊内镜(CE)图像中的小肠溃疡。
我们回顾性收集了已知 CD 患者和对照者的 CE 图像。每位专家胃肠病学家对每张图像进行标注,分为正常黏膜或存在黏膜溃疡。使用卷积神经网络对图像进行分类,分为正常黏膜或黏膜溃疡。首先,我们使用 5 折随机分割图像(每个折叠包含 80%的训练图像和 20%的测试图像)对网络进行训练。然后,我们进行了 10 项实验,其中使用 n-1 位患者的图像训练网络,而使用不同患者的图像对网络进行测试。比较了网络对随机分割图像和个体患者的结果。为每个单独的网络计算了曲线下面积(AUC)和准确性。
总体而言,我们的数据集包括 49 名患者的 17640 张 CE 图像:7391 张存在黏膜溃疡,10249 张正常黏膜。对于随机分割图像,结果非常出色,AUC 值为.99,准确率范围为 95.4%至 96.7%。对于个体患者水平的实验,AUC 值也非常出色(.94-.99)。
深度学习技术可提供 CE 图像上黏膜溃疡的准确、快速自动检测。个体患者水平的分析提供了高且一致的诊断准确性,同时缩短了阅读时间;未来,深度学习算法可能会增强并促进 CE 阅读。