University of Lincoln, Lincoln, UK.
Arab Academy for Science and Technology, Alexandria, Egypt.
Int J Comput Assist Radiol Surg. 2019 Apr;14(4):611-621. doi: 10.1007/s11548-019-01914-4. Epub 2019 Jan 22.
This study aims to adapt and evaluate the performance of different state-of-the-art deep learning object detection methods to automatically identify esophageal adenocarcinoma (EAC) regions from high-definition white light endoscopy (HD-WLE) images.
Several state-of-the-art object detection methods using Convolutional Neural Networks (CNNs) were adapted to automatically detect abnormal regions in the esophagus HD-WLE images, utilizing VGG'16 as the backbone architecture for feature extraction. Those methods are Regional-based Convolutional Neural Network (R-CNN), Fast R-CNN, Faster R-CNN and Single-Shot Multibox Detector (SSD). For the evaluation of the different methods, 100 images from 39 patients that have been manually annotated by five experienced clinicians as ground truth have been tested.
Experimental results illustrate that the SSD and Faster R-CNN networks show promising results, and the SSD outperforms other methods achieving a sensitivity of 0.96, specificity of 0.92 and F-measure of 0.94. Additionally, the Average Recall Rate of the Faster R-CNN in locating the EAC region accurately is 0.83.
In this paper, recent deep learning object detection methods are adapted to detect esophageal abnormalities automatically. The evaluation of the methods proved its ability to locate abnormal regions in the esophagus from endoscopic images. The automatic detection is a crucial step that may help early detection and treatment of EAC and also can improve automatic tumor segmentation to monitor its growth and treatment outcome.
本研究旨在适应和评估最先进的深度学习目标检测方法的性能,以自动识别高清白光内窥镜(HD-WLE)图像中的食管腺癌(EAC)区域。
采用几种基于卷积神经网络(CNNs)的最先进的目标检测方法,利用 VGG'16 作为特征提取的骨干架构,自动检测食管 HD-WLE 图像中的异常区域。这些方法是基于区域的卷积神经网络(R-CNN)、快速 R-CNN、Faster R-CNN 和单镜头多框检测器(SSD)。为了评估不同的方法,我们测试了 100 张来自 39 名患者的图像,这些图像已经由 5 名经验丰富的临床医生手动标注为真实图像。
实验结果表明,SSD 和 Faster R-CNN 网络表现出了很有前途的结果,SSD 的性能优于其他方法,其敏感性为 0.96,特异性为 0.92,F 度量为 0.94。此外,Faster R-CNN 定位 EAC 区域的平均召回率为 0.83。
在本文中,我们适应了最新的深度学习目标检测方法来自动检测食管异常。方法的评估证明了它从内窥镜图像中定位异常区域的能力。自动检测是一个关键步骤,它可以帮助早期发现和治疗 EAC,并且还可以改善自动肿瘤分割,以监测其生长和治疗效果。