School of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing, 210094, China.
School of Information Science and Engineering, University of Jinan, Jinan, 250022, China.
Med Phys. 2019 Oct;46(10):4502-4519. doi: 10.1002/mp.13728. Epub 2019 Aug 22.
The purpose of this study was to automatically and accurately segment hyper-reflective foci (HRF) in spectral domain optical coherence tomography (SD-OCT) images with diabetic retinopathy (DR) using deep convolutional neural networks.
An automatic HRF segmentation model for SD-OCT images based on deep networks was constructed. The model segmented small lesions through pixel-wise predictions based on small image patches. We used an approach for discriminative features extraction for small patches by introducing small kernels and strides in convolutional and pooling layers, which was applied on the state-of-the-art deep classification networks (GoogLeNet and ResNet). The features extracted by the adapted deep networks were fed into a softmax layer to produce the probabilities of HRF. We trained different models on a dataset with 16 HRF eyes by using different sizes of patches, and then, we fused these models to generate optimal results.
Experimental results on 18 eyes demonstrated that our method is effective for the HRF segmentation. The dice similarity coefficient (DSC) for the foci area in B-scan, projection images, and foci amount in B-scan images reaches 67.81%, 74.09%, and 72.45%, respectively.
The proposed segmentation model can accurately segment HRF in SD-OCT images with DR and outperforms traditional methods. Our model may provide reliable segmentations for small lesions in SD-OCT images and may be helpful in the clinical diagnosis of diseases.
本研究旨在使用深度卷积神经网络自动且准确地分割伴有糖尿病视网膜病变(DR)的谱域光学相干断层扫描(SD-OCT)图像中的高反射焦点(HRF)。
构建了一种基于深度网络的 SD-OCT 图像自动 HRF 分割模型。该模型通过基于小图像补丁的像素级预测来分割小病变。我们通过在卷积和池化层中引入小核和步长,为小补丁提取鉴别特征,应用于最先进的深度分类网络(GoogLeNet 和 ResNet)。通过自适应深度网络提取的特征被输入到 softmax 层,以产生 HRF 的概率。我们使用不同大小的补丁在具有 16 个 HRF 眼睛的数据集上训练不同的模型,然后融合这些模型以生成最佳结果。
对 18 只眼睛的实验结果表明,我们的方法对 HRF 分割是有效的。B 扫描、投影图像中焦点区域的 Dice 相似系数(DSC)和 B 扫描图像中焦点数量分别达到 67.81%、74.09%和 72.45%。
所提出的分割模型可以准确地分割伴有 DR 的 SD-OCT 图像中的 HRF,优于传统方法。我们的模型可以为 SD-OCT 图像中的小病变提供可靠的分割,可能有助于疾病的临床诊断。