IEEE J Biomed Health Inform. 2021 Jan;25(1):88-99. doi: 10.1109/JBHI.2020.2983549. Epub 2021 Jan 5.
We propose a fully-automatic deep learning-based algorithm for segmentation of ocular structures and microbial keratitis (MK) biomarkers on slit-lamp photography (SLP) images. The dataset consisted of SLP images from 133 eyes with manual annotations by a physician, P1. A modified region-based convolutional neural network, SLIT-Net, was developed and trained using P1's annotations to identify and segment four pathological regions of interest (ROIs) on diffuse white light images (stromal infiltrate (SI), hypopyon, white blood cell (WBC) border, corneal edema border), one pathological ROI on diffuse blue light images (epithelial defect (ED)), and two non-pathological ROIs on all images (corneal limbus, light reflexes). To assess inter-reader variability, 75 eyes were manually annotated for pathological ROIs by a second physician, P2. Performance was evaluated using the Dice similarity coefficient (DSC) and Hausdorff distance (HD). Using seven-fold cross-validation, the DSC of the algorithm (as compared to P1) for all ROIs was good (range: 0.62-0.95) on all 133 eyes. For the subset of 75 eyes with manual annotations by P2, the DSC for pathological ROIs ranged from 0.69-0.85 (SLIT-Net) vs. 0.37-0.92 (P2). DSCs for SLIT-Net were not significantly different than P2 for segmenting hypopyons (p > 0.05) and higher than P2 for WBCs (p < 0.001) and edema (p < 0.001). DSCs were higher for P2 for segmenting SIs (p < 0.001) and EDs (p < 0.001). HDs were lower for P2 for segmenting SIs (p = 0.005) and EDs (p < 0.001) and not significantly different for hypopyons (p > 0.05), WBCs (p > 0.05), and edema (p > 0.05). This prototype fully-automatic algorithm to segment MK biomarkers on SLP images performed to expectations on an exploratory dataset and holds promise for quantification of corneal physiology and pathology.
我们提出了一种完全基于深度学习的算法,用于对裂隙灯摄影 (SLP) 图像中的眼部结构和微生物角膜炎 (MK) 生物标志物进行分割。该数据集由 133 只眼睛的 SLP 图像组成,由一名医生 P1 进行手动注释。开发了一种改进的基于区域的卷积神经网络 SLIT-Net,并使用 P1 的注释对其进行训练,以识别和分割弥漫白光图像上的四个病理性感兴趣区域 (ROI) (基质浸润 (SI)、前房积血、白细胞 (WBC) 边界、角膜水肿边界)、弥漫蓝光图像上的一个病理性 ROI (上皮缺损 (ED)) 和所有图像上的两个非病理性 ROI (角膜缘、光反射)。为了评估读者间的变异性,由第二名医生 P2 对 75 只眼睛的病理性 ROI 进行手动注释。使用 Dice 相似系数 (DSC) 和 Hausdorff 距离 (HD) 来评估性能。使用七折交叉验证,在所有 133 只眼睛上,算法 (与 P1 相比) 对所有 ROI 的 DSC 均较好 (范围为 0.62-0.95)。对于由 P2 进行手动注释的 75 只眼睛的子集,病理性 ROI 的 DSC 范围为 0.69-0.85( SLIT-Net)与 0.37-0.92(P2)。对于前房积血 (p > 0.05) 和白细胞 (p < 0.001) 和水肿 (p < 0.001), SLIT-Net 的 DSCs 与 P2 无显著差异。对于 SI(p < 0.001)和 ED(p < 0.001), P2 的 DSCs 更高。对于 SI(p = 0.005)和 ED(p < 0.001), P2 的 HDs 较低,对于前房积血 (p > 0.05)、白细胞 (p > 0.05)和水肿 (p > 0.05),HDs 无显著差异。这种原型全自动算法在探索性数据集上对 SLP 图像中的 MK 生物标志物进行分割,表现符合预期,有望实现对角膜生理学和病理学的定量分析。