Liu Xiyang, Jiang Jiewei, Zhang Kai, Long Erping, Cui Jiangtao, Zhu Mingmin, An Yingying, Zhang Jia, Liu Zhenzhen, Lin Zhuoling, Li Xiaoyan, Chen Jingjing, Cao Qianzhong, Li Jing, Wu Xiaohang, Wang Dongni, Lin Haotian
School of Computer Science and Technology, Xidian University, Xi'an, China.
School of Software, Xidian University, Xi'an, China.
PLoS One. 2017 Mar 17;12(3):e0168606. doi: 10.1371/journal.pone.0168606. eCollection 2017.
Slit-lamp images play an essential role for diagnosis of pediatric cataracts. We present a computer vision-based framework for the automatic localization and diagnosis of slit-lamp images by identifying the lens region of interest (ROI) and employing a deep learning convolutional neural network (CNN). First, three grading degrees for slit-lamp images are proposed in conjunction with three leading ophthalmologists. The lens ROI is located in an automated manner in the original image using two successive applications of Candy detection and the Hough transform, which are cropped, resized to a fixed size and used to form pediatric cataract datasets. These datasets are fed into the CNN to extract high-level features and implement automatic classification and grading. To demonstrate the performance and effectiveness of the deep features extracted in the CNN, we investigate the features combined with support vector machine (SVM) and softmax classifier and compare these with the traditional representative methods. The qualitative and quantitative experimental results demonstrate that our proposed method offers exceptional mean accuracy, sensitivity and specificity: classification (97.07%, 97.28%, and 96.83%) and a three-degree grading area (89.02%, 86.63%, and 90.75%), density (92.68%, 91.05%, and 93.94%) and location (89.28%, 82.70%, and 93.08%). Finally, we developed and deployed a potential automatic diagnostic software for ophthalmologists and patients in clinical applications to implement the validated model.
裂隙灯图像在小儿白内障诊断中起着至关重要的作用。我们提出了一种基于计算机视觉的框架,通过识别感兴趣的晶状体区域(ROI)并采用深度学习卷积神经网络(CNN)来自动定位和诊断裂隙灯图像。首先,与三位顶尖眼科医生共同提出了裂隙灯图像的三个分级程度。使用Canny检测和霍夫变换的两次连续应用,以自动方式在原始图像中定位晶状体ROI,对其进行裁剪、调整为固定大小并用于形成小儿白内障数据集。这些数据集被输入到CNN中以提取高级特征并实现自动分类和分级。为了证明在CNN中提取的深度特征的性能和有效性,我们研究了结合支持向量机(SVM)和softmax分类器的特征,并将其与传统代表性方法进行比较。定性和定量实验结果表明,我们提出的方法具有出色的平均准确率、灵敏度和特异性:分类(97.07%、97.28%和96.83%)以及三度分级面积(89.02%、86.63%和90.75%)、密度(92.68%、91.05%和93.94%)和位置(89.28%、82.70%和93.08%)。最后,我们开发并部署了一个潜在的自动诊断软件,供眼科医生和患者在临床应用中使用,以实现经过验证的模型。