Shao Lei, Zhang Xiaomei, Hu Teng, Chen Yang, Zhang Chuan, Dong Li, Ling Saiguang, Dong Zhou, Zhou Wen Da, Zhang Rui Heng, Qin Lei, Wei Wen Bin
Beijing Key Laboratory of Intraocular Tumor Diagnosis and Treatment, Beijing Ophthalmology & Visual Sciences Key Lab, Medical Artificial Intelligence Research and Verification Key Laboratory of the Ministry of Industry and Information Technology, Beijing Tongren Eye Center, Beijing Tongren Hospital, Capital Medical University, Beijing, China.
School of Statistics, University of International Business and Economics, Beijing, China.
Front Med (Lausanne). 2022 Mar 10;9:817114. doi: 10.3389/fmed.2022.817114. eCollection 2022.
To predict the fundus tessellation (FT) severity with machine learning methods.
A population-based cross-sectional study with 3,468 individuals (mean age of 64.6 ± 9.8 years) based on Beijing Eye Study 2011. Participants underwent detailed ophthalmic examinations including fundus images. Five machine learning methods including ordinal logistic regression, ordinal probit regression, ordinal log-gamma regression, ordinal forest and neural network were used.
FT precision, recall, F1-score, weighted-average F1-score and AUC value.
Observed from the in-sample fitting performance, the optimal model was ordinal forest, which had correct classification rate (precision) of 81.28%, while 34.75, 93.73, 70.03, and 24.82% in each classified group by FT severity. The AUC value was 0.7249. And the F1-score was 65.05%, weighted-average F1-score was 79.64% on the whole dataset. For out-of-sample prediction performance, the optimal model was ordinal logistic regression, which had precision of 77.12% on the validation dataset, while 19.57, 92.68, 64.74, and 6.76% in each classified group by FT severity. The AUC value was 0.7187. The classification accuracy of light FT group was the highest, while that of severe FT group was the lowest. And the F1-score was 54.46%, weighted-average F1-score was 74.19% on the whole dataset.
The ordinal forest and ordinal logistic regression model had the strong prediction in-sample and out-sample performance, respectively. The threshold ranges of the ordinal forest model for no FT and light, moderate, severe FT were [0, 0.3078], [0.3078, 0.3347], [0.3347, 0.4048], [0.4048, 1], respectively. Likewise, the threshold ranges of ordinal logistic regression model were ≤ 3.7389, [3.7389, 10.5053], [10.5053, 13.9323], > 13.9323. These results can be applied to guide clinical fundus disease screening and FT severity assessment.
运用机器学习方法预测眼底镶嵌(FT)严重程度。
基于2011年北京眼病研究开展一项基于人群的横断面研究,纳入3468名个体(平均年龄64.6±9.8岁)。参与者接受了包括眼底图像在内的详细眼科检查。使用了五种机器学习方法,包括有序逻辑回归、有序概率回归、有序对数伽马回归、有序森林和神经网络。
FT的精确率、召回率、F1分数、加权平均F1分数和AUC值。
从样本内拟合性能来看,最优模型是有序森林,其正确分类率(精确率)为81.28%,而按FT严重程度划分的每个分类组的精确率分别为34.75%、93.73%、70.03%和24.82%。AUC值为0.7249。在整个数据集上,F1分数为65.05%,加权平均F1分数为79.64%。对于样本外预测性能,最优模型是有序逻辑回归,其在验证数据集上的精确率为77.12%,而按FT严重程度划分的每个分类组的精确率分别为19.