Department of Ophthalmology, Peking Union Medical College Hospital, Key Laboratory of Ocular Fundus Diseases, Chinese Academy of Medical Sciences, Beijing, 100730, China.
BMC Med Educ. 2022 Apr 9;22(1):258. doi: 10.1186/s12909-022-03272-3.
Evaluate the efficiency of using an artificial intelligence reading label system in the diabetic retinopathy grading training of junior ophthalmology resident doctors and medical students.
Loading 520 diabetic retinopathy patients' colour fundus images into the artificial intelligence reading label system. Thirteen participants, including six junior ophthalmology residents and seven medical students, read the images randomly for eight rounds. They evaluated the grading of images and labeled the typical lesions. The sensitivity, specificity, and kappa scores were determined by comparison with the participants' results and diagnosis gold standards.
Through eight rounds of reading, the average kappa score was elevated from 0.67 to 0.81. The average kappa score for rounds 1 to 4 was 0.77, and the average kappa score for rounds 5 to 8 was 0.81. The participants were divided into two groups. The participants in Group 1 were junior ophthalmology resident doctors, and the participants in Group 2 were medical students. The average kappa score of Group 1 was elevated from 0.71 to 0.76. The average kappa score of Group 2 was elevated from 0.63 to 0.84.
The artificial intelligence reading label system is a valuable tool for training resident doctors and medical students in performing diabetic retinopathy grading.
评估在初级眼科住院医师和医学生的糖尿病视网膜病变分级培训中使用人工智能阅读标签系统的效率。
将 520 例糖尿病视网膜病变患者的彩色眼底图像加载到人工智能阅读标签系统中。13 名参与者,包括 6 名初级眼科住院医师和 7 名医学生,随机阅读了 8 轮图像。他们评估了图像的分级并对典型病变进行了标记。通过与参与者的结果和诊断金标准进行比较,确定了敏感性、特异性和kappa 评分。
通过 8 轮阅读,平均 kappa 评分从 0.67 提高到 0.81。第 1 至 4 轮的平均 kappa 评分为 0.77,第 5 至 8 轮的平均 kappa 评分为 0.81。参与者被分为两组。第 1 组为初级眼科住院医师,第 2 组为医学生。第 1 组的平均 kappa 评分从 0.71 提高到 0.76,第 2 组的平均 kappa 评分从 0.63 提高到 0.84。
人工智能阅读标签系统是培训住院医师和医学生进行糖尿病视网膜病变分级的有价值的工具。