Radiology Section, Ankara Sehit Ahmet Ozsoy State Hospital, Ankara, Turkey.
School of Medicine, Department of Radiology, Sakarya University, Sakarya, Turkey.
Jpn J Radiol. 2021 Mar;39(3):267-272. doi: 10.1007/s11604-020-01055-8. Epub 2020 Oct 16.
To evaluate the agreement between observers using Greulich-Pyle (GP) and Gilsanz-Ratib (GR) methods, between four specialities (radiology, pediatrics, pediatric endocrinology and pediatric radiology) and between observers and automated tool in the bone age estimation.
A total of 99 observers participated in this questionnaire-based study. BoneXpert was used for the automated tool. Experienced, senior, and junior observers were defined by their experience, and the bone age determined by experienced observers was regarded as the ground truth. Agreement between observers was evaluated using the coefficient of variance (CV) and intraclass correlation coefficient (ICC), and they were reevaluated after adding BoneXpert to the observers. Agreement of BoneXpert, the senior, and the junior observers was also evaluated using the root-mean-square-error (RMSE) values and Blant Altman method by comparing with the ground truth.
The CV ranged from 4.98% to 22.08%. The ICC were 0.980 for GP, 0.980 for GP and BoneXpert, 0.973 for GR, and 0.976 for GR and BoneXpert, and the ICC between four specialities ranged form 0.963 to 0.990. BoneXpert tool had the lowest RMSE values (0.504 years for GP atlas).
Automated bone age estimation showed comparable results with GP and GR methods and its utilization may decrease inter-observer variability.
评估观察者使用 Greulich-Pyle (GP) 和 Gilsanz-Ratib (GR) 方法、四个专业(放射科、儿科、儿科内分泌学和儿科放射科)以及观察者和自动工具之间在骨龄评估中的一致性。
共有 99 名观察者参与了这项基于问卷调查的研究。BoneXpert 被用于自动工具。经验丰富的、高级的和初级的观察者是根据他们的经验来定义的,而由经验丰富的观察者确定的骨龄被视为基准。通过变异系数(CV)和组内相关系数(ICC)评估观察者之间的一致性,并在观察者中添加 BoneXpert 后重新评估。还通过与基准比较,使用均方根误差(RMSE)值和 Bland-Altman 方法评估 BoneXpert、高级观察者和初级观察者的一致性。
CV 范围为 4.98%至 22.08%。GP 的 ICC 为 0.980,GP 和 BoneXpert 的 ICC 为 0.980,GR 的 ICC 为 0.973,GR 和 BoneXpert 的 ICC 为 0.976,四个专业之间的 ICC 范围为 0.963 至 0.990。BoneXpert 工具具有最低的 RMSE 值(GP 图谱为 0.504 岁)。
自动骨龄评估与 GP 和 GR 方法具有可比的结果,其应用可能会降低观察者之间的变异性。