Department of Orthodontics, Faculty of Dentistry, Near East University, Mersin, Turkey.
Private Practice, Mersin, Turkey.
Orthod Craniofac Res. 2023 Aug;26(3):349-355. doi: 10.1111/ocr.12615. Epub 2022 Oct 30.
The aim of this study was to develop an artificial intelligence (AI) algorithm to automatically and accurately determine the stage of cervical vertebra maturation (CVM) with the main purpose being to eliminate the human error factor.
Archives of the cephalometric images were reviewed and the data of 1501 subjects with fully visible cervical vertebras were included in this retrospective study.
Lateral cephalometric (LC) that met the inclusion criteria were used in the training process, labeling was carried out using a computer vision annotation tool (CVAT), tracing was done by an experienced orthodontist as a gold standard and, in order to limit the effect of the uneven distribution of the training data set, maturation stage was classified with a modified Bachetti method by the operator who labelled them. The labelled data were split randomly into a training set (80%), a testing set (10%) and an validation set (10%), to measure intra-observer, inter-observer reliability, intraclass correlation coefficient (ICC) and weighted Cohen's kappa test was carried out.
The ICC was valued at 0.973, weighted Cohen's kappa standard error was 0.870 ± 0.027 which shows high reliability of the observers and excellent level of agreement between them, the segmentation network achieved a global accuracy of 0.99 and the average dice score overall images was 0.93. The classification network achieved an accuracy of 0.802, class sensitivity of (pre-pubertal 0.78; pubertal 0.45; post-pubertal 0.98), respectively, per class specificity of (pre-pubertal 0.94; pubertal 0.94; post-pubertal 0.75), respectively.
The developed algorithm showed the ability to determine the cervical vertebrae maturation stage which might aid in a faster diagnosis process by eliminating human intervention, which might lead to wrong decision-making procedures that might affect the outcome of the treatment plan. The developed algorithm proved reliable in determining the pre-pubertal and post-pubertal growth stages with high accuracy.
本研究旨在开发一种人工智能(AI)算法,以自动、准确地确定颈椎成熟度(CVM)阶段,其主要目的是消除人为因素的影响。
回顾性研究中纳入了 1501 例颈椎完全可见的头颅侧位片图像档案,所有患者均符合纳入标准。
使用符合纳入标准的头颅侧位片(LC)进行训练过程,使用计算机视觉标注工具(CVAT)进行标注,由经验丰富的正畸医生进行跟踪作为金标准,并为了限制训练数据集分布不均的影响,由操作者使用改良的 Bachetti 方法对成熟阶段进行分类。将标注的数据随机分为训练集(80%)、测试集(10%)和验证集(10%),以测量观察者内、观察者间的可靠性,进行组内相关系数(ICC)和加权 Cohen's kappa 检验。
ICC 值为 0.973,加权 Cohen's kappa 标准误为 0.870±0.027,这表明观察者的可靠性很高,观察者之间的一致性极好,分割网络的整体准确率为 0.99,整体图像的平均骰子分数为 0.93。分类网络的准确率为 0.802,各分类的敏感性分别为(青春前期 0.78;青春期 0.45;青春期后 0.98),各分类的特异性分别为(青春前期 0.94;青春期 0.94;青春期后 0.75)。
所开发的算法显示出确定颈椎成熟度阶段的能力,通过消除人为干预,可能有助于更快的诊断过程,从而避免错误的决策程序,影响治疗计划的结果。所开发的算法在确定青春前期和青春期后生长阶段方面具有高度准确性和可靠性。