Hadzic Arnela, Urschler Martin, Press Jan-Niclas Aaron, Riedl Regina, Rugani Petra, Štern Darko, Kirnbauer Barbara
Institute for Medical Informatics, Statistics and Documentation, Medical University of Graz, 8036 Graz, Austria.
Division of Oral Surgery and Orthodontics, Medical University of Graz, 8010 Graz, Austria.
J Clin Med. 2023 Dec 29;13(1):197. doi: 10.3390/jcm13010197.
The aim of this validation study was to comprehensively evaluate the performance and generalization capability of a deep learning-based periapical lesion detection algorithm on a clinically representative cone-beam computed tomography (CBCT) dataset and test for non-inferiority. The evaluation involved 195 CBCT images of adult upper and lower jaws, where sensitivity and specificity metrics were calculated for all teeth, stratified by jaw, and stratified by tooth type. Furthermore, each lesion was assigned a periapical index score based on its size to enable a score-based evaluation. Non-inferiority tests were conducted with proportions of 90% for sensitivity and 82% for specificity. The algorithm achieved an overall sensitivity of 86.7% and a specificity of 84.3%. The non-inferiority test indicated the rejection of the null hypothesis for specificity but not for sensitivity. However, when excluding lesions with a periapical index score of one (i.e., very small lesions), the sensitivity improved to 90.4%. Despite the challenges posed by the dataset, the algorithm demonstrated promising results. Nevertheless, further improvements are needed to enhance the algorithm's robustness, particularly in detecting very small lesions and the handling of artifacts and outliers commonly encountered in real-world clinical scenarios.
这项验证研究的目的是在具有临床代表性的锥束计算机断层扫描(CBCT)数据集上全面评估基于深度学习的根尖周病变检测算法的性能和泛化能力,并进行非劣效性测试。评估涉及195张成人上下颌的CBCT图像,针对所有牙齿计算敏感性和特异性指标,并按颌骨和牙齿类型进行分层。此外,根据病变大小为每个病变指定根尖指数评分,以便进行基于评分的评估。非劣效性测试的敏感性比例为90%,特异性比例为82%。该算法的总体敏感性为86.7%,特异性为84.3%。非劣效性测试表明,特异性的原假设被拒绝,而敏感性的原假设未被拒绝。然而,当排除根尖指数评分为1的病变(即非常小的病变)时,敏感性提高到了90.4%。尽管数据集带来了挑战,但该算法显示出了有前景的结果。尽管如此,仍需要进一步改进以提高算法的鲁棒性,特别是在检测非常小的病变以及处理实际临床场景中常见的伪影和异常值方面。
Comput Methods Programs Biomed. 2017-5-26
Diagnostics (Basel). 2024-12-9
Bioengineering (Basel). 2024-9-17
Dentomaxillofac Radiol. 2023-2
Diagnostics (Basel). 2022-12-29
Sensors (Basel). 2022-8-28
Dentomaxillofac Radiol. 2022-9-1