Department of Physics. Faculty of Philosophy Sciences and Letters of Ribeirão Preto, University of São Paulo, Ribeirão Preto, Brazil.
Department of Stomatology, Public Health and Forensic Dentistry, School of Dentistry of Ribeirão Preto, University of São Paulo, Ribeirão Preto, Brazil.
Biomed Phys Eng Express. 2023 Mar 10;9(3). doi: 10.1088/2057-1976/acb7f6.
Many studies in the last decades have correlated mandible bone structure with systemic diseases like osteoporosis. Mandible segmentation, as well as segmentation of other oral structures, is an essential step in studies that correlate oral structures' conditions with systemic diseases in general. However, manual mandible segmentation is a time-consuming and training-required task that suffers from inter and intra-user variability. Further, the dental panoramic x-ray image (PAN), the most used image in oral studies, contains overlapping of many structures and lacks contrast on structures' interface. Those facts make both manual and automatic mandible segmentation a challenge. In the present study, we propose a precise and robust set of deep learning-based algorithms for automatic mandible segmentation (AMS) on PAN images. Two datasets were considered. An in-house image dataset with 393 image/segmentation pairs was prepared using image data of 321 image patient data and the corresponding manual segmentation performed by an experienced specialist. Additionally, a publicly available third-party image dataset (TPD) composed of 116 image/segmentation pairs was used to train the models. Four deep learning models were trained using U-Net and HRNet architectures with and without data augmentation. An additional morphological refinement routine was proposed to enhance the models' prediction. An ensemble model was proposed combining the four best-trained segmentation models. The ensemble model with morphological refinement achieved the highest scores on the test set (98.27%, 97.60%, 97.18%, ACC, DICE, and IoU respectively), with the other models scoring above 95% in all performance metrics on the test set. The present study achieved the highest ranked performance considering all the previously published results on AMS for PAN images. Additionally, those are the most robust results achieved since it was performed over an image set with considerable gender representativeness, a wide age range, a large variety of oral conditions, and images from different imaging scans.
在过去几十年的许多研究中,人们已经将下颌骨结构与骨质疏松症等系统性疾病联系起来。下颌骨分割以及其他口腔结构的分割是研究口腔结构状况与系统性疾病之间关系的重要步骤。然而,手动下颌骨分割是一项耗时且需要培训的任务,存在用户间和用户内的变异性。此外,牙科全景 X 射线图像(PAN)是口腔研究中最常用的图像,其中包含许多结构的重叠,并且结构界面对比度低。这些事实使得手动和自动下颌骨分割都具有挑战性。在本研究中,我们提出了一套基于深度学习的精确而稳健的算法,用于对 PAN 图像进行自动下颌骨分割(AMS)。考虑了两个数据集。使用 321 张图像患者数据的图像数据和由经验丰富的专家执行的相应手动分割,准备了一个内部图像数据集,其中包含 393 张图像/分割对。此外,还使用了由 116 张图像/分割对组成的公共第三方图像数据集(TPD)来训练模型。使用 U-Net 和 HRNet 架构以及数据增强训练了四个深度学习模型。提出了一种额外的形态学细化例程来增强模型的预测。提出了一种组合四个最佳分割模型的集成模型。在测试集上,具有形态学细化的集成模型在所有性能指标上均获得了最高分数(分别为 98.27%、97.60%、97.18%、ACC、DICE 和 IoU),其他模型在测试集上的所有性能指标得分均高于 95%。考虑到以前在 PAN 图像的 AMS 方面发表的所有结果,本研究取得了最高的排名性能。此外,这是自从具有相当代表性的性别、广泛的年龄范围、各种口腔状况以及来自不同成像扫描的图像的图像集上进行以来获得的最稳健的结果。