Department of Oral Radiology, Osaka Dental University (ODU), Osaka, Japan.
Department of Oral and Maxillofacial Radiology, Aichi-Gakuin University School of Dentistry, Nagoya, Japan.
Oral Radiol. 2023 Jul;39(3):467-474. doi: 10.1007/s11282-022-00658-3. Epub 2022 Sep 27.
To clarify the performance of transfer learning with a small number of Waters' images at institution B in diagnosing maxillary sinusitis, based on a source model trained with a large number of panoramic radiographs at institution A.
The source model was created by a 200-epoch training process with 800 training and 60 validation datasets of panoramic radiographs at institution A using VGG-16. One hundred and eighty Waters' and 180 panoramic image patches with or without maxillary sinusitis at institution B were enrolled in this study, and were arbitrarily assigned to 120 training, 20 validation, and 40 test datasets, respectively. Transfer learning of 200 epochs was performed using the training and validation datasets of Waters' images based on the source model, and the target model was obtained. The test Waters' images were applied to the source and target models, and the performance of each model was evaluated. Transfer learning with panoramic radiographs and evaluation by two radiologists were undertaken and compared. The evaluation was based on the area of receiver-operating characteristic curves (AUC).
When using Waters' images as the test dataset, the AUCs of the source model, target model, and radiologists were 0.780, 0.830, and 0.806, respectively. There were no significant differences between these models and the radiologists, whereas the target model performed better than the source model. For panoramic radiographs, AUCs were 0.863, 0.863, and 0.808, respectively, with no significant differences.
This study performed transfer learning using a small number of Waters' images, based on a source model created solely from panoramic radiographs, resulting in a performance improvement to 0.830 in diagnosing maxillary sinusitis, which was equivalent to that of radiologists. Transfer learning is considered a useful method to improve diagnostic performance.
基于机构 A 中使用大量全景片训练的源模型,明确在机构 B 中使用少量 Waters 图像进行上颌窦炎诊断的迁移学习性能。
使用机构 A 中的 800 个训练和 60 个验证数据集,通过 VGG-16 对源模型进行 200 个 epoch 的训练过程,创建源模型。在机构 B 中,纳入 180 张带有或不带有上颌窦炎的 Waters 图像和 180 张全景图像的图像块,将其分别随机分配到 120 个训练、20 个验证和 40 个测试数据集。使用基于源模型的 Waters 图像的训练和验证数据集,进行 200 个 epoch 的迁移学习,获得目标模型。将测试 Waters 图像应用于源模型和目标模型,并评估每个模型的性能。进行全景片的迁移学习和两名放射科医生的评估,并进行比较。评估基于受试者工作特征曲线下面积(AUC)。
当使用 Waters 图像作为测试数据集时,源模型、目标模型和放射科医生的 AUC 分别为 0.780、0.830 和 0.806。这些模型与放射科医生之间没有显著差异,而目标模型的性能优于源模型。对于全景片,AUC 分别为 0.863、0.863 和 0.808,无显著差异。
本研究基于仅使用全景片创建的源模型,使用少量 Waters 图像进行迁移学习,将诊断上颌窦炎的性能提高到 0.830,与放射科医生相当。迁移学习被认为是一种提高诊断性能的有用方法。