Sheldon B. Lubar School of Business, University of Wisconsin-Milwaukee, Milwaukee, WI, USA.
Department of Radiology, UCHealth University of Colorado Hospital, Aurora, CO, USA.
J Digit Imaging. 2021 Feb;34(1):66-74. doi: 10.1007/s10278-020-00408-z. Epub 2020 Dec 1.
To explore the feasibility of an automatic machine-learning algorithm-based quality control system for the practice of diagnostic radiography, performance of a convolutional neural networks (CNN)-based algorithm for identifying radiographic (X-ray) views at different levels was examined with a retrospective, HIPAA-compliant, and IRB-approved study performed on 15,046 radiographic images acquired between 2013 and 2018 from nine clinical sites affiliated with our institution. Images were labeled according to four classification levels: level 1 (anatomy level, 25 classes), level 2 (laterality level, 41 classes), level 3 (projection level, 108 classes), and level 4 (detailed level, 143 classes). An Inception V3 model pre-trained with ImageNet dataset was trained with transfer learning to classify the image at all levels. Sensitivity and positive predictive value were reported for each class, and overall accuracy was reported for each level. Accuracy was also reported when we allowed for "reasonable errors". The overall accuracy was 0.96, 0.93, 0.90, and 0.86 at levels 1, 2, 3, and 4, respectively. Overall accuracy increased to 0.99, 0.97, 0.94, and 0.88 when "reasonable errors" were allowed. Machine learning algorithms resulted in reasonable model performance for identifying radiographic views with acceptable accuracy when "reasonable errors" were allowed. Our findings demonstrate the feasibility of building a quality-control program based on machine-learning algorithms to identify radiographic views with acceptable accuracy at lower levels, which could be applied in a clinical setting.
为了探索基于自动机器学习算法的诊断放射实践质量控制系统的可行性,我们对一种基于卷积神经网络(CNN)的算法进行了回顾性研究,该研究符合 HIPAA 规定并经过了机构审查委员会的批准,共纳入了 15046 张 2013 年至 2018 年间从我院 9 个临床站点采集的 X 射线图像。这些图像根据四个分类级别进行了标记:级别 1(解剖水平,25 个类别)、级别 2(侧别水平,41 个类别)、级别 3(投影水平,108 个类别)和级别 4(详细水平,143 个类别)。使用 ImageNet 数据集进行预训练的 Inception V3 模型通过迁移学习进行训练,以对所有级别进行图像分类。报告了每个类别的敏感性和阳性预测值,并报告了每个级别的总体准确率。当允许出现“合理误差”时,还报告了准确性。总体准确率分别为 0.96、0.93、0.90 和 0.86,级别分别为 1、2、3 和 4。当允许出现“合理误差”时,总体准确率提高到 0.99、0.97、0.94 和 0.88。当允许出现“合理误差”时,机器学习算法在识别 X 射线视图方面表现出合理的模型性能,具有可接受的准确性。我们的研究结果表明,在允许出现“合理误差”的情况下,基于机器学习算法构建质量控制系统来识别 X 射线视图具有可行性,且可在临床环境中应用。