From the Department of Radiology, Samsung Medical Center, Sungkyunkwan University School of Medicine, 81 Irwon-Ro, Gangnam-Gu, Seoul 06351, South Korea (H.K., J.H.W., J.H.K., Y.K.C., M.J.C.); Medical AI Research Center, Samsung Medical Center, Seoul, South Korea (Kyungsu Kim, M.J.C.); Department of Data Convergence and Future Medicine, Sungkyunkwan University School of Medicine, Seoul, South Korea (Kyungsu Kim, Kyunga Kim, M.J.C.); and Department of Health Sciences and Technology (S.J.O.) and Department of Digital Health (S.L., Kyunga Kim), Samsung Advanced Institute for Health Sciences & Technology, Sungkyunkwan University, Seoul, South Korea.
Radiol Artif Intell. 2024 May;6(3):e230094. doi: 10.1148/ryai.230094.
Purpose To develop an artificial intelligence (AI) system for humeral tumor detection on chest radiographs (CRs) and evaluate the impact on reader performance. Materials and Methods In this retrospective study, 14 709 CRs (January 2000 to December 2021) were collected from 13 468 patients, including CT-proven normal ( = 13 116) and humeral tumor ( = 1593) cases. The data were divided into training and test groups. A novel training method called (FPAR) was introduced to enhance the diagnostic performance by focusing on the humeral region. The AI program and 10 radiologists were assessed using holdout test set 1, wherein the radiologists were tested twice (with and without AI test results). The performance of the AI system was evaluated using holdout test set 2, comprising 10 497 normal images. Receiver operating characteristic analyses were conducted for evaluating model performance. Results FPAR application in the AI program improved its performance compared with a conventional model based on the area under the receiver operating characteristic curve (0.87 vs 0.82, = .04). The proposed AI system also demonstrated improved tumor localization accuracy (80% vs 57%, < .001). In holdout test set 2, the proposed AI system exhibited a false-positive rate of 2%. AI assistance improved the radiologists' sensitivity, specificity, and accuracy by 8.9%, 1.2%, and 3.5%, respectively ( < .05 for all). Conclusion The proposed AI tool incorporating FPAR improved humeral tumor detection on CRs and reduced false-positive results in tumor visualization. It may serve as a supportive diagnostic tool to alert radiologists about humeral abnormalities. Artificial Intelligence, Conventional Radiography, Humerus, Machine Learning, Shoulder, Tumor © RSNA, 2024.
目的 开发一种用于胸部 X 线摄影(CR)肱骨头肿瘤检测的人工智能(AI)系统,并评估其对读者性能的影响。
材料与方法 本回顾性研究共纳入 13468 例患者的 14709 例 CR(2000 年 1 月至 2021 年 12 月),包括 CT 证实正常( = 13116 例)和肱骨头肿瘤( = 1593 例)病例。数据分为训练组和测试组。引入一种新的训练方法,即 (FPAR),通过关注肱骨头区域来提高诊断性能。使用测试集 1 评估 AI 程序和 10 名放射科医师,放射科医师进行了两次测试(有和没有 AI 测试结果)。使用测试集 2(包含 10497 例正常图像)评估 AI 系统的性能。进行受试者工作特征分析以评估模型性能。
结果 与基于受试者工作特征曲线下面积的传统模型相比(0.87 比 0.82, =.04),AI 程序中 FPAR 的应用提高了其性能。所提出的 AI 系统还提高了肿瘤定位的准确性(80%比 57%, <.001)。在测试集 2 中,所提出的 AI 系统的假阳性率为 2%。AI 辅助可将放射科医师的敏感度、特异度和准确度分别提高 8.9%、1.2%和 3.5%(均 <.05)。
结论 纳入 FPAR 的 AI 工具提高了 CR 上肱骨头肿瘤的检测能力,并减少了肿瘤可视化的假阳性结果。它可以作为一种辅助诊断工具,提醒放射科医师注意肱骨头异常。
人工智能、常规放射摄影、肱骨、机器学习、肩部、肿瘤