Shin Hyun Joo, Han Kyunghwa, Son Nak-Hoon, Kim Eun-Kyung, Kim Min Jung, Gatidis Sergios, Vasanawala Shreyas
Department of Radiology, Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yongin Severance Hospital, Yonsei University College of Medicine, 363, Dongbaekjukjeon-daero, Giheung-gu, Yongin-si, 16995, Gyeonggi-do, Republic of Korea.
Department of Radiology, Research Institute of Radiological Science, Severance Hospital, Yonsei University College of Medicine, 50 - 1 Yonsei-Ro, Seodaemun-Gu, Seoul, 03722, Republic of Korea.
Sci Rep. 2024 Dec 28;14(1):31329. doi: 10.1038/s41598-024-82775-z.
The purpose of this study was to evaluate whether the optimal operating points of adult-oriented artificial intelligence (AI) software differ for pediatric chest radiographs and to assess its diagnostic performance. Chest radiographs from patients under 19 years old, collected between March and November 2021, were divided into test and exploring sets. A commercial adult-oriented AI software was utilized to detect lung lesions, including pneumothorax, consolidation, nodule, and pleural effusion, using a standard operating point of 15%. A pediatric radiologist reviewed the radiographs to establish ground truth for lesion presence. To determine the optimal operating points, receiver operating characteristic (ROC) curve analysis was conducted, varying thresholds to balance sensitivity and specificity by lesion type, age group, and imaging method. The test set (4,727 chest radiographs, mean 7.2 ± 6.1 years) and exploring set (2,630 radiographs, mean 5.9 ± 6.0 years) yielded optimal operating points of 11% for pneumothorax, 14% for consolidation, 15% for nodules, and 6% for pleural effusion. Using a 3% operating point improved pneumothorax sensitivity for children under 2 years, portable radiographs, and anteroposterior projections. Therefore, optimizing operating points of AI based on lesion type, age, and imaging method could improve diagnostic performance for pediatric chest radiographs, building on adult-oriented AI as a foundation.
本研究的目的是评估面向成人的人工智能(AI)软件在儿科胸部X光片上的最佳操作点是否不同,并评估其诊断性能。收集了2021年3月至11月期间19岁以下患者的胸部X光片,并将其分为测试集和探索集。使用一款面向成人的商业AI软件,以15%的标准操作点来检测肺部病变,包括气胸、实变、结节和胸腔积液。一名儿科放射科医生对X光片进行了复查,以确定病变存在的真实情况。为了确定最佳操作点,进行了受试者操作特征(ROC)曲线分析,通过改变阈值来平衡不同病变类型、年龄组和成像方法的敏感性和特异性。测试集(4727张胸部X光片,平均年龄7.2±6.1岁)和探索集(2630张X光片,平均年龄5.9±6.0岁)得出气胸的最佳操作点为11%,实变为14%,结节为15%,胸腔积液为6%。使用3%的操作点可提高2岁以下儿童、便携式X光片和前后位投照的气胸敏感性。因此,在以面向成人的AI为基础的前提下,根据病变类型、年龄和成像方法优化AI的操作点,可以提高儿科胸部X光片的诊断性能。