Lee Hyun Woo, Jin Kwang Nam, Oh Sohee, Kang Sung-Yoon, Lee Sang Min, Jeong In Beom, Son Ji Woong, Han Ju Hyuck, Heo Eun Young, Lee Jung Gyu, Kim Young Jae, Kim Eun Young, Cho Young Jun
Division of Respiratory and Critical Care, Department of Internal Medicine.
College of Medicine, Seoul National University, Seoul, Korea.
Ann Am Thorac Soc. 2023 May;20(5):660-667. doi: 10.1513/AnnalsATS.202206-481OC.
Artificial intelligence (AI)-assisted diagnosis imparts high accuracy to chest radiography (CXR) interpretation; however, its benefit for nonradiologist physicians in detecting lung lesions on CXR remains unclear. To investigate whether AI assistance improves the diagnostic performance of physicians for CXR interpretation and affects their clinical decisions in clinical practice. We randomly allocated eligible patients who visited an outpatient clinic to the intervention (with AI-assisted interpretation) and control (without AI-assisted interpretation) groups. Lung lesions on CXR were recorded by seven nonradiologists with or without AI assistance. The reference standard for lung lesions was established by three radiologists. The primary and secondary endpoints were the physicians' diagnostic accuracy and clinical decision, respectively. Between October 2020 and May 2021, 162 and 161 patients were assigned to the intervention and control groups, respectively. The area under the receiver operating characteristic curve was significantly larger in the intervention group than in the control group for the CXR level (0.840 [95% confidence interval (CI), 0.778-0.903] vs. 0.718 [95% CI, 0.640-0.796]; = 0.017) and lung lesion level (0.800 [95% CI, 0.740-0.861] vs. 0.677 [95% CI, 0.605-0.750]; = 0.011). The intervention group had higher sensitivity in terms of both CXR and lung lesion level and a lower false referral rate for the lung lesion level. AI-assisted CXR interpretation did not affect the physicians' clinical decisions. AI-assisted CXR interpretation improves the diagnostic performance of nonradiologist physicians in detecting abnormal lung findings. Clinical trial registered with Clinical Research Information Service of the Republic of Korea (KCT 0005466).
人工智能(AI)辅助诊断可提高胸部X线摄影(CXR)解读的准确性;然而,其对非放射科医生在CXR上检测肺部病变的益处仍不明确。为了研究AI辅助是否能提高医生对CXR解读的诊断性能,并影响他们在临床实践中的临床决策。我们将符合条件的门诊患者随机分配到干预组(有AI辅助解读)和对照组(无AI辅助解读)。由七名非放射科医生在有或无AI辅助的情况下记录CXR上的肺部病变。肺部病变的参考标准由三名放射科医生确定。主要和次要终点分别是医生的诊断准确性和临床决策。在2020年10月至2021年5月期间,分别有162例和161例患者被分配到干预组和对照组。在CXR水平(0.840 [95%置信区间(CI),0.778 - 0.903] 对 0.718 [95% CI,0.640 - 0.796];P = 0.017)和肺部病变水平(0.800 [95% CI,0.740 - 0.861] 对 0.677 [95% CI,0.605 - 0.750];P = 0.011)方面,干预组的受试者操作特征曲线下面积显著大于对照组。干预组在CXR和肺部病变水平方面均具有更高的敏感性,且在肺部病变水平方面假转诊率更低。AI辅助的CXR解读未影响医生的临床决策。AI辅助的CXR解读提高了非放射科医生检测异常肺部表现的诊断性能。在大韩民国临床研究信息服务中心注册的临床试验(KCT 0005466)。