Nishii Shizuka, Tomita Katsuyuki, Touge Hirokazu, Yamamoto Hiroyuki, Shigeshiro Keiji, Yamasaki Akira
Department of Respiratory Medicine, Hakuai Hospital, Yonago 683-0853, Japan.
Department of Respiratory Medicine, NHO Yonago Medical Center, Yonago 683-0006, Japan.
Yonago Acta Med. 2025 Jul 23;68(3):180-186. doi: 10.33160/yam.2025.08.002. eCollection 2025 Aug.
We designed a single-center retrospective study comparing the performance of commercially explainable artificial intelligence (XAI)-powered computer-aided detection (CAD) system of abnormal findings on chest X-rays (CXR) with that of non-experts, and pulmonology experts.
A total of 1,262 images of 1,262 subjects (mean age 49 years; 52% female) and 1,252 images of 1,252 subjects (mean age 51 years; 51% female) were obtained from DICOM formats in Hakuai Hospital Health Check-up Center, in the pre-and post-implementing XAI-powered CAD period, respectively. The ultimate decision of abnormality on CXR was made by two pulmonology experts. The diagnostic accuracy metrics were measured accuracy and negative predictive value (NPV) for detecting abnormality on CXR.
XAI-powered CAD systems achieved an accuracy of 0.84 (95% confidential interval [CI] 0.82-0.86) and NPV of 1.00 (95% CI 0.99-1.00) to detect the abnormality on CXR. For determining nodular shadows, it was found to be non-inferior to the pulmonology experts with an accuracy of 0.94 (95% CI 0.92-0.95), and NPV of 1.00 (95% CI 0.99-1.00). It tended to overestimate the abnormality of heart enlargement and pleural thickening with a tendency for lower sensitivity.
It seems likely that in the future, the most accurate screening CXR will be a double check combining with the pulmonology experts with XAI-powered CAD systems.
我们设计了一项单中心回顾性研究,比较了商业化的可解释人工智能(XAI)驱动的胸部X光(CXR)异常发现计算机辅助检测(CAD)系统与非专家及肺病专家的表现。
分别在引入XAI驱动的CAD系统之前和之后,从白怀医院健康检查中心的DICOM格式中获取了1262名受试者的1262张图像(平均年龄49岁;52%为女性)和1252名受试者的1252张图像(平均年龄51岁;51%为女性)。CXR异常的最终判定由两名肺病专家做出。测量了诊断准确性指标,即检测CXR异常的准确率和阴性预测值(NPV)。
XAI驱动的CAD系统检测CXR异常的准确率为0.84(95%置信区间[CI]0.82 - 0.86),NPV为1.00(95%CI 0.99 - 1.00)。对于确定结节阴影,发现其不劣于肺病专家,准确率为0.94(95%CI 0.92 - 0.95),NPV为1.00(95%CI 0.99 - 1.00)。它倾向于高估心脏扩大和胸膜增厚的异常情况,且敏感性有降低趋势。
未来,最准确的CXR筛查可能是将肺病专家与XAI驱动的CAD系统相结合的双重检查。