Department of Medical Ultrasonics, Ultrasomics Artificial Intelligence X-Lab, Institute of Diagnostic and Interventional Ultrasound, The First Affiliated Hospital of Sun Yat-Sen University, Guangzhou, China.
Department of Hepatobiliary Surgery, The First Affiliated Hospital of Sun Yat-sen University, Guangzhou, China.
J Gastroenterol Hepatol. 2021 Oct;36(10):2875-2883. doi: 10.1111/jgh.15522. Epub 2021 May 5.
This study aims to construct a strategy that uses assistance from artificial intelligence (AI) to assist radiologists in the identification of malignant versus benign focal liver lesions (FLLs) using contrast-enhanced ultrasound (CEUS).
A training set (patients = 363) and a testing set (patients = 211) were collected from our institute. On four-phase CEUS images in the training set, a composite deep learning architecture was trained and tuned for differentiating malignant and benign FLLs. In the test dataset, AI performance was evaluated by comparison with radiologists with varied levels of experience. Based on the comparison, an AI assistance strategy was constructed, and its usefulness in reducing CEUS interobserver heterogeneity was further tested.
In the test set, to identify malignant versus benign FLLs, AI achieved an area under the curve of 0.934 (95% CI 0.890-0.978) with an accuracy of 91.0%. Comparing with radiologists reviewing videos along with complementary patient information, AI outperformed residents (82.9-84.4%, P = 0.038) and matched the performance of experts (87.2-88.2%, P = 0.438). Due to the higher positive predictive value (PPV) (AI: 95.6% vs residents: 88.6-89.7%, P = 0.056), an AI strategy was defined to improve the malignant diagnosis. With the assistance of AI, radiologists exhibited a sensitivity improvement of 97.0-99.4% (P < 0.05) and an accuracy of 91.0-92.9% (P = 0.008-0.189), which was comparable with that of the experts (P = 0.904).
The CEUS-based AI strategy improved the performance of residents and reduced CEUS's interobserver heterogeneity in the differentiation of benign and malignant FLLs.
本研究旨在构建一种策略,利用人工智能(AI)辅助,帮助放射科医生通过对比增强超声(CEUS)鉴别肝脏局灶性病变(FLL)的良恶性。
从我们医院收集了一个训练集(患者=363)和一个测试集(患者=211)。在训练集中的四期 CEUS 图像上,训练并调整了一种复合深度学习架构,用于区分良恶性 FLL。在测试数据集中,通过与不同经验水平的放射科医生进行比较来评估 AI 的性能。在此基础上,构建了一种 AI 辅助策略,并进一步测试了其在降低 CEUS 观察者间异质性方面的作用。
在测试集中,AI 识别良恶性 FLL 的曲线下面积为 0.934(95%CI 0.890-0.978),准确率为 91.0%。与观看视频并补充患者信息的放射科医生相比,AI 优于住院医师(82.9-84.4%,P=0.038),与专家的表现相当(87.2-88.2%,P=0.438)。由于更高的阳性预测值(PPV)(AI:95.6%比住院医师:88.6-89.7%,P=0.056),定义了一种 AI 策略来提高恶性诊断。在 AI 的辅助下,放射科医生的敏感性提高了 97.0-99.4%(P<0.05),准确性提高了 91.0-92.9%(P=0.008-0.189),与专家相当(P=0.904)。
基于 CEUS 的 AI 策略提高了住院医师的性能,并降低了 CEUS 在鉴别良恶性 FLL 中的观察者间异质性。