Han Jung Hoon, Ha Sue Young, Lee Hoyeon, Park Gi-Hun, Hong Hotak, Kim Dongmin, Kim Jae Guk, Kim Joon-Tae, Sunwoo Leonard, Kim Chi Kyung, Ryu Wi-Sun
Department of Neurology, Korea University Guro Hospital, Seoul, Republic of Korea.
Artificial Intelligence Research Center, JLK Inc., Seoul, Republic of Korea.
Front Neurol. 2024 Jul 25;15:1442025. doi: 10.3389/fneur.2024.1442025. eCollection 2024.
We developed and externally validated a fully automated algorithm using deep learning to detect large vessel occlusion (LVO) in computed tomography angiography (CTA).
A total of 2,045 patients with acute ischemic stroke who underwent CTA were included in the development of our model. We validated the algorithm using two separate external datasets: one with 64 patients (external 1) and another with 313 patients (external 2), with ischemic stroke. In the context of current clinical practice, thrombectomy amenable vessel occlusion (TAVO) was defined as an occlusion in the intracranial internal carotid artery (ICA), or in the M1 or M2 segment of the middle cerebral artery (MCA). We employed the U-Net for vessel segmentation on the maximum intensity projection images, followed by the application of the EfficientNetV2 to predict TAVO. The algorithm's diagnostic performance was evaluated by calculating the area under the receiver operating characteristics curve (AUC), sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV).
The mean age in the training and validation dataset was 68.7 ± 12.6; 56.3% of participants were men, and 18.0% had TAVO. The algorithm achieved AUC of 0.950 (95% CI, 0.915-0.971) in the internal test. For the external datasets 1 and 2, the AUCs were 0.970 (0.897-0.997) and 0.971 (0.924-0.990), respectively. With a fixed sensitivity of 0.900, the specificities and PPVs for the internal test, external test 1, and external test 2 were 0.891, 0.796, and 0.930, and 0.665, 0.583, and 0.667, respectively. The algorithm demonstrated a sensitivity and specificity of approximately 0.95 in both internal and external datasets, specifically for cases involving intracranial ICA or M1-MCA occlusion. However, the diagnostic performance was somewhat reduced for isolated M2-MCA occlusion; the AUC for the internal and combined external datasets were 0.903 (0.812-0.944) and 0.916 (0.816-0.963), respectively.
We developed and externally validated a fully automated algorithm that identifies TAVO. Further research is needed to evaluate its effectiveness in real-world clinical settings. This validated algorithm has the potential to assist early-career physicians, thereby streamlining the treatment process for patients who can benefit from endovascular treatment.
我们开发并通过外部验证了一种使用深度学习的全自动算法,用于在计算机断层扫描血管造影(CTA)中检测大血管闭塞(LVO)。
共有2045例接受CTA检查的急性缺血性卒中患者纳入我们模型的开发。我们使用两个独立的外部数据集对该算法进行验证:一个包含64例患者(外部1),另一个包含313例缺血性卒中患者(外部2)。在当前临床实践背景下,可进行血栓切除术的血管闭塞(TAVO)被定义为颅内颈内动脉(ICA)或大脑中动脉(MCA)M1或M2段的闭塞。我们在最大强度投影图像上采用U-Net进行血管分割,随后应用EfficientNetV2预测TAVO。通过计算受试者操作特征曲线(AUC)下的面积、敏感性、特异性、阳性预测值(PPV)和阴性预测值(NPV)来评估该算法的诊断性能。
训练和验证数据集中的平均年龄为68.7±12.6岁;56.3%的参与者为男性,18.0%患有TAVO。该算法在内部测试中的AUC为0.950(95%CI,0.915 - 0.971)。对于外部数据集1和2,AUC分别为0.970(0.897 - 0.997)和0.971(0.924 - 0.990)。在固定敏感性为0.900时,内部测试、外部测试1和外部测试2的特异性和PPV分别为0.891、0.796和0.930,以及0.665、0.583和0.667。该算法在内部和外部数据集中的敏感性和特异性均约为0.95,特别是对于涉及颅内ICA或M1 - MCA闭塞的病例。然而,对于孤立的M2 - MCA闭塞,诊断性能有所降低;内部和合并外部数据集的AUC分别为0.903(0.812 - 0.944)和0.916(0.816 - 0.963)。
我们开发并通过外部验证了一种识别TAVO的全自动算法。需要进一步研究以评估其在实际临床环境中的有效性。这种经过验证的算法有可能帮助初出茅庐的医生,从而简化能够从血管内治疗中获益的患者的治疗过程。