Chan N, Sibtain N, Booth T, de Souza P, Bibby S, Mah Y-H, Teo J, U-King-Im J M
Department of Neuroradiology, King's College Hospital, London, UK; Department of Interventional Neuroradiology, The Royal London Hospital, London, UK.
Department of Neuroradiology, King's College Hospital, London, UK.
Clin Radiol. 2023 Feb;78(2):e45-e51. doi: 10.1016/j.crad.2022.10.007. Epub 2022 Nov 18.
To assess the clinical performance of a commercially available machine learning (ML) algorithm in acute stroke.
CT and CT angiography (CTA) studies of 104 consecutive patients (43 females, age range 19-93, median age 62) performed for suspected acute stroke at a single tertiary institution with real-time ML software analysis (RAPID™ ASPECTS and CTA) were included. Studies were retrospectively reviewed independently by two neuroradiologists in a blinded manner.
The cohort included 24 acute infarcts and 16 large vessel occlusions (LVO). RAPID™ ASPECTS interpretation demonstrated high sensitivity (87.5%) and NPV (87.5%) but very poor specificity (30.9%) and PPV (30.9%) for detection of acute ischaemic parenchymal changes. There was a high percentage of false positives (51.1%). In cases of proven LVO, RAPID™ ASPECTS showed good correlation with neuroradiologists' blinded independent interpretation, Pearson correlation coefficient = 0.96 (both readers), 0.63 (RAPID™ vs reader 1), 0.69 (RAPID™ vs reader 2). RAPID™ CTA interpretation demonstrated high sensitivity (92.3%), specificity (85.3%), and negative predictive (NPV) (98.5%) with moderate positive predictive value (PPV) (52.2%) for detection of LVO (N=13). False positives accounted for 12.5% of cases, of which 27.3% were attributed to arterial stenosis.
RAPID™ CTA was robust and reliable in detection of LVO. Although demonstrating high sensitivity and NPV, RAPID™ ASPECTS interpretation was associated with a high number of false positives, which decreased clinicians' confidence in the algorithm. However, in cases of proven LVO, RAPID™ ASPECTS performed well and had good correlation with neuroradiologists' blinded interpretation.
评估一种商用机器学习(ML)算法在急性卒中中的临床性能。
纳入在一家三级医疗机构对104例疑似急性卒中患者(43例女性,年龄范围19 - 93岁,中位年龄62岁)进行的CT及CT血管造影(CTA)检查,并采用实时ML软件分析(RAPID™ ASPECTS和CTA)。研究由两名神经放射科医生以盲法进行回顾性独立评估。
该队列包括24例急性梗死和16例大血管闭塞(LVO)。RAPID™ ASPECTS解读在检测急性缺血性实质改变方面显示出高敏感性(87.5%)和阴性预测值(NPV)(87.5%),但特异性(30.9%)和阳性预测值(PPV)(30.9%)非常低。假阳性率很高(51.1%)。在确诊为LVO的病例中,RAPID™ ASPECTS与神经放射科医生的盲法独立解读显示出良好的相关性,Pearson相关系数 = 0.96(两位阅片者),0.63(RAPID™与阅片者1),0.69(RAPID™与阅片者2)。RAPID™ CTA解读在检测LVO(N = 13)方面显示出高敏感性(92.3%)、特异性(85.3%)和阴性预测值(NPV)(98.5%),阳性预测值(PPV)中等(52.2%)。假阳性占病例的12.5%,其中27.3%归因于动脉狭窄。
RAPID™ CTA在检测LVO方面稳健且可靠。尽管RAPID™ ASPECTS解读显示出高敏感性和NPV,但与大量假阳性相关,这降低了临床医生对该算法的信心。然而,在确诊为LVO的病例中,RAPID™ ASPECTS表现良好,与神经放射科医生的盲法解读具有良好的相关性。