Bark David, Basu Julia, Toumpanakis Dimitrios, Burwick Nyberg Johan, Bjerner Tomas, Rostami Elham, Fällmar David
Department of Neurosciences, Neurosurgery, Uppsala University Hospital, Uppsala, Sweden.
Department of Surgical Sciences, Neuroradiology, Uppsala University, Uppsala, Sweden.
Neurotrauma Rep. 2024 Oct 14;5(1):1009-1015. doi: 10.1089/neur.2024.0017. eCollection 2024.
This study aimed to evaluate the predictive value and clinical impact of a clinically implemented artificial neural network software model. The software detects intracranial hemorrhage (ICH) from head computed tomography (CT) scans and artificial intelligence (AI)-identified positive cases are then annotated in the work list for early radiologist evaluation. The index test was AI detection by the program Zebra Medical Vision-HealthICH+. Radiologist-confirmed ICH was the reference standard. The study compared whether time benefits from using the AI model led to faster escalation of patient care or surgery within the first 24 h. A total of 2,306 patients were evaluated by the software, and 288 AI-positive cases were included. The AI tool had a positive predictive value of 0.823. There was, however, no significant time reduction when comparing the patients who required escalation of care and those who did not. There was also no significant time reduction in those who required acute surgery compared with those who did not. Among the individual patients with reduced time delay, no cases with evident clinical benefit were identified. Although the clinically implemented AI-based decision support system showed adequate predictive value in identifying ICH, there was no significant clinical benefit for the patients in our setting. While AI-assisted detection of ICH shows great promise from a technical perspective, there remains a need to evaluate the clinical impact and perform external validation across different settings.
本研究旨在评估临床应用的人工神经网络软件模型的预测价值和临床影响。该软件可从头部计算机断层扫描(CT)中检测颅内出血(ICH),人工智能(AI)识别出的阳性病例会在工作列表中进行标注,以便放射科医生尽早评估。指标检测是通过Zebra Medical Vision-HealthICH+程序进行的AI检测。放射科医生确认的ICH为参考标准。该研究比较了使用AI模型带来的时间优势是否能在24小时内更快地提升患者护理级别或进行手术。软件共评估了2306例患者,纳入了288例AI阳性病例。AI工具的阳性预测值为0.823。然而,比较需要提升护理级别的患者和不需要提升护理级别的患者时,时间并没有显著减少。与不需要进行急诊手术的患者相比,需要进行急诊手术的患者时间也没有显著减少。在时间延迟缩短的个体患者中,未发现有明显临床获益的病例。虽然临床应用的基于AI的决策支持系统在识别ICH方面显示出足够的预测价值,但在我们的研究环境中,对患者并没有显著的临床益处。虽然从技术角度来看,AI辅助检测ICH前景广阔,但仍需要评估其临床影响并在不同环境中进行外部验证。