Gorenshtein Alon, Fistel Shiri, Sorka Moran, Telman Gregory, Winer Raz, Peretz Shlomi, Aran Dvir, Shelly Shahar
Department of Neurology, Rambam Health Care Campus, Haifa 3109601, Israel.
Azrieli Faculty of Medicine, Bar-Ilan University, Safed 1311502, Israel.
J Clin Med. 2025 Sep 8;14(17):6333. doi: 10.3390/jcm14176333.
: We aimed to prove integration of advanced machine learning methods within a robust ensemble framework can enhance clinical decision-support for neurologists managing patients in the emergency department (ED). : We engineered an ensemble framework leveraging the capabilities of the Gemini 1.5-pro-002 large language model (LLM). The model was enhanced using prompt engineering and retrieval-augmented generation (RAG). Predictive modeling achieved by combining eXtreme Gradient Boosting (XGBoost) and logistic regression for optimal accuracy in clinical decision-making. Key clinical outcomes, such as admission and mortality, were assessed. A random subset of 100 cases was reviewed by three senior neurologists to evaluate the alignment of the AI's predictions with expert clinical judgment. : We retrospectively analyzed 1368 consecutive ED patients who underwent neurological consultations, assessing their clinical features, diagnostic tests, and admission outcomes. Patients admitted were typically older and had higher mortality rates, shorter intervals to neurological evaluation, and a higher incidence of acute stroke compared to those discharged. For the primary analysis ( = 250), the Neuro artificial intelligence (AI) model demonstrated significant performance metrics, achieving an area under the curve (AUC) of 0.88 for general admission predictions in comparison to actual outcomes, an AUC of 0.86 for neurological department admissions, 0.93 for long-term mortality risk, and 1 for 48 h mortality risk. Our Neuro AI model predictions showed a strong correlation with expert consensus (Pearson correlation 0.79, < 0.001), indicating its ability to provide consistent support amid divergent clinical opinions. : Our Neuro AI model accurately predicted hospital admissions (AUC = 0.88) and neurological department admissions (AUC = 0.86), demonstrating strong alignment with expert clinical judgment.
我们旨在证明,在一个强大的集成框架中整合先进的机器学习方法,可以增强为急诊科(ED)中管理患者的神经科医生提供的临床决策支持。我们设计了一个利用Gemini 1.5-pro-002大语言模型(LLM)能力的集成框架。该模型通过提示工程和检索增强生成(RAG)进行了优化。通过结合极端梯度提升(XGBoost)和逻辑回归实现预测建模,以在临床决策中获得最佳准确性。评估了关键临床结果,如入院情况和死亡率。由三位资深神经科医生对100例病例的随机子集进行审查,以评估人工智能预测与专家临床判断的一致性。我们回顾性分析了1368例连续接受神经科会诊的急诊科患者,评估了他们的临床特征、诊断测试和入院结果。与出院患者相比,入院患者通常年龄更大,死亡率更高,神经科评估间隔更短,急性中风发生率更高。对于主要分析(n = 250),神经人工智能(AI)模型展示了显著的性能指标,与实际结果相比,一般入院预测的曲线下面积(AUC)为0.88,神经科入院预测的AUC为0.86,长期死亡风险预测的AUC为0.93,48小时死亡风险预测的AUC为1。我们的神经人工智能模型预测与专家共识显示出很强的相关性(Pearson相关性为0.79,P < 0.001),表明其在不同临床意见中提供一致支持的能力。我们的神经人工智能模型准确预测了医院入院情况(AUC = 0.88)和神经科入院情况(AUC = 0.86),与专家临床判断高度一致。