Mintz Igor, Chowers Michal, Obolski Uri
School of Public Health, Tel Aviv University, Tel Aviv, Israel.
Porter School of the Environment and Earth Sciences, Tel Aviv University, Tel Aviv, Israel.
Commun Med (Lond). 2023 Mar 28;3(1):43. doi: 10.1038/s43856-023-00275-z.
Ciprofloxacin is a widely used antibiotic that has lost efficiency due to extensive resistance. We developed machine learning (ML) models that predict the probability of ciprofloxacin resistance in hospitalized patients.
Data were collected from electronic records of hospitalized patients with positive bacterial cultures, during 2016-2019. Susceptibility results to ciprofloxacin (n = 10,053 cultures) were obtained for Escherichia coli, Klebsiella pneumoniae, Morganella morganii, Pseudomonas aeruginosa, Proteus mirabilis and Staphylococcus aureus. An ensemble model, combining several base models, was developed to predict ciprofloxacin resistant cultures, either with (gnostic) or without (agnostic) information on the infecting bacterial species.
The ensemble models' predictions are well-calibrated, and yield ROC-AUCs (area under the receiver operating characteristic curve) of 0.737 (95%CI 0.715-0.758) and 0.837 (95%CI 0.821-0.854) on independent test-sets for the agnostic and gnostic datasets, respectively. Shapley additive explanations analysis identifies that influential variables are related to resistance of previous infections, where patients arrived from (hospital, nursing home, etc.), and recent resistance frequencies in the hospital. A decision curve analysis reveals that implementing our models can be beneficial in a wide range of cost-benefits considerations of ciprofloxacin administration.
This study develops ML models to predict ciprofloxacin resistance in hospitalized patients. The models achieve high predictive ability, are well calibrated, have substantial net-benefit across a wide range of conditions, and rely on predictors consistent with the literature. This is a further step on the way to inclusion of ML decision support systems into clinical practice.
环丙沙星是一种广泛使用的抗生素,但由于广泛耐药已失去疗效。我们开发了机器学习(ML)模型来预测住院患者对环丙沙星耐药的概率。
收集了2016年至2019年期间住院且细菌培养呈阳性患者的电子记录数据。获得了大肠杆菌、肺炎克雷伯菌、摩根氏摩根菌、铜绿假单胞菌、奇异变形杆菌和金黄色葡萄球菌对环丙沙星的药敏结果(n = 10,053份培养物)。开发了一种集成模型,该模型结合了多个基础模型,用于预测环丙沙星耐药培养物,无论是否有关于感染细菌种类的信息(有信息的为“gnostic”,无信息的为“agnostic”)。
集成模型的预测经过了良好校准,在独立测试集上,无信息数据集和有信息数据集的受试者操作特征曲线下面积(ROC-AUC)分别为0.737(95%CI 0.715 - 0.758)和0.837(95%CI 0.821 - 0.854)。夏普利值分析表明,有影响的变量与既往感染的耐药性、患者来源(医院、疗养院等)以及医院近期的耐药频率有关。决策曲线分析表明,在环丙沙星给药的广泛成本效益考虑中,应用我们的模型可能是有益的。
本研究开发了用于预测住院患者环丙沙星耐药性的ML模型。这些模型具有较高的预测能力,校准良好,在广泛条件下具有显著的净效益,并且所依赖的预测因素与文献一致。这是将ML决策支持系统纳入临床实践道路上的又一步。