Department of Anesthesiology, University of Michigan Health System, Ann Arbor, Michigan; Department of Computational Medicine and Bioinformatics, University of Michigan Health System, Ann Arbor, Michigan; Michigan Integrated Center for Health Analytics and Medical Prediction, Institute for Healthcare Policy and Innovation, University of Michigan, Ann Arbor, Michigan; and Michigan Center for Integrative Research in Critical Care, University of Michigan, Ann Arbor, Michigan.
Department of Anesthesiology, University of Michigan Health System, Ann Arbor, Michigan.
Anesthesiology. 2022 Nov 1;137(5):586-601. doi: 10.1097/ALN.0000000000004345.
Postoperative hemodynamic deterioration among cardiac surgical patients can indicate or lead to adverse outcomes. Whereas prediction models for such events using electronic health records or physiologic waveform data are previously described, their combined value remains incompletely defined. The authors hypothesized that models incorporating electronic health record and processed waveform signal data (electrocardiogram lead II, pulse plethysmography, arterial catheter tracing) would yield improved performance versus either modality alone.
Intensive care unit data were reviewed after elective adult cardiac surgical procedures at an academic center between 2013 and 2020. Model features included electronic health record features and physiologic waveforms. Tensor decomposition was used for waveform feature reduction. Machine learning-based prediction models included a 2013 to 2017 training set and a 2017 to 2020 temporal holdout test set. The primary outcome was a postoperative deterioration event, defined as a composite of low cardiac index of less than 2.0 ml min-1 m-2, mean arterial pressure of less than 55 mmHg sustained for 120 min or longer, new or escalated inotrope/vasopressor infusion, epinephrine bolus of 1 mg or more, or intensive care unit mortality. Prediction models analyzed data 8 h before events.
Among 1,555 cases, 185 (12%) experienced 276 deterioration events, most commonly including low cardiac index (7.0% of patients), new inotrope (1.9%), and sustained hypotension (1.4%). The best performing model on the 2013 to 2017 training set yielded a C-statistic of 0.803 (95% CI, 0.799 to 0.807), although performance was substantially lower in the 2017 to 2020 test set (0.709, 0.705 to 0.712). Test set performance of the combined model was greater than corresponding models limited to solely electronic health record features (0.641; 95% CI, 0.637 to 0.646) or waveform features (0.697; 95% CI, 0.693 to 0.701).
Clinical deterioration prediction models combining electronic health record data and waveform data were superior to either modality alone, and performance of combined models was primarily driven by waveform data. Decreased performance of prediction models during temporal validation may be explained by data set shift, a core challenge of healthcare prediction modeling.
心脏外科患者术后血流动力学恶化可预示或导致不良结局。虽然已有使用电子健康记录或生理波形数据预测此类事件的模型,但它们的综合价值仍未得到充分定义。作者假设,结合电子健康记录和处理后的波形信号数据(心电图导联 II、脉搏血氧仪、动脉导管描记)的模型将比单独使用任何一种模型的性能有所提高。
在学术中心对 2013 年至 2020 年间择期成人心脏外科手术后的重症监护病房数据进行了回顾。模型特征包括电子健康记录特征和生理波形。张量分解用于波形特征降维。基于机器学习的预测模型包括 2013 年至 2017 年的训练集和 2017 年至 2020 年的时间保留测试集。主要结局是术后恶化事件,定义为低心指数(<2.0 ml min-1 m-2)、平均动脉压(<55 mmHg)持续 120 分钟或更长时间、新的或升级的正性肌力/血管加压输注、肾上腺素推注 1mg 或更多、或重症监护病房死亡率的复合事件。预测模型在事件发生前 8 小时分析数据。
在 1555 例患者中,185 例(12%)发生 276 例恶化事件,最常见的包括低心指数(7.0%的患者)、新的正性肌力(1.9%)和持续低血压(1.4%)。在 2013 年至 2017 年的训练集上表现最好的模型的 C 统计量为 0.803(95%CI,0.799 至 0.807),尽管在 2017 年至 2020 年的测试集中的性能要低得多(0.709,0.705 至 0.712)。联合模型的测试集性能优于仅限制于电子健康记录特征(0.641;95%CI,0.637 至 0.646)或波形特征(0.697;95%CI,0.693 至 0.701)的相应模型。
结合电子健康记录数据和波形数据的临床恶化预测模型优于单独使用任何一种模型,且联合模型的性能主要由波形数据驱动。在时间验证期间预测模型性能下降可能是由于数据集中存在的偏差,这是医疗保健预测建模的核心挑战。