Department of Anaesthesia, Pain and Perioperative Medicine, Queen Mary Hospital, Hong Kong SAR, China.
Department of Intensive Care, Pamela Youde Nethersole Eastern Hospital, Hong Kong SAR, China.
Hong Kong Med J. 2024 Apr;30(2):130-138. doi: 10.12809/hkmj2210235. Epub 2024 Mar 28.
This study compared the performance of the artificial neural network (ANN) model with the Acute Physiologic and Chronic Health Evaluation (APACHE) II and IV models for predicting hospital mortality among critically ill patients in Hong Kong.
This retrospective analysis included all patients admitted to the intensive care unit of Pamela Youde Nethersole Eastern Hospital from January 2010 to December 2019. The ANN model was constructed using parameters identical to the APACHE IV model. Discrimination performance was assessed using area under the receiver operating characteristic curve (AUROC); calibration performance was evaluated using the Brier score and Hosmer-Lemeshow statistic.
In total, 14 503 patients were included, with 10% in the validation set and 90% in the ANN model development set. The ANN model (AUROC=0.88, 95% confidence interval [CI]=0.86-0.90, Brier score=0.10; P in Hosmer-Lemeshow test=0.37) outperformed the APACHE II model (AUROC=0.85, 95% CI=0.80-0.85, Brier score=0.14; P<0.001 for both comparisons of AUROCs and Brier scores) but showed performance similar to the APACHE IV model (AUROC=0.87, 95% CI=0.85-0.89, Brier score=0.11; P=0.34 for comparison of AUROCs, and P=0.05 for comparison of Brier scores). The ANN model demonstrated better calibration than the APACHE II and APACHE IV models.
Our ANN model outperformed the APACHE II model but was similar to the APACHE IV model in terms of predicting hospital mortality in Hong Kong. Artificial neural networks are valuable tools that can enhance real-time prognostic prediction.
本研究比较了人工神经网络(ANN)模型与急性生理和慢性健康评估(APACHE)Ⅱ和Ⅳ模型在预测香港重症患者住院死亡率方面的性能。
本回顾性分析纳入了 2010 年 1 月至 2019 年 12 月期间入住 Pamela Youde Nethersole Eastern 医院重症监护病房的所有患者。ANN 模型的构建使用了与 APACHE Ⅳ模型相同的参数。使用受试者工作特征曲线下面积(AUROC)评估区分性能;使用 Brier 评分和 Hosmer-Lemeshow 统计评估校准性能。
共纳入 14503 例患者,其中 10%在验证集中,90%在 ANN 模型开发集中。ANN 模型(AUROC=0.88,95%置信区间[CI]=0.86-0.90,Brier 评分=0.10;P 值在 Hosmer-Lemeshow 检验中为 0.37)优于 APACHE Ⅱ模型(AUROC=0.85,95%CI=0.80-0.85,Brier 评分=0.14;P<0.001,AUROC 和 Brier 评分比较均如此),但与 APACHE Ⅳ模型表现相似(AUROC=0.87,95%CI=0.85-0.89,Brier 评分=0.11;P=0.34,AUROC 比较;P=0.05,Brier 评分比较)。ANN 模型的校准性能优于 APACHE Ⅱ和 APACHE Ⅳ模型。
我们的 ANN 模型在预测香港住院死亡率方面优于 APACHE Ⅱ模型,但与 APACHE Ⅳ模型相似。人工神经网络是增强实时预后预测的有价值工具。