Jiang Xiaoqian, Osl Melanie, Kim Jihoon, Ohno-Machado Lucila
Division of Biomedical Informatics, Department of Medicine University of California, San Diego.
AMIA Jt Summits Transl Sci Proc. 2011;2011:16-20. Epub 2011 Mar 7.
Predictive models are critical for risk adjustment in clinical research. Evaluation of supervised learning models often focuses on predictive model discrimination, sometimes neglecting the assessment of their calibration. Recent research in machine learning has shown the benefits of calibrating predictive models, which becomes especially important when probability estimates are used for clinical decision making. By extending the isotonic regression method for recalibration to obtain a smoother fit in reliability diagrams, we introduce a novel method that combines parametric and non-parametric approaches. The method calibrates probabilistic outputs smoothly and shows better generalization ability than its ancestors in simulated as well as real world biomedical data sets.
预测模型对于临床研究中的风险调整至关重要。监督学习模型的评估通常侧重于预测模型的区分能力,有时会忽略对其校准的评估。机器学习领域的最新研究表明了校准预测模型的益处,当概率估计用于临床决策时,这一点变得尤为重要。通过扩展用于重新校准的等渗回归方法,以在可靠性图中获得更平滑的拟合,我们引入了一种结合参数和非参数方法的新方法。该方法能平滑地校准概率输出,并且在模拟以及真实世界的生物医学数据集中,比其前身具有更好的泛化能力。