Department of Industrial Engineering, University of Arkansas, Fayetteville, Arkansas, USA.
Department of Biological Sciences, University of Arkansas, Fayetteville, Arkansas, USA.
J Am Med Inform Assoc. 2022 Apr 13;29(5):900-908. doi: 10.1093/jamia/ocac003.
This study aims to establish an informative dynamic prediction model of treatment outcomes using follow-up records of tuberculosis (TB) patients, which can timely detect cases when the current treatment plan may not be effective.
We used 122 267 follow-up records from 17 958 new cases of pulmonary TB in the Republic of Moldova. A dynamic prediction framework integrating landmark modeling and machine learning algorithms was designed to predict patient outcomes during the course of treatment. Sensitivity and positive predictive value (PPV) were calculated to evaluate performance of the model at critical time points. New measures were defined to determine when follow-up laboratory tests should be conducted to obtain most informative results.
The random-forest algorithm performed better than support vector machine and penalized multinomial logistic regression models for predicting TB treatment outcomes. For all 3 outcome classes (ie, cured, not cured, and died after 24 months following treatment initiation), sensitivity and PPV of prediction models improved as more follow-up information was collected. Specifically, sensitivity and PPV increased from 0.55 to 0.84 and from 0.32 to 0.88, respectively, for the not cured class.
The dynamic prediction framework utilizes longitudinal laboratory test results to predict patient outcomes at various landmarks. Sputum culture and smear results are among the important variables for prediction; however, the most recent sputum result is not always the most informative one. This framework can potentially facilitate a more effective treatment monitoring program and provide insights for policymakers toward improved guidelines on follow-up tests.
本研究旨在利用结核病(TB)患者的随访记录建立一个信息丰富的治疗结果动态预测模型,以便及时发现当前治疗方案可能无效的情况。
我们使用了摩尔多瓦共和国 17958 例新的肺结核病例的 122267 份随访记录。设计了一种集成里程碑建模和机器学习算法的动态预测框架,以预测患者在治疗过程中的结局。计算了敏感性和阳性预测值(PPV),以评估模型在关键时间点的性能。定义了新的措施来确定何时进行随访实验室检查以获得最具信息性的结果。
随机森林算法在预测结核病治疗结局方面优于支持向量机和惩罚多项逻辑回归模型。对于所有 3 种结局类别(即治愈、未治愈和治疗后 24 个月后死亡),随着收集更多的随访信息,预测模型的敏感性和 PPV均有所提高。具体来说,未治愈类别的敏感性和 PPV分别从 0.55 提高到 0.84 和从 0.32 提高到 0.88。
动态预测框架利用纵向实验室检测结果在各个里程碑处预测患者结局。痰培养和涂片结果是预测的重要变量之一;然而,最近的痰检结果并不总是最具信息性的。该框架有可能促进更有效的治疗监测计划,并为政策制定者提供有关随访检测改进指南的见解。