Department of Rheumatology, Leiden University Medical Center, Leiden, The Netherlands
Department of Rheumatology, Leiden University Medical Center, Leiden, The Netherlands.
RMD Open. 2021 May;7(2). doi: 10.1136/rmdopen-2020-001524.
To develop a prediction model to guide annual assessment of systemic sclerosis (SSc) patients tailored in accordance to disease activity.
A machine learning approach was used to develop a model that can identify patients without disease progression. SSc patients included in the prospective Leiden SSc cohort and fulfilling the ACR/EULAR 2013 criteria were included. Disease progression was defined as progression in ≥1 organ system, and/or start of immunosuppression or death. Using elastic-net-regularisation, and including 90 independent clinical variables (100% complete), we trained the model on 75% and validated it on 25% of the patients, optimising on negative predictive value (NPV) to minimise the likelihood of missing progression. Probability cutoffs were identified for low and high risk for disease progression by expert assessment.
Of the 492 SSc patients (follow-up range: 2-10 years), disease progression during follow-up was observed in 52% (median time 4.9 years). Performance of the model in the test set showed an AUC-ROC of 0.66. Probability score cutoffs were defined: low risk for disease progression (<0.197, NPV:1.0; 29% of patients), intermediate risk (0.197-0.223, NPV:0.82; 27%) and high risk (>0.223, NPV:0.78; 44%). The relevant variables for the model were: previous use of cyclophosphamide or corticosteroids, start with immunosuppressive drugs, previous gastrointestinal progression, previous cardiovascular event, pulmonary arterial hypertension, modified Rodnan Skin Score, creatine kinase and diffusing capacity for carbon monoxide.
Our machine-learning-assisted model for progression enabled us to classify 29% of SSc patients as 'low risk'. In this group, annual assessment programmes could be less extensive than indicated by international guidelines.
开发一种预测模型,以指导根据疾病活动度对系统性硬化症(SSc)患者进行年度评估。
采用机器学习方法开发一种模型,该模型可以识别无疾病进展的患者。纳入前瞻性莱顿 SSc 队列中符合 ACR/EULAR 2013 标准的 SSc 患者。疾病进展定义为≥1个器官系统进展,和/或开始免疫抑制治疗或死亡。使用弹性网络正则化,纳入 90 个独立的临床变量(100%完整),在 75%的患者中进行模型训练,并在 25%的患者中进行验证,优化阴性预测值(NPV)以降低漏诊疾病进展的可能性。通过专家评估确定疾病进展低风险和高风险的概率截断值。
在 492 例 SSc 患者(随访范围:2-10 年)中,随访期间观察到疾病进展 52%(中位时间 4.9 年)。模型在测试集中的表现为 AUC-ROC 为 0.66。定义概率评分截断值:疾病进展低风险(<0.197,NPV:1.0;29%的患者)、中风险(0.197-0.223,NPV:0.82;27%)和高风险(>0.223,NPV:0.78;44%)。模型的相关变量包括:既往使用环磷酰胺或皮质类固醇、开始使用免疫抑制剂、既往胃肠道进展、既往心血管事件、肺动脉高压、改良 Rodnan 皮肤评分、肌酸激酶和一氧化碳弥散量。
我们开发的进展机器学习辅助模型使我们能够将 29%的 SSc 患者归类为“低风险”。在该组中,年度评估方案可能比国际指南所指示的要少。