Schena Francesco Paolo, Anelli Vito Walter, Trotta Joseph, Di Noia Tommaso, Manno Carlo, Tripepi Giovanni, D'Arrigo Graziella, Chesnaye Nicholas C, Russo Maria Luisa, Stangou Maria, Papagianni Aikaterini, Zoccali Carmine, Tesar Vladimir, Coppo Rosanna
Department of Emergency and Organ Transplant, University of Bari, Bari, Italy; Research Laboratory, Fondazione Schena, Valenzano, Bari, Italy.
Department of Electrical and Information Engineering, Polytechnic of Bari, Bari, Italy.
Kidney Int. 2021 May;99(5):1179-1188. doi: 10.1016/j.kint.2020.07.046. Epub 2020 Sep 2.
We have developed an artificial neural network prediction model for end-stage kidney disease (ESKD) in patients with primary immunoglobulin A nephropathy (IgAN) using a retrospective cohort of 948 patients with IgAN. Our tool is based on a two-step procedure of a classifier model that predicts ESKD, and a regression model that predicts development of ESKD over time. The classifier model showed a performance value of 0.82 (area under the receiver operating characteristic curve) in patients with a follow-up of five years, which improved to 0.89 at the ten-year follow-up. Both models had a higher recall rate, which indicated the practicality of the tool. The regression model showed a mean absolute error of 1.78 years and a root mean square error of 2.15 years. Testing in an independent cohort of 167patients with IgAN found successful results for 91% of the patients. Comparison of our system with other mathematical models showed the highest discriminant Harrell C index at five- and ten-years follow-up (81% and 86%, respectively), paralleling the lowest Akaike information criterion values (355.01 and 269.56, respectively). Moreover, our system was the best calibrated model indicating that the predicted and observed outcome probabilities did not significantly differ. Finally, the dynamic discrimination indexes of our artificial neural network, expressed as the weighted average of time-dependent areas under the curve calculated at one and two years, were 0.80 and 0.79, respectively. Similar results were observed over a 25-year follow-up period. Thus, our tool identified individuals who were at a high risk of developing ESKD due to IgAN and predicted the time-to-event endpoint. Accurate prediction is an important step toward introduction of a therapeutic strategy for improving clinical outcomes.
我们使用948例原发性免疫球蛋白A肾病(IgAN)患者的回顾性队列,开发了一种用于预测IgAN患者终末期肾病(ESKD)的人工神经网络预测模型。我们的工具基于一个两步程序,即预测ESKD的分类器模型和预测ESKD随时间发展的回归模型。在随访五年的患者中,分类器模型的性能值(受试者工作特征曲线下面积)为0.82,在十年随访时提高到0.89。两个模型都有较高的召回率,这表明了该工具的实用性。回归模型的平均绝对误差为1.78年,均方根误差为2.15年。在167例IgAN患者的独立队列中进行测试,发现91%的患者取得了成功结果。将我们的系统与其他数学模型进行比较,发现在五年和十年随访时具有最高的判别Harrell C指数(分别为81%和86%),同时具有最低的赤池信息准则值(分别为355.01和269.56)。此外,我们的系统是校准最佳的模型,表明预测结果与观察到的结果概率没有显著差异。最后,我们人工神经网络的动态判别指数,以一年和两年时计算的曲线下时间依赖面积的加权平均值表示,分别为0.80和0.79。在25年的随访期内也观察到了类似的结果。因此,我们的工具识别出了因IgAN而有高风险发展为ESKD的个体,并预测了事件发生时间终点。准确的预测是引入改善临床结果的治疗策略的重要一步。