School of Electrical and Information Engineering, Tianjin University, 300072, Tianjin, China.
School of Electrical and Information Engineering, Tianjin University, 300072, Tianjin, China.
Neural Netw. 2020 Jun;126:347-361. doi: 10.1016/j.neunet.2020.03.022. Epub 2020 Apr 2.
A conformal predictive system(CPS) is based on the learning framework of conformal prediction, which outputs cumulative distribution functions(CDFs) for labels in regression problems. The CDFs output by a CPS provide useful information for users, as they not only provide probability for the events related to the test labels, but also can be transformed to prediction intervals with the corresponding quantiles. Moreover, CPSs have the property of validity since the distributions and intervals they output have statistical compatibility with the realizations. This property is very useful for many risk-sensitive applications such as financial time series forecast and weather forecast. However, as based on conformal predictors, CPSs inherit the computational issue. To build a fast CPS, in this paper, we propose a CPS with regularized extreme learning machine as the underlying algorithm. To be specific, we combine the leave-one-out cross-conformal predictive system(Leave-One-Out CCPS), a variant of the original CPS, with regularized extreme learning machine(RELM), which is named as LOO-CCPS-RELM. We analyse the computational complexity of it and prove its asymptotic validity based on some regularity assumptions. We also prove that the error rate of the prediction interval output by LOO-CCPS-RELM is under control in the asymptotic setting. Experiments with 20 public data sets were conducted to test LOO-CCPS-RELM and the results showed that LOO-CCPS-RELM is empirically valid and compared favourably with the other CPSs.
一个保形预测系统(CPS)是基于保形预测的学习框架,它为回归问题中的标签输出累积分布函数(CDF)。CPS 输出的 CDF 为用户提供了有用的信息,因为它们不仅为与测试标签相关的事件提供了概率,还可以通过相应的分位数转换为预测区间。此外,CPS 具有有效性属性,因为它们输出的分布和区间与实现具有统计兼容性。这种属性对于许多风险敏感的应用非常有用,例如金融时间序列预测和天气预报。然而,由于基于保形预测器,CPS 继承了计算问题。为了构建一个快速的 CPS,在本文中,我们提出了一个基于正则化极限学习机的 CPS 作为底层算法。具体来说,我们将Leave-One-Out 交叉保形预测系统(Leave-One-Out CCPS),即原始 CPS 的一个变体,与正则化极限学习机(RELM)相结合,称为 LOO-CCPS-RELM。我们分析了它的计算复杂性,并基于一些正则性假设证明了它的渐近有效性。我们还证明了 LOO-CCPS-RELM 输出的预测区间的误差率在渐近设置下是可控的。我们使用 20 个公共数据集进行了实验来测试 LOO-CCPS-RELM,结果表明 LOO-CCPS-RELM 在经验上是有效的,并优于其他 CPS。