IEEE Trans Neural Netw Learn Syst. 2012 Feb;23(2):260-76. doi: 10.1109/TNNLS.2011.2178321.
This paper introduces a wide framework for online, i.e., time-adaptive, supervised multiregression tasks. The problem is formulated in a general infinite-dimensional reproducing kernel Hilbert space (RKHS). In this context, a fairly large number of nonlinear multiregression models fall as special cases, including the linear case. Any convex, continuous, and not necessarily differentiable function can be used as a loss function in order to quantify the disagreement between the output of the system and the desired response. The only requirement is the subgradient of the adopted loss function to be available in an analytic form. To this end, we demonstrate a way to calculate the subgradients of robust loss functions, suitable for the multiregression task. As it is by now well documented, when dealing with online schemes in RKHS, the memory keeps increasing with each iteration step. To attack this problem, a simple sparsification strategy is utilized, which leads to an algorithmic scheme of linear complexity with respect to the number of unknown parameters. A convergence analysis of the technique, based on arguments of convex analysis, is also provided. To demonstrate the capacity of the proposed method, the multiregressor is applied to the multiaccess multiple-input multiple-output channel equalization task for a setting with poor resources and nonavailable channel information. Numerical results verify the potential of the method, when its performance is compared with those of the state-of-the-art linear techniques, which, in contrast, use space-time coding, more antenna elements, as well as full channel information.
本文介绍了一种广泛的在线(即自适应时间)监督多回归任务框架。该问题在一般的无限维再生核希尔伯特空间(RKHS)中进行了表述。在这种情况下,相当多的非线性多回归模型作为特例出现,包括线性模型。任何凸、连续且不一定可微的函数都可以用作损失函数,以量化系统输出与期望响应之间的差异。唯一的要求是所采用的损失函数的次梯度以解析形式可用。为此,我们展示了一种计算适用于多回归任务的稳健损失函数次梯度的方法。众所周知,在 RKHS 中处理在线方案时,内存会随着每次迭代步骤而不断增加。为了解决这个问题,我们采用了一种简单的稀疏化策略,该策略导致算法方案的复杂度与未知参数的数量呈线性关系。基于凸分析的论点,我们还提供了对该技术的收敛性分析。为了展示所提出方法的能力,我们将多回归器应用于资源匮乏且无法获取信道信息的多址多输入多输出信道均衡任务中。数值结果验证了该方法的潜力,将其性能与最先进的线性技术进行了比较,后者使用了空时编码、更多的天线元件以及完整的信道信息。