School of Electrical Engineering, Southwest Jiaotong University, Chengdu 611756, China.
School of Electrical Engineering, Southwest Jiaotong University, Chengdu 611756, China.
Neural Netw. 2024 Nov;179:106521. doi: 10.1016/j.neunet.2024.106521. Epub 2024 Jul 8.
The broad learning system (BLS) is an effective machine learning model that exhibits excellent feature extraction ability and fast training speed. However, the traditional BLS is derived from the minimum mean square error (MMSE) criterion, which is highly sensitive to non-Gaussian noise. In order to enhance the robustness of BLS, this paper reconstructs the objective function of BLS based on the maximum multi-kernel correntropy criterion (MMKCC), and obtains a new robust variant of BLS (MKC-BLS). For the multitude of parameters involved in MMKCC, an effective parameter optimization method is presented. The fixed-point iteration method is employed to further optimize the model, and a reliable convergence proof is provided. In comparison to the existing robust variants of BLS, MKC-BLS exhibits superior performance in the non-Gaussian noise environment, particularly in the multi-modal noise environment. Experiments on multiple public datasets and real application validate the efficacy of the proposed method.
宽学习系统 (BLS) 是一种有效的机器学习模型,具有出色的特征提取能力和快速的训练速度。然而,传统的 BLS 是基于最小均方误差 (MMSE) 准则导出的,对非高斯噪声非常敏感。为了增强 BLS 的鲁棒性,本文基于最大多核相关熵准则 (MMKCC) 重建了 BLS 的目标函数,并得到了一个新的稳健变体 BLS (MKC-BLS)。针对 MMKCC 中涉及的众多参数,提出了一种有效的参数优化方法。采用定点迭代法进一步优化模型,并给出了可靠的收敛证明。与现有的稳健变体 BLS 相比,MKC-BLS 在非高斯噪声环境下表现出更好的性能,特别是在多模态噪声环境下。在多个公共数据集和实际应用中的实验验证了所提方法的有效性。