IEEE Trans Cybern. 2019 Jan;49(1):14-26. doi: 10.1109/TCYB.2017.2762521. Epub 2017 Oct 24.
Intelligent computing technologies are useful and important for online data modeling, where system dynamics may be nonstationary with some uncertainties. In this paper, an efficient learning mechanism is developed for building self-organizing fuzzy neural networks (SOFNNs), where a second-order algorithm (SOA) with adaptive learning rate is employed, the network size and the parameters can be determined simultaneously in the learning process. First, all parameters of SOFNN are adjusted by using the SOA strategy to achieve fast convergence through a powerful search scheme. Second, the structure of SOFNN can be self-organized using the relative importance index of each rule. The fuzzy rules used in SOFNN with SOA (SOA-SOFNN) are generated or pruned automatically to reduce the computational complexity and potentially improve the generalization power. Finally, a theoretical analysis on the learning convergence of the proposed SOA-SOFNN is given to show the computational efficiency. To demonstrate the merits of our proposed approach for data modeling, several benchmark datasets, and a real world application associated with nonlinear systems modeling problems are examined with comparisons against other existing methods. The results indicate that our proposed SOA-SOFNN performs favorably in terms of both learning speed and prediction accuracy for online data modeling.
智能计算技术对于在线数据建模非常有用和重要,因为系统动态可能是非平稳的,并且存在一些不确定性。在本文中,开发了一种有效的学习机制,用于构建自组织模糊神经网络(SOFNN),其中采用了具有自适应学习率的二阶算法(SOA),网络大小和参数可以在学习过程中同时确定。首先,通过使用 SOA 策略调整 SOFNN 的所有参数,通过强大的搜索方案实现快速收敛。其次,使用相对重要性指数对每个规则进行自组织,以实现 SOFNN 的结构自组织。使用 SOA 的 SOFNN(SOA-SOFNN)中使用的模糊规则可以自动生成或修剪,以降低计算复杂度并提高泛化能力。最后,给出了对所提出的 SOA-SOFNN 的学习收敛性的理论分析,以展示计算效率。为了证明我们提出的方法在数据建模方面的优势,使用了几个基准数据集和一个与非线性系统建模问题相关的实际应用程序,并与其他现有方法进行了比较。结果表明,在在线数据建模方面,我们提出的 SOA-SOFNN 在学习速度和预测精度方面都表现出色。