Liang Nan-Ying, Huang Guang-Bin, Saratchandran P, Sundararajan N
School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore 639798, Singapore.
IEEE Trans Neural Netw. 2006 Nov;17(6):1411-23. doi: 10.1109/TNN.2006.880583.
In this paper, we develop an online sequential learning algorithm for single hidden layer feedforward networks (SLFNs) with additive or radial basis function (RBF) hidden nodes in a unified framework. The algorithm is referred to as online sequential extreme learning machine (OS-ELM) and can learn data one-by-one or chunk-by-chunk (a block of data) with fixed or varying chunk size. The activation functions for additive nodes in OS-ELM can be any bounded nonconstant piecewise continuous functions and the activation functions for RBF nodes can be any integrable piecewise continuous functions. In OS-ELM, the parameters of hidden nodes (the input weights and biases of additive nodes or the centers and impact factors of RBF nodes) are randomly selected and the output weights are analytically determined based on the sequentially arriving data. The algorithm uses the ideas of ELM of Huang et al. developed for batch learning which has been shown to be extremely fast with generalization performance better than other batch training methods. Apart from selecting the number of hidden nodes, no other control parameters have to be manually chosen. Detailed performance comparison of OS-ELM is done with other popular sequential learning algorithms on benchmark problems drawn from the regression, classification and time series prediction areas. The results show that the OS-ELM is faster than the other sequential algorithms and produces better generalization performance.
IEEE Trans Neural Netw. 2006-11
IEEE Trans Syst Man Cybern B Cybern. 2009-8
Int J Neural Syst. 2008-10
IEEE Trans Neural Netw Learn Syst. 2012-2
IEEE Trans Neural Netw. 2009-8
IEEE Trans Neural Netw Learn Syst. 2012-9
IEEE Trans Cybern. 2013-12
IEEE Trans Neural Netw Learn Syst. 2014-7-15
IEEE Trans Neural Netw. 2006-7
IEEE Trans Neural Netw. 2006-11
PeerJ Comput Sci. 2023-12-21
Front Neuroinform. 2023-8-24
Front Artif Intell. 2023-4-17