Fu Jun, Li Guangli, Tang Jianfeng, Xia Lei, Wang Lidan, Duan Shukai
College of Artificial Intelligence, Southwest University, Chongqing 400715, People's Republic of China.
National and Local Joint Engineering Research Center of Intelligent Transmission and Control Technology, Chongqing 400715, People's Republic of China.
Chaos. 2023 Sep 1;33(9). doi: 10.1063/5.0159966.
Echo state network (ESN) has gained wide acceptance in the field of time series prediction, relying on sufficiently complex reservoir connections to remember the historical features of the data and using these features to obtain the outputs by a simple linear readout. However, the randomness of its input and reservoir connections pose negative impacts on the prediction performance and performance stability of the models, the complexity of reservoir connections brings high time consumption during network computing, and the presence of randomness and complexity makes the hardware implementation of the ESN difficult. In response, we propose a double-cycle ESN (DCESN) based on the Li-ESN model, which has fixed weights to improve prediction performance and performance stability and simpler reservoir connections compared to the classical ESN to reduce the time consumption. The existence of both greatly reduces the difficulty of hardware implementation of the ESN and provides many conveniences for the future application of the ESN. Experimental results on many widely used time series datasets show that the DCESN has comparable or even better prediction performance than the ESN and good robustness against noise and parameter fluctuations.
回声状态网络(ESN)在时间序列预测领域已获得广泛认可,它依靠足够复杂的储层连接来记忆数据的历史特征,并通过简单的线性读出利用这些特征来获得输出。然而,其输入和储层连接的随机性对模型的预测性能和性能稳定性产生负面影响,储层连接的复杂性在网络计算期间带来高时间消耗,并且随机性和复杂性的存在使得ESN的硬件实现困难。作为回应,我们基于Li-ESN模型提出了一种双循环ESN(DCESN),它具有固定权重以提高预测性能和性能稳定性,并且与经典ESN相比具有更简单的储层连接以减少时间消耗。两者的存在大大降低了ESN硬件实现的难度,并为ESN的未来应用提供了许多便利。在许多广泛使用的时间序列数据集上的实验结果表明,DCESN具有与ESN相当甚至更好的预测性能,并且对噪声和参数波动具有良好的鲁棒性。