Zhang Anguo, Xu Zheng
College of Physics and Information Engineering, Fuzhou University, Fuzhou, 350108 China.
Key Laboratory of Medical Instrumentation and Pharmaceutical Technology of Fujian Province, Fuzhou, 350116 China.
Cogn Neurodyn. 2020 Dec;14(6):849-857. doi: 10.1007/s11571-020-09612-7. Epub 2020 Jul 23.
The Conceptor network is a new framework of reservoir computing (RC), in addition to the features of easy training, global convergence, it can online learn new classes of input patterns without complete re-learning from all the training data. The conventional connection topology and weights of the hidden layer (reservoir) of RC are initialized randomly, and are fixed to be no longer fine-tuned after initialization. However, it has been demonstrated that the reservoir connection of RC plays an important role in the computational performance of RC. Therefore, in this paper, we optimize the Conceptor's reservoir connection and propose a phase space reconstruction (PSR) -based reservoir generation method. We tested the generation method on time series prediction task, and the experiment results showed that the proposed PSR-based method can improve the prediction accuracy of Conceptor networks. Further, we compared the PSR-based Conceptor with two Conceptor networks of other typical reservoir topologies (random connected, cortex-like connected), and found that all of their prediction accuracy showed a nonlinear decline trend with increasing storage load, but in comparison, our proposed PSR-based method has the best accuracy under different storage loads.
概念器网络是一种新型的储层计算(RC)框架,除了具有易于训练、全局收敛的特点外,它还能够在线学习新的输入模式类别,而无需从所有训练数据重新进行完整学习。传统的储层计算隐藏层(储层)的连接拓扑和权重是随机初始化的,初始化后固定不变不再进行微调。然而,已经证明储层计算的储层连接在其计算性能中起着重要作用。因此,在本文中,我们优化了概念器的储层连接,并提出了一种基于相空间重构(PSR)的储层生成方法。我们在时间序列预测任务上测试了该生成方法,实验结果表明所提出的基于PSR的方法可以提高概念器网络的预测精度。此外,我们将基于PSR的概念器与其他两种典型储层拓扑(随机连接、类皮层连接)的概念器网络进行了比较,发现它们的预测精度均随着存储负载的增加呈现非线性下降趋势,但相比之下,我们提出的基于PSR的方法在不同存储负载下具有最佳精度。