Chepuri R, Amzalag D, Antonsen T M, Girvan M
Department of Physics, University of Maryland, College Park, Maryland 20742, USA.
Department of Mathematics, University of Chicago, Chicago, Illinois 60637, USA.
Chaos. 2024 Jun 1;34(6). doi: 10.1063/5.0206232.
Reservoir computers (RCs) are powerful machine learning architectures for time series prediction. Recently, next generation reservoir computers (NGRCs) have been introduced, offering distinct advantages over RCs, such as reduced computational expense and lower training data requirements. However, NGRCs have their own practical difficulties, including sensitivity to sampling time and type of nonlinearities in the data. Here, we introduce a hybrid RC-NGRC approach for time series forecasting of dynamical systems. We show that our hybrid approach can produce accurate short-term predictions and capture the long-term statistics of chaotic dynamical systems in situations where the RC and NGRC components alone are insufficient, e.g., due to constraints from limited computational resources, sub-optimal hyperparameters, sparsely sampled training data, etc. Under these conditions, we show for multiple model chaotic systems that the hybrid RC-NGRC method with a small reservoir can achieve prediction performance approaching that of a traditional RC with a much larger reservoir, illustrating that the hybrid approach can offer significant gains in computational efficiency over traditional RCs while simultaneously addressing some of the limitations of NGRCs. Our results suggest that the hybrid RC-NGRC approach may be particularly beneficial in cases when computational efficiency is a high priority and an NGRC alone is not adequate.
储层计算机(RC)是用于时间序列预测的强大机器学习架构。最近,下一代储层计算机(NGRC)已被引入,与RC相比具有明显优势,例如计算成本降低和训练数据要求更低。然而,NGRC也有其自身的实际困难,包括对采样时间和数据中非线性类型的敏感性。在此,我们介绍一种用于动态系统时间序列预测的混合RC-NGRC方法。我们表明,我们的混合方法能够产生准确的短期预测,并在仅RC和NGRC组件不足的情况下(例如由于有限计算资源的限制、次优超参数、稀疏采样的训练数据等)捕捉混沌动态系统的长期统计特性。在这些条件下,我们针对多个模型混沌系统表明,具有小储层的混合RC-NGRC方法可以实现接近具有大得多的储层的传统RC的预测性能,这说明混合方法在计算效率方面比传统RC有显著提高,同时解决了NGRC的一些局限性。我们的结果表明,当计算效率是高优先级且仅NGRC不足时,混合RC-NGRC方法可能特别有益。