Data Science and Big Data Lab, Pablo de Olavide University, Seville, Spain.
Department of Commerce, SADEG Company (Sonelgaz Group), Bejaia, Algeria.
Big Data. 2021 Feb;9(1):3-21. doi: 10.1089/big.2020.0159. Epub 2020 Dec 3.
Time series forecasting has become a very intensive field of research, which is even increasing in recent years. Deep neural networks have proved to be powerful and are achieving high accuracy in many application fields. For these reasons, they are one of the most widely used methods of machine learning to solve problems dealing with big data nowadays. In this work, the time series forecasting problem is initially formulated along with its mathematical fundamentals. Then, the most common deep learning architectures that are currently being successfully applied to predict time series are described, highlighting their advantages and limitations. Particular attention is given to feed forward networks, recurrent neural networks (including Elman, long-short term memory, gated recurrent units, and bidirectional networks), and convolutional neural networks. Practical aspects, such as the setting of values for hyper-parameters and the choice of the most suitable frameworks, for the successful application of deep learning to time series are also provided and discussed. Several fruitful research fields in which the architectures analyzed have obtained a good performance are reviewed. As a result, research gaps have been identified in the literature for several domains of application, thus expecting to inspire new and better forms of knowledge.
时间序列预测已成为一个非常活跃的研究领域,近年来甚至有增无减。深度神经网络已被证明具有强大的功能,并在许多应用领域取得了很高的准确性。基于这些原因,它们是当今解决大数据问题最广泛使用的机器学习方法之一。在这项工作中,时间序列预测问题首先从数学基础的角度进行了阐述。然后,描述了目前正在成功应用于预测时间序列的最常见的深度学习架构,突出了它们的优点和局限性。特别关注前馈网络、递归神经网络(包括 Elman、长短时记忆、门控递归单元和双向网络)和卷积神经网络。还提供并讨论了成功将深度学习应用于时间序列时,超参数值的设置和最适合框架的选择等实际方面。回顾了分析的架构在几个表现良好的富有成效的研究领域。因此,文献中已经确定了几个应用领域的研究差距,从而有望激发新的更好的知识形式。