相关论文

Forecasting Economics and Financial Time Series: ARIMA vs. LSTM

Abstract:Forecasting time series data is an important subject in economics, business, and finance. Traditionally, there are several techniques to effectively forecast the next lag of time series data such as univariate Autoregressive (AR), univariate Moving Average (MA), Simple Exponential Smoothing (SES), and more notably Autoregressive Integrated Moving Average (ARIMA) with its many variations. In particular, ARIMA model has demonstrated its outperformance in precision and accuracy of predicting the next lags of time series. With the recent advancement in computational power of computers and more importantly developing more advanced machine learning algorithms and approaches such as deep learning, new algorithms are developed to forecast time series data. The research question investigated in this article is that whether and how the newly developed deep learning-based algorithms for forecasting time series data, such as "Long Short-Term Memory (LSTM)", are superior to the traditional algorithms. The empirical studies conducted and reported in this article show that deep learning-based algorithms such as LSTM outperform traditional-based algorithms such as ARIMA model. More specifically, the average reduction in error rates obtained by LSTM is between 84 - 87 percent when compared to ARIMA indicating the superiority of LSTM to ARIMA. Furthermore, it was noticed that the number of training times, known as "epoch" in deep learning, has no effect on the performance of the trained forecast model and it exhibits a truly random behavior.

参考文献

[1]  Harshal Patel,et al.  Predicting Stock Prices Using LSTM , 2017 .

[2]  Thomas Fischer,et al.  Deep learning with long short-term memory networks for financial market predictions , 2017, Eur. J. Oper. Res..

[3]  B. Mohamed USING AUTOREGRESSIVE INTEGRATED MOVING AVERAGE (ARIMA) MODELS TO PREDICT THE NUMBER OF PATIENT ADMISSION IN PAEDIATRIC CLINIC AT A PRIVATE HOSPITAL IN KUANTAN , 2018 .

[4]  Jürgen Schmidhuber,et al.  Learning to forget: continual prediction with LSTM , 1999 .

[5]  河原 達也 Automatic Speech Recognition and Understanding Workshop(ASRU99) , 2000 .

[6]  M. Hashem Pesaran,et al.  Time Series and Panel Data Econometrics , 2015 .

[7]  A. Banerjee,et al.  Forecasting Macroeconomic Variables for the New Member States of the European Union , 2005, SSRN Electronic Journal.

[8]  Yue Zhang,et al.  Deep Learning for Event-Driven Stock Prediction , 2015, IJCAI.

[9]  Guoqiang Peter Zhang,et al.  Neural network forecasting for seasonal and trend time series , 2005, Eur. J. Oper. Res..

[10]  Nowrouz Kohzadi,et al.  A comparison of artificial neural network and time series models for forecasting commodity prices , 1996, Neurocomputing.

[11]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[12]  Navdeep Jaitly,et al.  Hybrid speech recognition with Deep Bidirectional LSTM , 2013, 2013 IEEE Workshop on Automatic Speech Recognition and Understanding.

[13]  Ruoxuan Xiong,et al.  Deep Learning Stock Volatility with Google Domestic Trends , 2015, 1512.04916.

[14]  Matthew Scotch,et al.  Comparison of ARIMA and Random Forest time series models for prediction of avian influenza H5N1 outbreaks , 2014, BMC Bioinformatics.

[15]  John Cristian Borges Gamboa,et al.  Deep Learning for Time-Series Analysis , 2017, ArXiv.

[16]  Björn W. Schuller,et al.  From speech to letters - using a novel neural network architecture for grapheme based ASR , 2009, 2009 IEEE Workshop on Automatic Speech Recognition & Understanding.

[17]  Andrew W. Senior,et al.  Long short-term memory recurrent neural network architectures for large scale acoustic modeling , 2014, INTERSPEECH.

[18]  A. Earnest,et al.  Using autoregressive integrated moving average (ARIMA) models to predict and monitor the number of beds occupied during a SARS outbreak in a tertiary hospital in Singapore , 2005, BMC health services research.

[19]  Daniel P. W. Ellis,et al.  Connectionist speech recognition of Broadcast News , 2002, Speech Commun..

[20]  Andrew W. Senior,et al.  Long Short-Term Memory Based Recurrent Neural Network Architectures for Large Vocabulary Speech Recognition , 2014, ArXiv.

[21]  Seong Joon Yoo,et al.  A Deep Efficient Frontier Method for Optimal Investments , 2017 .

[22]  Josh Patterson,et al.  Deep Learning: A Practitioner's Approach , 2017 .

[23]  Aderemi Oluyinka Adewumi,et al.  Stock Price Prediction Using the ARIMA Model , 2014, 2014 UKSim-AMSS 16th International Conference on Computer Modelling and Simulation.

[24]  Nicolas Huck,et al.  Pairs selection and outranking: An application to the S&P 100 index , 2009, Eur. J. Oper. Res..

[25]  George Athanasopoulos,et al.  Forecasting: principles and practice , 2013 .

[26]  Mehdi Khashei,et al.  A novel hybridization of artificial neural networks and ARIMA models for time series forecasting , 2011, Appl. Soft Comput..

[27]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[28]  Peter Loos,et al.  Evaluating Forecasting Methods by Considering Different Accuracy Measures , 2016 .

引用
LSTM-Based Quantitative Trading Using Dynamic K-Top and Kelly Criterion
2020 International Joint Conference on Neural Networks (IJCNN)
2020
Alohomora: Motion-Based Hotword Detection in Head-Mounted Displays
IEEE Internet of Things Journal
2020
A Prediction Model of Wechat Official Account's Article Reading Volume
CSAI '18
2018
Threatening second wave of COVID-19 is imminent: A deep learning perspective
medRxiv
2020
A Neural-based model to Predict the Future Natural Gas Market Price through Open-domain Event Extraction
CLEOPATRA@ESWC
2020
Open-domain Event Extraction and Embedding for Natural Gas Market Prediction
ArXiv
2019
Forecasting directional movements of stock prices for intraday trading using LSTM and random forests
ArXiv
2020
Low Rank Forecasting
ArXiv
2021
The Power of Language: Understanding Sentiment Towards the Climate Emergency using Twitter Data
2020
Modeling Time Series Data with Deep Learning: A Review, Analysis, Evaluation and Future Trend
2020 8th International Conference on Information Technology and Multimedia (ICIMU)
2020
Online Non-stationary Time Series Analysis and Processing
ArXiv
2019
Building segment based revenue prediction for CLV model
2019
An Auto Regressive Deep Learning Model for Sales Tax Forecasting from Multiple Short Time Series
2019 18th IEEE International Conference On Machine Learning And Applications (ICMLA)
2019
Enforcing Optimal Moving Target Defense Policies
2019 IEEE 43rd Annual Computer Software and Applications Conference (COMPSAC)
2019
Stock market trend prediction with sentiment analysis based on LSTM neural network
2019
Inclination of Tech Stocks using Time Series Analysis and Prophecy of Returns using Recurrent Neural Network
2020 Third International Conference on Smart Systems and Inventive Technology (ICSSIT)
2020
Recurrent Neural Networks applied to Forecasting of Speed of Freight Transport in Dense Areas of Santiago, Chile
2019 IEEE CHILEAN Conference on Electrical, Electronics Engineering, Information and Communication Technologies (CHILECON)
2019
Performance evaluation of deep neural networks for forecasting time-series with multiple structural breaks and high volatility
CAAI Trans. Intell. Technol.
2019
Spatio-Temporal Crime HotSpot Detection and Prediction: A Systematic Literature Review
IEEE Access
2020
The Short and Long Run Effects of Selected Variables on Tax Revenue - A Case Study
Applied Economics and Finance
2018