Modern Strategies for Time Series Regression

This paper discusses several modern approaches to regression analysis involving time series data where some of the predictor variables are also indexed by time. We discuss classical statistical approaches as well as methods that have been proposed recently in the machine learning literature. The approaches are compared and contrasted, and it will be seen that there are advantages and disadvantages to most currently available approaches. There is ample room for methodological developments in this area. The work is motivated by an application involving the prediction of water levels as a function of rainfall and other climate variables in an aquifer in eastern Australia.

[1]  Jina Jeong,et al.  Comparative applications of data-driven models representing water table fluctuations , 2018, Journal of Hydrology.

[2]  Jürgen Schmidhuber,et al.  LSTM: A Search Space Odyssey , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[3]  Kazuhiko Ito,et al.  Distributed Lag Analyses of Daily Hospital Admissions and Source-Apportioned Fine Particle Air Pollution , 2010, Environmental health perspectives.

[4]  George Athanasopoulos,et al.  Forecasting: principles and practice , 2013 .

[5]  Evangelos Spiliotis,et al.  Statistical and Machine Learning forecasting methods: Concerns and ways forward , 2018, PloS one.

[6]  Karsten Schulz,et al.  Rainfall–runoff modelling using Long Short-Term Memory (LSTM) networks , 2018, Hydrology and Earth System Sciences.

[7]  Gianluca Bontempi,et al.  Machine Learning Strategies for Time Series Forecasting , 2012, eBISS.

[8]  H. Guitton,et al.  Distributed Lags and Investment Analysis , 1955 .

[9]  Michael I. Jordan.  Serial Order: A Parallel Distributed Processing Approach , 1997 .

[10]  Petros Koumoutsakos,et al.  Data-driven forecasting of high-dimensional chaotic systems with long short-term memory networks , 2018, Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[11]  Reg-ARIMA model identification: empirical evidence , 2016 .

[12]  Claudia Pahl-Wostl,et al.  Water security for a planet under pressure: interconnected challenges of a changing world call for sustainable solutions , 2012 .

[13]  Christian D. Langevin,et al.  Documentation for the MODFLOW 6 Groundwater Flow Model , 2017 .

[14]  Chaopeng Shen,et al.  A Transdisciplinary Review of Deep Learning Research and Its Relevance for Water Resources Scientists , 2017, Water Resources Research.

[15]  Ruey S. Tsay,et al.  Time Series and Forecasting: Brief History and Future Research , 2000 .

[16]  S. Wood.  Generalized Additive Models: An Introduction with R , 2006 .

[17]  Rob J Hyndman,et al.  Density Forecasting for Long-Term Peak Electricity Demand , 2010, IEEE Transactions on Power Systems.

[18]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[19]  A. Maravall,et al.  Estimation, Prediction, and Interpolation for Nonstationary Series with the Kalman Filter , 1994 .

[20]  C. Perrin,et al.  Improvement of a parsimonious model for streamflow simulation , 2003 .

[21]  Douglas C. Montgomery,et al.  Modeling and Forecasting Time Series Using Transfer Function and Intervention Methods , 1980 .

[22]  Hamid Hassanpour,et al.  A comparative performance analysis of different activation functions in LSTM networks for classification , 2017, Neural Computing and Applications.

[23]  J. Friedman,et al.  Projection Pursuit Regression , 1981 .

[24]  P. Young,et al.  Time series analysis, forecasting and control , 1972, IEEE Transactions on Automatic Control.

[25]  Ju-Young Shin,et al.  Stochastic simulation on reproducing long-term memory of hydroclimatological variables using deep learning model , 2020 .

[26]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[27]  R. Tibshirani.  Regression Shrinkage and Selection via the Lasso , 1996 .

[28]  M. Bakker,et al.  Solving Groundwater Flow Problems with Time Series Analysis: You May Not Even Need Another Model , 2019, Ground water.

[29]  M. A. Wincek.  Forecasting With Dynamic Regression Models , 1993 .

[30]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[31]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[32]  M. Ye,et al.  Developing a Long Short-Term Memory (LSTM) based model for predicting water table depth in agricultural areas , 2018, Journal of Hydrology.

[33]  Abhijit Ghatak,et al.  Deep Learning with R , 2019, Springer Singapore.

[34]  Xi Cheng,et al.  Polynomial Regression As an Alternative to Neural Nets , 2018, ArXiv.