Online Time Series Prediction with Missing Data

We consider the problem of time series prediction in the presence of missing data. We cast the problem as an online learning problem in which the goal of the learner is to minimize prediction error. We then devise an efficient algorithm for the problem, which is based on autoregressive model, and does not assume any structure on the missing data nor on the mechanism that generates the time series. We show that our algorithm's performance asymptotically approaches the performance of the best AR predictor in hindsight, and corroborate the theoretic results with an empirical study on synthetic and real-world data.

[1]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[2]  P. Robinson,et al.  Estimation of Time Series Models in the Presence of Missing Data , 1981 .

[3]  R. Shumway,et al.  AN APPROACH TO TIME SERIES SMOOTHING AND FORECASTING USING THE EM ALGORITHM , 1982 .

[4]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[5]  Bruno Sinopoli,et al.  Kalman filtering with intermittent observations , 2004, IEEE Transactions on Automatic Control.

[6]  A. Goldsmith,et al.  Kalman filtering with partial observation losses , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[7]  Fuwen Yang,et al.  Robust finite-horizon filtering for stochastic systems with missing measurements , 2005, IEEE Signal Processing Letters.

[8]  Melvin J. Hinich,et al.  Time Series Analysis by State Space Methods , 2001 .

[9]  Gábor Lugosi,et al.  Prediction, learning, and games , 2006 .

[10]  Hong Yan,et al.  Autoregressive-Model-Based Missing Value Estimation for DNA Microarray Time Series Data , 2009, IEEE Transactions on Information Technology in Biomedicine.

[11]  G. King,et al.  What to Do about Missing Values in Time‐Series Cross‐Section Data , 2010 .

[12]  Jie Ding,et al.  Time series AR modeling with missing observations based on the polynomial transformation , 2010, Math. Comput. Model..

[13]  Elad Hazan.  The convex optimization approach to regret minimization , 2011 .

[14]  Shai Shalev-Shwartz,et al.  Online Learning and Online Convex Optimization , 2012, Found. Trends Mach. Learn..

[15]  Shie Mannor,et al.  Online Learning for Time Series Prediction , 2013, COLT.

[16]  Roi Livni,et al.  Classification with Low Rank and Missing Data , 2015, ICML.