Incomplete Time Series Prediction Using Max-Margin Classification of Data with Absent Features

This paper discusses the prediction of time series with missing data. A novel forecast model is proposed based on max-margin classification of data with absent features. The issue of modeling incomplete time series is considered as classification of data with absent features. We employ the optimal hyperplane of classification to predict the future values. Compared with traditional predicting process of incomplete time series, our method solves the problem directly rather than fills the missing data in advance. In addition, we introduce an imputation method to estimate the missing data in the history series. Experimental results validate the effectiveness of our model in both prediction and imputation.

[1]  Wang Huoli SVM Nonlinear Regression Algorithm , 2005 .

[2]  Massimo Scalia,et al.  Analysis of Large-Amplitude Pulses in Short Time Intervals: Application to Neuron Interactions , 2010 .

[3]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[4]  Alexander J. Smola,et al.  Learning with Kernels: support vector machines, regularization, optimization, and beyond , 2001, Adaptive computation and machine learning series.

[5]  Chidchanok Lursinsap,et al.  Imputing time series data by regional-gradient-guided bootstrapping algorithm , 2009, 2009 9th International Symposium on Communications and Information Technology.

[6]  Bernhard Schölkopf,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2005, IEEE Transactions on Neural Networks.

[7]  D. J. Bartholomew,et al.  Time Series Analysis Forecasting and Control , 1971 .

[8]  D. Rubin Multiple Imputation After 18+ Years , 1996 .

[9]  J.A.C. Bingham,et al.  Multicarrier modulation for data transmission: an idea whose time has come , 1990, IEEE Communications Magazine.

[10]  Ming Li,et al.  Variance Bound of ACF Estimation of One Block of fGn with LRD , 2010 .

[11]  Bin Fang,et al.  Incremental Nonnegative Matrix Factorization for Face Recognition , 2008 .

[12]  Chidchanok Lursinsap,et al.  Imputing incomplete time-series data based on varied-window similarity measure of data sequences , 2007, Pattern Recognit. Lett..

[13]  Liqun Qi,et al.  A nonsmooth version of Newton's method , 1993, Math. Program..

[14]  Michael I. Jordan,et al.  Supervised learning from incomplete data via an EM approach , 1993, NIPS.

[15]  Vladimir Vapnik,et al.  The Nature of Statistical Learning , 1995 .

[16]  Ito Wasito,et al.  Nearest neighbour approach in the least-squares data imputation algorithms , 2005, Inf. Sci..

[17]  V. Rao Vemuri,et al.  Artificial Neural Networks - Forecasting Time Series , 1993 .

[18]  Francis Eng Hock Tay,et al.  Support vector machine with adaptive parameters in financial time series forecasting , 2003, IEEE Trans. Neural Networks.

[19]  Ming Li Fractal Time Series—A Tutorial Review , 2010 .

[20]  Ming Li,et al.  On the Predictability of Long-Range Dependent Series , 2010 .

[21]  Ming Li,et al.  Representation of a Stochastic Traffic Bound , 2010, IEEE Transactions on Parallel and Distributed Systems.

[22]  Pieter Abbeel,et al.  Max-margin Classification of Data with Absent Features , 2008, J. Mach. Learn. Res..

[23]  E. Bakhoum,et al.  Dynamical Aspects of Macroscopic and Quantum Transitions due to Coherence Function and Time Series Events , 2010 .

[24]  Robert H. Shumway,et al.  Time Series Analysis and Its Applications (Springer Texts in Statistics) , 2005 .

[25]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[26]  Jianwei Zhang,et al.  Vision Processing for Realtime 3-D Data Acquisition Based on Coded Structured Light , 2008, IEEE Transactions on Image Processing.