On the Predictability of Long-Range Dependent Series

This paper points out that the predictability analysis of conventional time series may in general be invalid for long-range dependent (LRD) series since the conventional mean-square error (MSE) may generally not exist for predicting LRD series. To make the MSE of LRD series prediction exist, we introduce a generalized MSE. With that, the proof of the predictability of LRD series is presented in Hilbert space.

[1]  R. Kohn,et al.  Estimation, Prediction, and Interpolation for ARIMA Models with Missing Data , 1986 .

[2]  Narayanaswamy Balakrishnan,et al.  Prediction in a trivariate normal distribution via a linear combination of order statistics , 2009 .

[3]  Stephen S. Wolff,et al.  Linear optimum predictors , 1967, IEEE Trans. Inf. Theory.

[4]  Ezzat G. Bakhoum,et al.  Relativistic Short Range Phenomena and Space-Time Aspects of Pulse Measurements , 2008 .

[5]  Fabio Ricciato,et al.  Revisiting an old friend: on the observability of the relation between long range dependence and heavy tail , 2010, Telecommun. Syst..

[6]  A. D. Wyner,et al.  On prediction of moving-average processes , 1980, The Bell System Technical Journal.

[7]  Sílvia R. C. Lopes,et al.  Some simulations and applications of forecasting long-memory time-series models , 1999 .

[8]  Ming Li,et al.  Short Range Phenomena: Modeling, Computational Aspects and Applications , 2008 .

[9]  W. Wefelmeyer,et al.  Prediction in moving average processes , 2008 .

[10]  F. Godet.  Prediction of long memory processes on same-realisation , 2007, 0712.1922.

[11]  Ming Li.  Modeling autocorrelation functions of long-range dependent teletraffic series based on optimal approximation in Hilbert space—A further study , 2007 .

[12]  R. J. Bhansali,et al.  Asymptotic Mean-square Error of Predicting more than One-step ahead Using the Regression Method , 1974 .

[13]  Ming Li,et al.  Variance Bound of ACF Estimation of One Block of fGn with LRD , 2010 .

[14]  J. Makhoul,et al.  Linear prediction: A tutorial review , 1975, Proceedings of the IEEE.

[15]  Jan Beran,et al.  Contrasts under long-range correlations , 1993 .

[16]  Ming Li,et al.  A rigorous derivation of power spectrum of fractional Gaussian noise , 2006 .

[17]  A. N. Kolmogorov,et al.  Interpolation and extrapolation of stationary random sequences. , 1962 .

[18]  Aggregation effect and forecasting temporal aggregates of long memory processes , 2006 .

[19]  S. Resnick.  Heavy tail modeling and teletraffic data: special invited paper , 1997 .

[20]  William W. Edmonson,et al.  Linear prediction of bandlimited processes with flat spectral densities , 2001, IEEE Trans. Signal Process..

[21]  Ming Li,et al.  Modeling network traffic using generalized Cauchy process , 2008 .

[22]  H. Michiel,et al.  Teletraffic engineering in a broad-band era , 1997, Proc. IEEE.

[23]  G. U. Yule,et al.  The Foundations of Econometric Analysis: On a Method of Investigating Periodicities in Disturbed Series, with Special Reference to Wolfer's Sunspot Numbers ( Philosophical Transactions of the Royal Society of London , A, vol. 226, 1927, pp. 267–73) , 1995 .

[24]  Gennady Samorodnitsky,et al.  Heavy Tails and Long Range Dependence in On/Off Processes and Associated Fluid Models , 1998, Math. Oper. Res..

[25]  L. Zadeh,et al.  An Extension of Wiener's Theory of Prediction , 1950 .

[26]  Michael P. Clements,et al.  Forecasting economic processes , 1998 .

[27]  R. Bhansali.  Linear Prediction by Autoregressive Model Fitting in the Time Domain , 1978 .

[28]  S. Resnick.  Heavy-Tail Phenomena: Probabilistic and Statistical Modeling , 2006 .

[29]  Jan Beran,et al.  On least squares estimation for long-memory lattice processes , 2009, J. Multivar. Anal..

[30]  C. Cattani.  Shannon Wavelets Theory , 2008 .

[31]  E. Robinson,et al.  A historical perspective of spectrum estimation , 1982, Proceedings of the IEEE.

[32]  Zonghua Liu.  Chaotic Time Series Analysis , 2010 .

[33]  Granino A. Korn,et al.  Mathematical handbook for scientists and engineers , 1961 .

[34]  Ming Li,et al.  Representation of a Stochastic Traffic Bound , 2010, IEEE Transactions on Parallel and Distributed Systems.

[35]  Ming Li,et al.  Change trend of averaged Hurst parameter of traffic under DDOS flood attacks , 2006, Comput. Secur..

[36]  William W. Edmonson,et al.  The predictability of continuous-time, bandlimited processes , 2000, IEEE Trans. Signal Process..

[37]  Silvano Bordignon,et al.  Mean square prediction error for long-memory processes , 2002 .

[38]  Philippe Owezarski,et al.  Non-Gaussian and Long Memory Statistical Characterizations for Internet Traffic with Anomalies , 2007, IEEE Transactions on Dependable and Secure Computing.

[39]  Ming Li,et al.  An approach to reliably identifying signs of DDOS flood attacks based on LRD traffic pattern recognition , 2004, Comput. Secur..

[40]  Clifford M. Hurvich,et al.  Multi‐step forecasting for long‐memory processes , 1999 .

[41]  Piotr Kokoszka,et al.  Prediction of Long-Memory Time Series: A Tutorial Review , 2003 .

[42]  Norbert Wiener,et al.  Extrapolation, Interpolation, and Smoothing of Stationary Time Series , 1964 .

[43]  Bruce J. West,et al.  Fractal physiology , 1994, IEEE Engineering in Medicine and Biology Magazine.

[44]  Jae H. Kim.  Forecasting autoregressive time series with bias-corrected parameter estimators , 2003 .

[45]  M. S. Peiris,et al.  ON PREDICTION WITH FRACTIONALLY DIFFERENCED ARIMA MODELS , 1988 .

[46]  N. Levinson.  The Wiener (Root Mean Square) Error Criterion in Filter Design and Prediction , 1946 .

[47]  A. Balakrishnan.  Applied Functional Analysis , 1976 .

[48]  Luisa Bisaglia,et al.  Forecasting long memory time series when occasional breaks occur , 2008 .

[49]  Ming Li,et al.  Power spectrum of generalized Cauchy process , 2010, Telecommun. Syst..

[50]  Ezzat G. Bakhoum,et al.  Mathematical Transform of Traveling-Wave Equations and Phase Aspects of Quantum Interaction , 2010 .

[51]  N. Wiener.  The Wiener RMS (Root Mean Square) Error Criterion in Filter Design and Prediction , 1949 .

[52]  Ghiocel Toma.  Specific Differential Equations for Generating Pulse Sequences , 2010 .

[53]  Carlo Cattani,et al.  Harmonic wavelet approximation of random, fractal and high frequency signals , 2010, Telecommun. Syst..

[54]  L. Ming,et al.  Fractional Gaussian Noise and Network Traffic Modeling , 2009 .

[55]  Ming Li,et al.  Correlation matching method for the weak stationarity test of LRD traffic , 2010, Telecommun. Syst..

[56]  Q. Yao,et al.  Nonparametric regression under dependent errors with infinite variance , 2004 .

[57]  P.P. Vaidyanathan,et al.  On predicting a band-limited signal based on past sample values , 1987, Proceedings of the IEEE.

[58]  J. Beran.  Fitting long-memory models by generalized linear regression , 1993 .

[59]  Rob J Hyndman,et al.  25 years of time series forecasting , 2006 .

[60]  Rainer von Sachs,et al.  Forecasting economic time series with unconditional time-varying variance , 2004 .

[61]  Mark A. McComb.  A Practical Guide to Heavy Tails , 2000, Technometrics.

[62]  Ming Li.  Generation of teletraffic of generalized Cauchy type , 2010 .

[63]  B.S. Atal.  The history of linear prediction , 2006, IEEE Signal Processing Magazine.

[64]  Nikolai Dokuchaev.  The predictability of band-limited, high-frequency and mixed processes in the presence of ideal low-pass filters , 2008 .

[65]  Qiwei Yao,et al.  Inference in ARCH and GARCH models with heavy-tailed errors , 2003 .

[66]  H. Vincent Poor,et al.  Prediction and tracking of long-range-dependent sequences , 2005, Syst. Control. Lett..

[67]  Michael P. Clements,et al.  FORECASTING ECONOMIC TIME SERIES , 2000, Econometric Theory.

[68]  K. Man,et al.  Linear prediction of temporal aggregates under model misspecification , 2004 .

[69]  N. Cressie,et al.  Mean squared prediction error in the spatial linear model with estimated covariance parameters , 1992 .

[70]  J. Beran.  Statistical methods for data with long-range dependence , 1992 .

[71]  Jane L. Harvill,et al.  A note on multi-step forecasting with functional coefficient autoregressive models , 2005 .

[72]  Ming Li.  Fractal Time Series—A Tutorial Review , 2010 .

[73]  D. Griffel.  Applied functional analysis , 1982 .

[74]  Ghiocel Toma,et al.  Vanishing Waves on Closed Intervals and Propagating Short-Range Phenomena , 2008 .

[75]  Pierre Borgnat,et al.  Foreword to the special issue on traffic modeling, its computations and applications , 2010, Telecommun. Syst..

[76]  N. Wiener.  A Heuristic Exposition of Wiener's Mathematical Theory of Prediction and Filtering , 1949 .

[77]  R. Bhansali.  Asymptotic Properties of the Wiener‐Kolmogorov Predictor. I , 1974 .

[78]  Jan Beran,et al.  Statistics for long-memory processes , 1994 .

[79]  A. Papoulis.  A note on the predictability of band-limited processes , 1985, Proceedings of the IEEE.

[80]  Yuzhi Cai,et al.  A forecasting procedure for nonlinear autoregressive time series models , 2005 .

[81]  K. Man,et al.  Long memory time series and short term forecasts , 2003 .

[82]  Sally Floyd,et al.  Wide area traffic: the failure of Poisson modeling , 1995, TNET.

[83]  Dawei Huang,et al.  LEVINSON-TYPE RECURSIVE ALGORITHMS FOR LEAST-SQUARES AUTOREGRESSION , 1990 .