Universal, nonlinear, mean-square prediction of Markov processes

We estimate the best, nonlinear, mean-square predictor for a Markov process from an observed, finite realization of the process when the true Markov order is unknown. In particular, we propose an universal minimum complexity estimator, which does not know the true Markov order, and yet delivers the same statistical performance as that delivered by a minimum complexity estimator, which knows the true Markov order.

[1]  A. Barron Approximation and Estimation Bounds for Artificial Neural Networks , 1991, COLT '91.

[2]  M. Rosenblatt A CENTRAL LIMIT THEOREM AND A STRONG MIXING CONDITION. , 1956, Proceedings of the National Academy of Sciences of the United States of America.

[3]  Dharmendra S. Modha,et al.  Minimum complexity regression estimation with weakly dependent observations , 1996, IEEE Trans. Inf. Theory.