Determination of the order of a Markov chain by Akaike's information criterion

Using Akaike's information criterion, we have presented an objective procedure for the determination of the order of an ergodic Markov chain with a finite number of states. The procedure exploits the asymptotic properties of the maximum likelihood ratio statistics and Kullback and Leibler's mean information for the discrimination between two distributions. Numerical illustrations are given, using data from Bartlett (1966), Good and Gover (1967) and some weather records.

[1]  C. Brooks,et al.  Handbook of Statistical Methods in Meteorology , 1954 .

[2]  J. Gani,et al.  SOME THEOREMS AND SUFFICIENCY CONDITIONS FOR THE MAXIMUM-LIKELIHOOD ESTIMATOR OF AN UNKNOWN PARAMETER IN A SIMPLE MARKOV CHAIN , 1955 .

[3]  H. Akaike.  Statistical predictor identification , 1970 .

[4]  M. Bartlett.  The frequency goodness of fit test for probability chains , 1951, Mathematical Proceedings of the Cambridge Philosophical Society.

[5]  W. Kennedy,et al.  Model Building for Prediction in Regression Based Upon Repeated Significance Tests , 1971 .

[6]  H. Akaike,et al.  Information Theory and an Extension of the Maximum Likelihood Principle , 1973 .

[7]  H. Akaike.  A new look at the statistical model identification , 1974 .

[8]  P. Billingsley,et al.  Statistical inference for Markov processes , 1961 .

[9]  S. Kullback.  Information Theory and Statistics , 1959 .

[10]  T. Nakagawa,et al.  Statistical approach to computer control of cement rotary kilns , 1972 .

[11]  E. Parzen.  Some recent advances in time series modeling , 1974 .

[12]  Paul G. Hoel,et al.  A TEST FOR MARKOFF CHAINS , 1954 .

[13]  T. W. Anderson,et al.  Statistical Inference about Markov Chains , 1957 .

[14]  I. Good,et al.  Corrigendum: The Generalized Serial Test and the Binary Expansion of √2 , 1967 .

[15]  I. Good.  The serial test for sampling numbers and other tests for randomness , 1953, Mathematical Proceedings of the Cambridge Philosophical Society.

[16]  E. Parzen,et al.  Some Solutions to the Time Series Modeling and Prediction Problem. , 1974 .

[17]  K. Gabriel,et al.  A Markov chain model for daily rainfall occurrence at Tel Aviv , 1962 .

[18]  B. C. Brookes,et al.  An introduction to stochastic processes, with special reference to methods and applications , 1955 .