Optimal Choice of AR and MA Parts in Autoregressive Moving Average Models

This paper deals with the Bayesian method of choosing the best model for a given one-dimensional series among a finite number of candidates belonging to autoregressive (AR), moving average (MA), ARMA, and other families. The series could be either a sequence of observations in time as in speech applications, or a sequence of pixel intensities of a two-dimensional image. The observation set is not restricted to be Gaussian. We first derive an optimum decision rule for assigning the given observation set to one of the candidate models so as to minimize the average probability of error in the decision. We also derive an optimal decision rule so as to minimize the average value of the loss function. Then we simplify the decision rule when the candidate models are different Gaussian ARMA models of different orders. We discuss the consistency of the optimal decision rule and compare it with the other decision rules in the literature for comparing dynamical models.

[1]  G. Arthur Mihram,et al.  Dynamic Stochastic Models from Empirical Data , 1978 .

[2]  J. Rissanen,et al.  Modeling By Shortest Data Description* , 1978, Autom..

[3]  H. Akaike.  A new look at the statistical model identification , 1974 .

[4]  Rama Chellappa,et al.  Stochastic models for closed boundary analysis: Representation and reconstruction , 1981, IEEE Trans. Inf. Theory.

[5]  R. Kashyap,et al.  Dynamic Stochastic Models from Empirical Data. , 1977 .

[6]  H. Akaike.  A Bayesian extension of the minimum AIC procedure of autoregressive model fitting , 1979 .

[7]  R. Shibata.  Selection of the order of an autoregressive model by Akaike's information criterion , 1976 .

[8]  E. Hannan.  The Estimation of the Order of an ARMA Process , 1980 .

[9]  Rangasami L. Kashyap,et al.  Optimal feature selection and decision rules in classification problems with time series , 1978, IEEE Trans. Inf. Theory.

[10]  R. Kashyap.  A Bayesian comparison of different classes of dynamic models using empirical data , 1977 .

[11]  R. Kashyap.  Inconsistency of the AIC rule for estimating the order of autoregressive models , 1980 .

[12]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[13]  R. Chellappa,et al.  CLASSIFICATION OF IMAGES USING FEATURES DERIVED FROM RANDOM FIELD MODELS , 1982 .

[14]  Koichiro Deguchi,et al.  Texture Characterization and Texture-Based Image Partitioning Using Two-Dimensional Linear Estimation Techniques , 1978, IEEE Transactions on Computers.

[15]  J. Makhoul,et al.  Linear prediction: A tutorial review , 1975, Proceedings of the IEEE.

[16]  T. Fine,et al.  Consistent estimation of system order , 1978, 1978 IEEE Conference on Decision and Control including the 17th Symposium on Adaptive Processes.

[17]  Rangasami L. Kashyap,et al.  Image data compression using autoregressive time series models , 1979, Pattern Recognit..