Optimal decomposition and classification of linear mixtures of ARMA processes

We consider the problem of detecting and classifying an unkn own number of multiple simultaneous Gaussian autoregressive-moving average (ARMA) si gnals with unknown variances given a finite length observation of their sum and a dictionary of candidat e ARMA models. We introduce the concept of mixture of ARMA ( ARMA) process and show that the detection and classification prob lem is equivalent to decomposition of a ARMA process. The optimal solution in an information theoretic s ense is found by applying the minimum description length (MDL) prin c ple. Computation of the MDL solution requires the maximization of a likelihood function of the va riances of the ARMA components for a series of subsets from the dictionary. This maximization is perfor med efficiently by combining the EM algorithm with the Rauch-Tung-Striebel optimal smoother or with a Wie ner filter-based approximation thereof and a new result on subset selection. The performance of the algor ithm is illustrated by numerical simulations. Possible extensions of the method are discussed. Potential applications are in the area of sound recognition and stochastic NMR spectroscopy. Authorization to publish this abstract separately is grant ed. EDICS Classification: SP 3.7.1, SP 3.6.1, SP 3.1.1. Christophe Couvreur’s work is also supported in part by the N ational Fund for Scientific Research of Belgium (F.N.R.S.). yYoram Bresler’s work is also supported in part by a National S cience Foundation grant No. MIP 91-57377.

[1]  Charles L. Lawson,et al.  Solving least squares problems , 1976, Classics in applied mathematics.

[2]  Mohamed A. Deriche AR parameter estimation from noisy data using the EM algorithm , 1994, Proceedings of ICASSP '94. IEEE International Conference on Acoustics, Speech and Signal Processing.

[3]  Alfred O. Hero,et al.  Lower bounds for parametric estimation with constraints , 1990, IEEE Trans. Inf. Theory.

[4]  Zdenek Vostrý New algorithm for polynomial spectral factorization with quadratic convergence. II , 1975, Kybernetika.

[5]  Markus Lang,et al.  Polynomial root finding , 1994, IEEE Signal Processing Letters.

[6]  R. Shumway,et al.  AN APPROACH TO TIME SERIES SMOOTHING AND FORECASTING USING THE EM ALGORITHM , 1982 .

[7]  Jeffrey P. Woodard,et al.  Modeling and classification of natural sounds by product code hidden Markov models , 1992, IEEE Trans. Signal Process..

[8]  B. Anderson,et al.  Optimal Filtering , 1979, IEEE Transactions on Systems, Man, and Cybernetics.

[9]  Yariv Ephraim,et al.  Statistical-model-based speech enhancement systems , 1992, Proc. IEEE.

[10]  Yoram Bresler,et al.  Decomposition of a mixture of Gaussian AR processes , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.

[11]  Henry Stark,et al.  Probability, Random Processes, and Estimation Theory for Engineers , 1995 .

[12]  Steven Kay,et al.  Modern Spectral Estimation: Theory and Application , 1988 .

[13]  Yoram Bresler,et al.  Dictionary-based decomposition of linear mixtures of Gaussian processes , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[14]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[15]  A. Kumar,et al.  Derivative computations for the log likelihood function , 1982 .

[16]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[17]  Christophe Couvreur Environmental Sound Recognition: A Statistical Approach , 1997 .

[18]  Ilan Ziskind,et al.  Multiple frequencies and AR parameters estimation from one bit quantized signal via the EM algorithm , 1993, IEEE Trans. Signal Process..

[19]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[20]  J. Rissanen,et al.  Modeling By Shortest Data Description* , 1978, Autom..

[21]  M. Simaan,et al.  IN ThE PRESENCE OF WHITE NOISE , 1985 .

[22]  New York Dover,et al.  ON THE CONVERGENCE PROPERTIES OF THE EM ALGORITHM , 1983 .