EM-based identification of sparse FIR systems having quantized data1

Abstract In this paper, we explore the identification of sparse FIR systems having quantized output data. Our approach is based on the use of regularization. We explore several aspects concerning the implementation of the Expectation-Maximization (EM) algorithm, including: i) a general framework, based on mean-variance Gaussian mixtures, for incorporating a regularization term that forces sparsity, ii) utilization of Markov Chain Monte Carlo techniques (namely a Gibbs sampler) and scenarios to implement the EM algorithm for multiple input multiple output systems. We show that for single input single output systems, it is possible to obtain closed form expressions for solving the EM algorithm.

[1]  Fredrik Gustafsson,et al.  Statistical results for system identification based on quantized observations , 2009, Autom..

[2]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[3]  Erik Weyer,et al.  Finite sample properties of system identification with quantized output data , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[4]  O. Barndorff-Nielsen,et al.  Normal Variance-Mean Mixtures and z Distributions , 1982 .

[5]  Graham C. Goodwin,et al.  On identification of FIR systems having quantized output data , 2011, Autom..

[6]  Graham C. Goodwin,et al.  Estimation with Missing Data , 1999 .

[7]  Graham C. Goodwin,et al.  System identification using quantized data , 2007, 2007 46th IEEE Conference on Decision and Control.

[8]  G. Goodwin,et al.  Identification of continuous-time state-space models from non-uniform fast-sampled data , 2011 .

[9]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[10]  Andrea Garulli,et al.  Input Design in Worst-Case System Identification Using Binary Sensors , 2011, IEEE Transactions on Automatic Control.

[11]  James G. Scott,et al.  Sparse Bayes estimation in non-Gaussian models via data augmentation , 2011 .

[12]  S. Walker,et al.  Sampling Truncated Normal, Beta, and Gamma Densities , 2001 .

[13]  T. Sugie,et al.  System identification based on quantized I/O data corrupted with noises and its performance improvement , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[14]  R. Tibshirani.  Regression Shrinkage and Selection via the Lasso , 1996 .

[15]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[16]  Torbjörn Wigren,et al.  Adaptive filtering using quantized output measurements , 1998, IEEE Trans. Signal Process..