On identification of FIR systems having quantized output data

In this paper, we present a novel algorithm for estimating the parameters of a linear system when the observed output signal is quantized. This question has relevance to many areas including sensor networks and telecommunications. The algorithms described here have closed form solutions for the SISO case. However, for the MIMO case, a set of pre-computed scenarios is used to reduce the computational complexity of EM type algorithms that are typically deployed for this kind of problem. Comparisons are made with other algorithms that have been previously described in the literature as well as with the implementation of algorithms based on the Quasi-Newton method.

[1]  Gerald B. Folland,et al.  Real Analysis: Modern Techniques and Their Applications , 1984 .

[2]  長崎 誠三.  Victor A. Phillips: Modern Metallographic Techniques and Their Applications, Wiley-Interscience, 1971, 23.5×15.5cm, 538 ページ, 10,450 円 , 1972 .

[3]  Robin J. Evans,et al.  Feedback Control Under Data Rate Constraints: An Overview , 2007, Proceedings of the IEEE.

[4]  Joel Max,et al.  Quantizing for minimum distortion , 1960, IRE Trans. Inf. Theory.

[5]  L. Ljung,et al.  Maximum likelihood estimation of Wiener models , 2000, Proceedings of the 39th IEEE Conference on Decision and Control (Cat. No.00CH37187).

[6]  G.C. Goodwin,et al.  Approximate EM Algorithms for Parameter and State Estimation in Nonlinear Stochastic Models , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[7]  Jérôme Juillard,et al.  A Weighted Least-Squares Approach to Parameter Estimation Problems Based on Binary Measurements , 2010, IEEE Transactions on Automatic Control.

[8]  Erik Weyer,et al.  Finite sample properties of system identification with quantized output data , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[9]  G. Yin,et al.  System Identification with Quantized Observations , 2010 .

[10]  Michel Verhaegen,et al.  Identifying MIMO Wiener systems using subspace model identification methods , 1996, Signal Process..

[11]  Victor Solo,et al.  An EM algorithm for singular state space models: II , 2003, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[12]  K. Lange.  A gradient algorithm locally equivalent to the EM algorithm , 1995 .

[13]  T. Wigren.  Approximate gradients, convergence and positive realness in recursive identification of a class of non‐linear systems , 1995 .

[14]  Xiaodong Wang,et al.  Iterative receivers for space-time block-coded OFDM systems in dispersive fading channels , 2002, IEEE Trans. Wirel. Commun..

[15]  Torbjörn Wigren,et al.  MATLAB software for recursive identification of systems with output quantization : Revision 1 , 2007 .

[16]  Le Yi Wang,et al.  System identification using binary sensors , 2003, IEEE Trans. Autom. Control..

[17]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[18]  Adrian Pagan,et al.  Estimation, Inference and Specification Analysis. , 1996 .

[19]  Subhash Challa,et al.  Nonlinear filtering via generalized Edgeworth series and Gauss-Hermite quadrature , 2000, IEEE Trans. Signal Process..

[20]  S. Billings,et al.  Identification of nonlinear systems using the Wiener model , 1977 .

[21]  Le Yi Wang,et al.  Identification of Wiener systems with binary-valued output observations , 2007, Autom..

[22]  Brian L. Hughes,et al.  Joint channel estimation and data detection in space-time communications , 2003, IEEE Trans. Commun..

[23]  Meir Feder,et al.  Recursive expectation-maximization (EM) algorithms for time-varying parameters with applications to multiple target tracking , 1999, IEEE Trans. Signal Process..

[24]  Michael I. Jordan.  Learning in Graphical Models , 1999, NATO ASI Series.

[25]  A Orman,et al.  Optimization of Stochastic Models: The Interface Between Simulation and Optimization , 2012, J. Oper. Res. Soc..

[26]  Robert J. Elliott,et al.  Discrete-Time Nonlinear Filtering Algorithms Using Gauss–Hermite Quadrature , 2007, Proceedings of the IEEE.

[27]  Bonaventure Intercontinental,et al.  ON DECISION AND CONTROL , 1985 .

[28]  Geoffrey E. Hinton,et al.  A View of the Em Algorithm that Justifies Incremental, Sparse, and other Variants , 1998, Learning in Graphical Models.

[29]  Eric Moulines,et al.  Inference in hidden Markov models , 2010, Springer series in statistics.

[30]  Fredrik Gustafsson,et al.  Statistical results for system identification based on quantized observations , 2009, Autom..

[31]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[32]  Graham C. Goodwin,et al.  Scenario-based EM identification for FIR systems having quantized output data , 2009 .

[33]  Torbjörn Wigren,et al.  Adaptive filtering using quantized output measurements , 1998, IEEE Trans. Signal Process..

[34]  G. McLachlan,et al.  The EM algorithm and extensions , 1996 .

[35]  Graham C. Goodwin,et al.  Dynamic System Identification: Experiment Design and Data Analysis , 2012 .

[36]  Kaare Brandt Petersen,et al.  State-Space Models: From the EM Algorithm to a Gradient Approach , 2007, Neural Computation.

[37]  Torbjörn Wigren.  ODE analysis and redesign in blind adaptation , 1997, IEEE Trans. Autom. Control..