The Cramer-Rao lower bound for bilinear systems

Estimation of the unknown parameters that characterize a bilinear system is of primary importance in many applications. The Cramer-Rao lower bound (CRLB) provides a lower bound on the covariance matrix of any unbiased estimator of unknown parameters. It is widely applied to investigate the limit of the accuracy with which parameters can be estimated from noisy data. Here it is shown that the CRLB for a data set generated by a bilinear system with additive Gaussian measurement noise can be expressed explicitly in terms of the outputs of its derivative system which is also bilinear. A connection between the nonsingularity of the Fisher information matrix and the local identifiability of the unknown parameters is exploited to derive local identifiability conditions of bilinear systems using the concept of the derivative system. It is shown that for bilinear systems with piecewise constant inputs, the CRLB for uniformly sampled data can be efficiently computed through solving a Lyapunov equation. In addition, a novel method is proposed to derive the asymptotic CRLB when the number of acquired data samples approaches infinity. These theoretical results are illustrated through the simulation of surface plasmon resonance experiments for the determination of the kinetic parameters of protein-protein interactions.

[1]  Peter Lancaster,et al.  The theory of matrices , 1969 .

[2]  Viswanath Ramakrishna,et al.  On the role of reachability and observability in NMR experimentation , 1999 .

[3]  E S Ward,et al.  The influence of signal noise on the accuracy of kinetic constants measured by surface plasmon resonance experiments. , 1999, Analytical biochemistry.

[4]  Petre Stoica,et al.  On non-singular information matrices and local identifiability , 1982 .

[5]  A. Gualtierotti H. L. Van Trees, Detection, Estimation, and Modulation Theory, , 1976 .

[6]  Benjamin Friedlander,et al.  On the computation of the Cramer Rao bound for ARMA parameter estimation , 1984, ICASSP.

[7]  L. Mirsky,et al.  The Theory of Matrices , 1961, The Mathematical Gazette.

[8]  Calyampudi R. Rao Theory of Statistical Inference , 2008 .

[9]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[10]  Bart De Moor,et al.  Subspace identification of bilinear systems subject to white inputs , 1999, IEEE Trans. Autom. Control..

[11]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[12]  Nicholas Kalouptsidis,et al.  Blind identification of bilinear systems , 2003, IEEE Trans. Signal Process..

[13]  R. R. Mohler,et al.  Nonlinear systems (vol. 2): applications to bilinear control , 1991 .

[14]  N. G. Parke,et al.  Ordinary Differential Equations. , 1958 .

[15]  S. Kay Fundamentals of statistical signal processing: estimation theory , 1993 .

[16]  Qiyue. Zou System theory in biomedical applications. , 2004 .

[17]  P. Graefe Linear stochastic systems , 1966 .

[18]  Rama Chellappa,et al.  Stochastic Approximation and Rate-Distortion Analysis for Robust Structure and Motion Estimation , 2003, International Journal of Computer Vision.

[19]  H. Leung,et al.  Adaptive identification of nonlinear systems with application to chaotic communications , 2000 .

[20]  P. Schuck,et al.  Reliable determination of binding affinity and kinetics using surface plasmon resonance biosensors. , 1997, Current opinion in biotechnology.

[21]  Rama Chellappa,et al.  3-D Motion Estimation Using a Sequence of Noisy Stereo Images: Models, Estimation, and Uniqueness Results , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  H. Piaggio Mathematical Analysis , 1955, Nature.

[23]  Raimund J. Ober The Fisher information matrix for linear systems , 2002, Syst. Control. Lett..

[24]  Petre Stoica,et al.  MUSIC, maximum likelihood, and Cramer-Rao bound , 1989, IEEE Transactions on Acoustics, Speech, and Signal Processing.

[25]  W. Rugh Nonlinear System Theory: The Volterra / Wiener Approach , 1981 .

[26]  Kevin A. Grasse,et al.  Reachability of Interior States by Piecewise Constant Controls , 1995 .

[27]  T. Rothenberg Identification in Parametric Models , 1971 .

[28]  W. D. Ray Identifiability, Recursive Identification and Spaces of Linear Dynamical Systems , 1991 .

[29]  Bo Johnsson,et al.  A novel hydrogel matrix on gold surfaces in surface plasmon resonance sensors for fast and efficient covalent immobilization of ligands , 1990 .

[30]  H. Spang,et al.  Second-order correlation method for bilinear system identification , 1977, 1977 IEEE Conference on Decision and Control including the 16th Symposium on Adaptive Processes and A Special Symposium on Fuzzy Set Theory and Applications.

[31]  Zhiping Lin,et al.  Calculation of the Fisher information matrix for multidimensional data sets , 2003, IEEE Trans. Signal Process..

[32]  Ronald R. Mohler Applications to bilinear control , 1991 .

[33]  F. R. Gantmakher The Theory of Matrices , 1984 .

[34]  Georgios B. Giannakis,et al.  Trends in channel estimation and equalization , 2001 .

[35]  Raimund J. Ober,et al.  A system theoretic formulation of NMR experiments , 1996 .

[36]  Thomas Kailath,et al.  Linear Systems , 1980 .

[37]  M. Melamed Detection , 2021, SETI: Astronomy as a Contact Sport.