Versatility of constrained CRB for system analysis and design

Provided that one keeps in mind the Craḿer-Rao bound (CRB) limitations, that is, to become an overly optimistic lower bound when the observation conditions degrades, the CRB is a lower bound of great interest for analysis and design of a system of measurement in the asymptotic region. As a contribution, we introduce an original framework taking into account most (and possibly all) of the factors impacting the asymptotic estimation performance of the parameters of interest via equality constraints, leading to direct algebraic computations of constrained CRB. For complex systems, derivation of analytical expression of CRB is either impossible or inefficient. For application to active systems of measurement such as radar, we provide the general form of the Fisher information matrix (FIM) for multiple conditional models, which generally precludes the derivation of an analytical expression of the CRB for scenarios including interference and sensors modelling errors. We show that the proposed framework can also be used efficiently to generate new closed-form expressions of CRB, although this is not its main aim.

[1]  Fulvio Gini,et al.  Cramér-Rao type lower bounds for relative sensor registration process , 2011, 2010 18th European Signal Processing Conference.

[2]  Pei-Jung Chung,et al.  Array self-calibration using SAGE algorithm , 2008, 2008 5th IEEE Sensor Array and Multichannel Signal Processing Workshop.

[3]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[4]  Brian M. Sadler,et al.  The Constrained CramÉr–Rao Bound From the Perspective of Fitting a Model , 2007, IEEE Signal Processing Letters.

[5]  Petre Stoica,et al.  Performance study of conditional and unconditional direction-of-arrival estimation , 1990, IEEE Trans. Acoust. Speech Signal Process..

[6]  Michael C. Wicks,et al.  Principles of waveform diversity and design , 2011 .

[7]  Paul Tune,et al.  Computing Constrained Cramér-Rao Bounds , 2012, IEEE Transactions on Signal Processing.

[8]  P. Larzabal,et al.  On the High-SNR Conditional Maximum-Likelihood Estimator Full Statistical Characterization , 2006, IEEE Transactions on Signal Processing.

[9]  P. Whittle The Analysis of Multiple Stationary Time Series , 1953 .

[10]  Benjamin Friedlander,et al.  Sensitivity analysis of the maximum likelihood direction finding algorithm , 1989, Twenty-Third Asilomar Conference on Signals, Systems and Computers, 1989..

[11]  A. Hero,et al.  A recursive algorithm for computing Cramer-Rao- type bounds on estimator covariance , 1994, IEEE Trans. Inf. Theory.

[12]  Fulvio Gini,et al.  Cramer-Rao Bounds and Selection of Bistatic Channels for Multistatic Radar Systems , 2011, IEEE Transactions on Aerospace and Electronic Systems.

[13]  Alfred O. Hero,et al.  Lower bounds for parametric estimation with constraints , 1990, IEEE Trans. Inf. Theory.

[14]  Bhaskar D. Rao,et al.  Cramer-Rao lower bound for constrained complex parameters , 2004, IEEE Signal Processing Letters.

[15]  Anthony J. Weiss,et al.  Array shape calibration using sources in unknown locations-a maximum likelihood approach , 1988, ICASSP-88., International Conference on Acoustics, Speech, and Signal Processing.

[16]  Gongguo Tang,et al.  Constrained Cramér–Rao Bound on Robust Principal Component Analysis , 2011, IEEE Transactions on Signal Processing.

[17]  Eric Chaumette,et al.  Reparameterization and constraints for CRB: duality and a major inequality for system analysis and design in the asymptotic region , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[18]  Thomas L. Marzetta,et al.  A simple derivation of the constrained multiple parameter Cramer-Rao bound , 1993, IEEE Trans. Signal Process..

[19]  Brian M. Sadler,et al.  Bounds on bearing and symbol estimation with side information , 2001, IEEE Trans. Signal Process..

[20]  Don H. Johnson,et al.  Statistical Signal Processing , 2009, Encyclopedia of Biometrics.

[21]  Eric Chaumette,et al.  New Results on Deterministic Cramér–Rao Bounds for Real and Complex Parameters , 2012, IEEE Transactions on Signal Processing.

[22]  M. Hazewinkel Encyclopaedia of mathematics , 1987 .

[23]  Sailes K. Sengijpta Fundamentals of Statistical Signal Processing: Estimation Theory , 1995 .

[24]  Yoram Bresler,et al.  A compact Cramer-Rao bound expression for parametric estimation of superimposed signals , 1992, IEEE Trans. Signal Process..

[25]  Anne Ferréol,et al.  Performance Prediction of Maximum-Likelihood Direction-of-Arrival Estimation in the Presence of Modeling Errors , 2008, IEEE Transactions on Signal Processing.

[26]  Eric Chaumette,et al.  CRB for active radar , 2011, 2011 19th European Signal Processing Conference.

[27]  J. Munkres,et al.  Calculus on Manifolds , 1965 .

[28]  Anna Freud,et al.  Design And Analysis Of Modern Tracking Systems , 2016 .

[29]  Lei Hu,et al.  A New Derivation of Constrained Cramér-Rao Bound Via Norm Minimization , 2011, IEEE Trans. Signal Process..

[30]  Aleksandar Dogandzic,et al.  Cramer-Rao bounds for estimating range, velocity, and direction with an active array , 2001, IEEE Trans. Signal Process..

[31]  Henry Leung,et al.  Joint Data Association, Registration, and Fusion using EM-KF , 2010, IEEE Transactions on Aerospace and Electronic Systems.

[32]  Benjamin Friedlander,et al.  On the Cramer-Rao bound for time delay and Doppler estimation , 1984, IEEE Trans. Inf. Theory.

[33]  Ping-Cheng Yeh,et al.  An Interpretation of the Moore-Penrose Generalized Inverse of a Singular Fisher Information Matrix , 2011, IEEE Transactions on Signal Processing.

[34]  Edward J. Wegman,et al.  Statistical Signal Processing , 1985 .

[35]  Eric Chaumette,et al.  A New Barankin Bound Approximation for the Prediction of the Threshold Region Performance of Maximum Likelihood Estimators , 2008, IEEE Transactions on Signal Processing.

[36]  Yonina C. Eldar,et al.  The Cramér-Rao Bound for Estimating a Sparse Parameter Vector , 2010, IEEE Transactions on Signal Processing.

[37]  Joseph Tabrikian,et al.  General Classes of Performance Lower Bounds for Parameter Estimation—Part I: Non-Bayesian Bounds for Unbiased Estimators , 2010, IEEE Transactions on Information Theory.

[38]  Yonina C. Eldar,et al.  On the Constrained CramÉr–Rao Bound With a Singular Fisher Information Matrix , 2009, IEEE Signal Processing Letters.

[39]  B. C. Ng,et al.  On the Cramer-Rao bound under parametric constraints , 1998, IEEE Signal Processing Letters.

[40]  Thomas L. Marzetta,et al.  Parameter estimation problems with singular information matrices , 2001, IEEE Trans. Signal Process..

[41]  Georgios B. Giannakis,et al.  On regularity and identifiability of blind source separation under constant-modulus constraints , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[42]  Brian M. Sadler,et al.  Sufficient conditions for regularity and strict identifiability in MIMO systems , 2004, IEEE Transactions on Signal Processing.

[43]  Brian M. Sadler,et al.  Maximum-Likelihood Estimation, the CramÉr–Rao Bound, and the Method of Scoring With Parameter Constraints , 2008, IEEE Transactions on Signal Processing.

[44]  Fulvio Gini,et al.  On the identifiability problem in the presence of random nuisance parameters , 2012, Signal Process..

[45]  Mati Wax The joint estimation of differential delay, Doppler, and phase , 1982, IEEE Trans. Inf. Theory.

[46]  Adriaan van den Bos,et al.  A Cramer-Rao lower bound for complex parameters , 1994, IEEE Trans. Signal Process..

[47]  Aleksandar Dogandzic,et al.  Space-time fading channel estimation and symbol detection in unknown spatially correlated noise , 2002, IEEE Trans. Signal Process..