Survey and some new results on performance analysis of complex-valued parameter estimators

Recently, there has been an increased awareness that simplistic adaptation of performance analysis developed for random real-valued signals and parameters to the complex case may be inadequate or may lead to intractable calculations. Unfortunately, many fundamental statistical tools for handling complex-valued parameter estimators are missing or scattered in the open literature. In this paper, we survey some known results and provide a rigorous and unified framework to study the statistical performance of complex-valued parameter estimators with a particular attention paid to properness (i.e., second order circularity), specifically referring to the second-order statistical properties. In particular, some new properties relative to the properness of the estimates, asymptotically minimum variance bound and Whittle formulas are presented. A new look at the role of nuisance parameters is given, proving and illustrating that the noncircular Gaussian distributions do not necessarily improve the Cramer-Rao bound (CRB) with respect to the circular case. Efficiency of subspace-based complex-valued parameter estimators that are presented with a special emphasis is put on noisy linear mixture.

[1]  A. Bos Estimation of Complex Parameters , 1994 .

[2]  Jean Pierre Delmas Asymptotically minimum variance second-order estimation for noncircular signals with application to DOA estimation , 2004, IEEE Transactions on Signal Processing.

[3]  Jean Pierre Delmas,et al.  Stochastic Crame/spl acute/r-Rao bound for noncircular signals with application to DOA estimation , 2004, IEEE Transactions on Signal Processing.

[4]  P. Whittle The Analysis of Multiple Stationary Time Series , 1953 .

[5]  George A. F. Seber,et al.  A matrix handbook for statisticians , 2007 .

[6]  Jean Pierre Delmas,et al.  On the Cramer Rao bound and maximum likelihood in passive time delay estimation for complex signals , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[7]  Ken Kreutz-Delgado,et al.  The Complex Gradient Operator and the CR-Calculus ECE275A - Lecture Supplement - Fall 2005 , 2009, 0906.4835.

[8]  Kaiqi Huang,et al.  Visual information analysis for security , 2009, Signal Process..

[9]  P. Stoica,et al.  The stochastic CRB for array processing: a textbook derivation , 2001, IEEE Signal Processing Letters.

[10]  Jean Pierre Delmas,et al.  Asymptotic distribution of circularity coefficients estimate of complex random variables , 2009, Signal Process..

[11]  Eric Moulines,et al.  In-variance of subspace based estimators , 2000, IEEE Trans. Signal Process..

[12]  Jean Pierre Delmas,et al.  Extension of the matrix Bartlett's formula to the third and fourth order and to noisy linear models with application to parameter estimation , 2005, IEEE Transactions on Signal Processing.

[13]  Adriaan van den Bos,et al.  A Cramer-Rao lower bound for complex parameters , 1994, IEEE Trans. Signal Process..

[14]  V. Koivunen,et al.  On the Cramér-Rao bound for the constrained and unconstrained complex parameters , 2008, 2008 5th IEEE Sensor Array and Multichannel Signal Processing Workshop.

[15]  Visa Koivunen,et al.  Essential Statistics and Tools for Complex Random Variables , 2010, IEEE Transactions on Signal Processing.

[16]  Ing Rj Ser Approximation Theorems of Mathematical Statistics , 1980 .

[17]  B. Friedlander,et al.  Performance analysis of parameter estimation algorithms based on high‐order moments , 1989 .

[18]  J. Magnus,et al.  Matrix Differential Calculus with Applications in Statistics and Econometrics , 2019, Wiley Series in Probability and Statistics.

[19]  Donatella Darsena,et al.  Subspace-based blind channel identification of SISO-FIR systems with improper random inputs , 2004, Signal Process..

[20]  Jean Pierre Delmas,et al.  Asymptotic performance of second-order algorithms , 2002, IEEE Trans. Signal Process..

[21]  Tülay Adali,et al.  Complex-Valued Signal Processing: The Proper Way to Deal With Impropriety , 2011, IEEE Transactions on Signal Processing.

[22]  Simon Haykin,et al.  ComplexValued Adaptive Signal Processing , 2010 .

[23]  Jean Pierre Delmas,et al.  Efficiency of subspace-based DOA estimators , 2007, Signal Process..

[24]  Jean-Pierre Delmas,et al.  Performance bounds and statistical analysis of DOA estimation , 2015 .

[25]  J. Magnus,et al.  Matrix Differential Calculus with Applications in Statistics and Econometrics , 1991 .

[26]  Björn E. Ottersten,et al.  A subspace method for direction of arrival estimation of uncorrelated emitter signals , 1999, IEEE Trans. Signal Process..

[27]  E. Lehmann Elements of large-sample theory , 1998 .

[28]  Petre Stoica,et al.  Performance study of conditional and unconditional direction-of-arrival estimation , 1990, IEEE Trans. Acoust. Speech Signal Process..

[29]  G. Giannakis Cumulants: A powerful tool in signal processing , 1987, Proceedings of the IEEE.

[30]  Pierre Comon,et al.  Performance Limits of Alphabet Diversities for FIR SISO Channel Identification , 2009, IEEE Transactions on Signal Processing.

[31]  Benedikt Loesch,et al.  Cramér-Rao Bound for Circular and Noncircular Complex Independent Component Analysis , 2013, IEEE Transactions on Signal Processing.

[32]  B. Friedlander,et al.  An approximate maximum likelihood approach to ARMA spectral estimation , 1985, 1985 24th IEEE Conference on Decision and Control.

[33]  L. Scharf,et al.  Statistical Signal Processing of Complex-Valued Data: The Theory of Improper and Noncircular Signals , 2010 .

[34]  H. Vincent Poor,et al.  Complex-valued signal processing — essential models, tools and statistics , 2011, 2011 Information Theory and Applications Workshop.