A Review of Closed-Form Cramér-Rao Bounds for DOA Estimation in the Presence of Gaussian Noise Under a Unified Framework

The Cramér-Rao Bound (CRB) for direction of arrival (DOA) estimation has been extensively studied over the past four decades, with a plethora of CRB expressions reported for various parametric models. In the literature, there are different methods to derive a closed-form CRB expression, but many derivations tend to involve intricate matrix manipulations which appear difficult to understand. Starting from the Slepian-Bangs formula and following the simplest derivation approach, this paper reviews a number of closed-form Gaussian CRB expressions for the DOA parameter under a unified framework, based on which all the specific CRB presentations can be derived concisely. The results cover three scenarios: narrowband complex circular signals, narrowband complex noncircular signals, and wideband signals. Three signal models are considered: the deterministic model, the stochastic Gaussian model, and the stochastic Gaussian model with the a priori knowledge that the sources are spatially uncorrelated. Moreover, three Gaussian noise models distinguished by the structure of the noise covariance matrix are concerned: spatially uncorrelated noise with unknown either identical or distinct variances at different sensors, and arbitrary unknown noise. In each scenario, a unified framework for the DOA-related block of the deterministic/stochastic CRB is developed, which encompasses one class of closed-form deterministic CRB expressions and two classes of stochastic ones under the three noise models. Comparisons among different CRBs across classes and scenarios are presented, yielding a series of equalities and inequalities which reflect the benchmark for the estimation efficiency under various situations. Furthermore, validity of all CRB expressions are examined, with some specific results for linear arrays provided, leading to several upper bounds on the number of resolvable Gaussian sources in the underdetermined case.

[1]  Steven Kay,et al.  Fundamentals Of Statistical Signal Processing , 2001 .

[2]  Hong Wang,et al.  Coherent signal-subspace processing for the detection and estimation of angles of arrival of multiple wide-band sources , 1985, IEEE Trans. Acoust. Speech Signal Process..

[3]  Wei-Ping Zhu,et al.  ESPRIT-like two-dimensional direction finding for mixed circular and strictly noncircular sources based on joint diagonalization , 2017, Signal Process..

[4]  Arye Nehorai,et al.  Wideband Gaussian Source Processing Using a Linear Nested Array , 2013, IEEE Signal Processing Letters.

[5]  Huaijin Gu Reply to 'comments on "linearization method for finding cramer-rao bounds in signal processing" , 2001, IEEE Trans. Signal Process..

[6]  Bernard C. Picinbono,et al.  Second-order complex random vectors and normal distributions , 1996, IEEE Trans. Signal Process..

[7]  P. Stoica,et al.  The stochastic CRB for array processing: a textbook derivation , 2001, IEEE Signal Processing Letters.

[8]  Arye Nehorai,et al.  Further Results on the Cramér–Rao Bound for Sparse Linear Arrays , 2019, IEEE Transactions on Signal Processing.

[9]  Bin Liao,et al.  Direction Finding With Partly Calibrated Uniform Linear Arrays , 2012, IEEE Transactions on Antennas and Propagation.

[10]  Arye Nehorai,et al.  Coarrays, MUSIC, and the Cramér–Rao Bound , 2016, IEEE Transactions on Signal Processing.

[11]  Mohammed Nabil El Korso,et al.  Conditional and Unconditional Cramér–Rao Bounds for Near-Field Source Localization , 2010, IEEE Transactions on Signal Processing.

[12]  Olivier Besson,et al.  On the Fisher Information Matrix for Multivariate Elliptically Contoured Distributions , 2013, IEEE Signal Processing Letters.

[13]  P. P. Vaidyanathan,et al.  Sparse Sensing With Co-Prime Samplers and Arrays , 2011, IEEE Transactions on Signal Processing.

[14]  KUNGL TEKNISKA HÖGSKOLAN Direction Estimation in Partially Unknown Noise Fields , 1995 .

[15]  Wei Liu,et al.  Sparse array extension for non-circular signals with subspace and compressive sensing based DOA estimation methods , 2018, Signal Process..

[16]  Yide Wang,et al.  A non-circular sources direction finding method using polynomial rooting , 2001, Signal Process..

[17]  Harry L. Van Trees,et al.  Optimum Array Processing: Part IV of Detection, Estimation, and Modulation Theory , 2002 .

[18]  Wei Cui,et al.  Extension of Co-Prime Arrays Based on the Fourth-Order Difference Co-Array Concept , 2016, IEEE Signal Processing Letters.

[19]  A. Enis Çetin,et al.  Robust direction-of-arrival estimation in non-Gaussian noise , 1998, IEEE Trans. Signal Process..

[20]  Wei Cui,et al.  Low-Complexity Direction-of-Arrival Estimation Based on Wideband Co-Prime Arrays , 2015, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[21]  Philippe Forster,et al.  Unconditional Maximum Likelihood Performance at Finite Number of Samples and High Signal-to-Noise Ratio , 2007, IEEE Transactions on Signal Processing.

[22]  Jean-Pierre Le Cadre Parametric methods for spatial signal processing in the presence of unknown colored noise fields , 1989, IEEE Trans. Acoust. Speech Signal Process..

[23]  Monika Agrawal,et al.  Design And Analysis of the Sparse Array for DoA Estimation of Noncircular Signals , 2019, IEEE Transactions on Signal Processing.

[24]  Thomas L. Marzetta,et al.  Parameter estimation problems with singular information matrices , 2001, IEEE Trans. Signal Process..

[25]  T. Kailath,et al.  Spatio-temporal spectral analysis by eigenstructure methods , 1984 .

[26]  Abdelhak M. Zoubir,et al.  Non-Coherent Direction-of-Arrival Estimation Using Partly Calibrated Arrays , 2017, IEEE Transactions on Signal Processing.

[27]  Jeffrey L. Krolik,et al.  Focused wide-band array processing by spatial resampling , 1990, IEEE Trans. Acoust. Speech Signal Process..

[28]  Arye Nehorai,et al.  On identifiability and information-regularity in parametrized normal distributions , 1997 .

[29]  Fei Wen,et al.  Improved MUSIC Algorithm for Multiple Noncoherent Subarrays , 2014, IEEE Signal Processing Letters.

[30]  B. Friedlander,et al.  DOA and steering vector estimation using a partially calibrated array , 1996, IEEE Transactions on Aerospace and Electronic Systems.

[31]  David S. Slepian,et al.  Estimation of signal parameters in the presence of noise , 1954, Trans. IRE Prof. Group Inf. Theory.

[32]  Yoram Bresler,et al.  Worst case Cramer-Rao bounds for parametric estimation of superimposed signals with applications , 1992, IEEE Trans. Signal Process..

[33]  Raffaele Parisi,et al.  WAVES: weighted average of signal subspaces for robust wideband direction finding , 2001, IEEE Trans. Signal Process..

[34]  Björn E. Ottersten,et al.  Sensor array processing based on subspace fitting , 1991, IEEE Trans. Signal Process..

[35]  Bjorn Ottersten,et al.  Exact and Large Sample ML Techniques for Parameter Estimation and Detection in Array Processing , 1993 .

[36]  Petre Stoica,et al.  MUSIC, maximum likelihood, and Cramer-Rao bound: further results and comparisons , 1990, IEEE Trans. Acoust. Speech Signal Process..

[37]  Erik G. Larsson,et al.  Comments on "Linearization method for finding Cramer-Rao bounds in signal processing" [and reply] , 2001, IEEE Trans. Signal Process..

[38]  Shing-Chow Chan,et al.  Direction Finding With Partly Calibrated Uniform Linear Arrays in Nonuniform Noise , 2016, IEEE Sensors Journal.

[39]  Hagit Messer,et al.  Optimal and suboptimal broad-band source location estimation , 1993, IEEE Trans. Signal Process..

[40]  K.T. Wong,et al.  CramÉr-Rao Bounds for Direction Finding by an Acoustic Vector Sensor Under Nonideal Gain-Phase Responses, Noncollocation, or Nonorthogonal Orientation , 2009, IEEE Sensors Journal.

[41]  Petre Stoica,et al.  MUSIC, maximum likelihood, and Cramer-Rao bound , 1989, IEEE Transactions on Acoustics, Speech, and Signal Processing.

[42]  Alexei Gorokhov,et al.  Detection-estimation of more uncorrelated Gaussian sources than sensors in nonuniform linear antenna arrays .I. Fully augmentable arrays , 2001, IEEE Trans. Signal Process..

[43]  R. Fisher,et al.  On the Mathematical Foundations of Theoretical Statistics , 1922 .

[44]  P. P. Vaidyanathan,et al.  Nested Arrays: A Novel Approach to Array Processing With Enhanced Degrees of Freedom , 2010, IEEE Transactions on Signal Processing.

[45]  Jean Pierre Delmas,et al.  Stochastic Crame/spl acute/r-Rao bound for noncircular signals with application to DOA estimation , 2004, IEEE Transactions on Signal Processing.

[46]  Brian M. Sadler,et al.  Performance Analysis and Bounds , 2014 .

[47]  K. G. Jinadasa,et al.  Partitioned kronecker products of matrices and applications , 1989 .

[48]  David N. Swingler,et al.  An approximate expression for the Cramer-Rao bound on DOA estimates of closely spaced sources in broadband line-array beamforming , 1994, IEEE Trans. Signal Process..

[49]  B. Friedlander,et al.  ON THE CRAMER RAO BOUND FOR DIRECTION FINDING OF CORRELATED SIGNALS , 1990, 1990 Conference Record Twenty-Fourth Asilomar Conference on Signals, Systems and Computers, 1990..

[50]  Marius Pesavento,et al.  Maximum-likelihood direction-of-arrival estimation in the presence of unknown nonuniform noise , 2001, IEEE Trans. Signal Process..

[51]  Wei Liu,et al.  Cramér-Rao Bound for Wideband DOA Estimation with Uncorrelated Sources , 2019, 2019 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[52]  Yang-Ho Choi Unified approach to Cramer-Rao bounds in direction estimation with known signal structures , 2004, Signal Process..

[53]  Yimin D. Zhang,et al.  Performance Analysis for Uniform Linear Arrays Exploiting Two Coprime Frequencies , 2018, IEEE Signal Processing Letters.

[54]  Liu Jianguo,et al.  The CRB on wideband direction of arrival estimation under the background of colored noises , 2009, 2009 2nd International Conference on Power Electronics and Intelligent Transportation System (PEITS).

[55]  John P. Ianniello High-resolution multipath time delay estimation for broad-band random signals , 1988, IEEE Trans. Acoust. Speech Signal Process..

[56]  Björn E. Ottersten,et al.  Analysis of subspace fitting and ML techniques for parameter estimation from sensor array data , 1992, IEEE Trans. Signal Process..

[57]  Wei Liu,et al.  An improved expanding and shift scheme for the construction of fourth-order difference co-arrays , 2018, Signal Process..

[58]  Florian Roemer,et al.  Deterministic Cramér-Rao bound for a mixture of circular and strictly non-circular signals , 2015, 2015 International Symposium on Wireless Communication Systems (ISWCS).

[59]  Alexei Gorokhov,et al.  Detection-estimation of more uncorrelated Gaussian sources than sensors in nonuniform linear antenna arrays. II. Partially augmentable arrays , 2001, IEEE Trans. Signal Process..

[60]  H. Neudecker,et al.  Block Kronecker products and the vecb operator , 1991 .

[61]  Olivier Besson,et al.  Direction-of-arrival estimation in a mixture of K-distributed and Gaussian noise , 2016, Signal Process..

[62]  Kung Yao,et al.  Maximum Likelihood DOA Estimation of Multiple Wideband Sources in the Presence of Nonuniform Sensor Noise , 2008, EURASIP J. Adv. Signal Process..

[63]  Rémy Boyer,et al.  A Cramér Rao bounds based analysis of 3D antenna array geometries made from ULA branches , 2013, Multidimens. Syst. Signal Process..

[64]  E. L. Lehmann,et al.  Theory of point estimation , 1950 .

[65]  Peilin Liu,et al.  DOA Estimation for Noncircular Sources with Multiple Noncoherent Subarrays , 2017, IEEE Communications Letters.

[66]  P. P. Vaidyanathan,et al.  Cramér-Rao bounds for coprime and other sparse arrays, which find more sources than sensors , 2017, Digit. Signal Process..

[67]  Erik G. Larsson,et al.  Stochastic Cramer-Rao bound for direction estimation in unknown noise fields , 2002 .

[68]  Ahsan Raza,et al.  Thinned Coprime Array for Second-Order Difference Co-Array Generation With Reduced Mutual Coupling , 2019, IEEE Transactions on Signal Processing.

[69]  A. Ouamri,et al.  Performance of high resolution frequencies estimation methods compared to the Cramer-Rao bounds , 1989, IEEE Trans. Acoust. Speech Signal Process..

[70]  Shuangzhe Liu,et al.  Hadamard, Khatri-Rao, Kronecker and Other Matrix Products , 2008 .

[71]  Hagit Messer The potential performance gain in using spectral information in passive detection/localization of wideband sources , 1995, IEEE Trans. Signal Process..

[72]  H. Luetkepohl The Handbook of Matrices , 1996 .

[73]  Xin Yang,et al.  Sparsity-Inducing DOA Estimation of Coherent Signals Under the Coexistence of Mutual Coupling and Nonuniform Noise , 2019, IEEE Access.

[74]  Xin Yuan,et al.  Cramér-rao bound of the direction-of-arrival estimation using a spatially spread electromagnetic vector-sensor , 2011, 2011 IEEE Statistical Signal Processing Workshop (SSP).

[75]  Raffaele Parisi,et al.  Space Time MUSIC: Consistent Signal Subspace Estimation for Wideband Sensor Arrays , 2017, IEEE Transactions on Signal Processing.

[76]  Fulvio Gini,et al.  Maximum likelihood, ESPRIT, and periodogram frequency estimation of radar signals in K-distributed clutter , 2000, Signal Process..

[77]  Petre Stoica,et al.  Performance study of conditional and unconditional direction-of-arrival estimation , 1990, IEEE Trans. Acoust. Speech Signal Process..

[78]  Kung Yao,et al.  Maximum-likelihood source localization and unknown sensor location estimation for wideband signals in the near-field , 2002, IEEE Trans. Signal Process..

[79]  Wei Cui,et al.  Focused Compressive Sensing for Underdetermined Wideband DOA Estimation Exploiting High-Order Difference Coarrays , 2017, IEEE Signal Processing Letters.

[80]  Rory A. Fisher,et al.  Theory of Statistical Estimation , 1925, Mathematical Proceedings of the Cambridge Philosophical Society.

[81]  Y. Bresler,et al.  Sensor-efficient wideband source location , 1989, Proceedings of the 32nd Midwest Symposium on Circuits and Systems,.

[82]  Björn E. Ottersten,et al.  Performance analysis of direction finding with large arrays and finite data , 1995, IEEE Trans. Signal Process..

[83]  Wei Liu,et al.  On the Cramér-Rao Bound and the Number of Resolvable Sources in the Presence of Nonuniform Noise for Underdetermined DOA Estimation , 2020, 2020 15th IEEE International Conference on Signal Processing (ICSP).

[84]  Anthony J. Weiss,et al.  Direction finding using noise covariance modeling , 1995, IEEE Trans. Signal Process..

[85]  Peng Chen,et al.  Gridless Sparse Direction Finding Method for Correlated Signals with Gain-Phase Errors , 2019, Electronics.

[86]  Jean-Pierre Delmas,et al.  Performance bounds and statistical analysis of DOA estimation , 2015 .

[87]  Jian Wang,et al.  Maximum Likelihood Estimation of Compound-Gaussian Clutter and Target Parameters , 2006, IEEE Transactions on Signal Processing.

[88]  Ye Tian,et al.  Calibrating nested sensor arrays for DOA estimation utilizing continuous multiplication operator , 2020, Signal Process..

[89]  Wei-Ping Zhu,et al.  Efficient Two-Dimensional Direction-of-Arrival Estimation for a Mixture of Circular and Noncircular Sources , 2016, IEEE Sensors Journal.

[90]  Yide Wang,et al.  Improved MUSIC Under the Coexistence of Both Circular and Noncircular Sources , 2008, IEEE Transactions on Signal Processing.

[91]  Arye Nehorai,et al.  Performance Analysis of Coarray-Based MUSIC in the Presence of Sensor Location Errors , 2018, IEEE Transactions on Signal Processing.

[92]  P. Vaidyanathan,et al.  Coprime sampling and the music algorithm , 2011, 2011 Digital Signal Processing and Signal Processing Education Meeting (DSP/SPE).

[93]  Adriaan van den Bos,et al.  The multivariate complex normal distribution-a generalization , 1995, IEEE Trans. Inf. Theory.

[94]  Anthony J. Weiss,et al.  Maximum-Likelihood Direction Finding of Wide-Band Sources , 1993, IEEE Trans. Signal Process..

[95]  Tapan K. Sarkar,et al.  A note on the Cramer-Rao bound for 2-D direction finding based on 2-D array , 1991, IEEE Trans. Signal Process..

[96]  Braham Himed,et al.  Sparsity-based DOA estimation using co-prime arrays , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[97]  Yimin Zhang,et al.  Generalized Coprime Array Configurations for Direction-of-Arrival Estimation , 2015, IEEE Transactions on Signal Processing.

[98]  Houcem Gazzah,et al.  Cramer-Rao bounds for antenna array design , 2006, IEEE Transactions on Signal Processing.

[99]  Siliang Wu,et al.  Simplified and Enhanced Multiple Level Nested Arrays Exploiting High-Order Difference Co-Arrays , 2019, IEEE Transactions on Signal Processing.

[100]  Shahrokh Valaee,et al.  Wideband array processing using a two-sided correlation transformation , 1995, IEEE Trans. Signal Process..

[101]  Martin Morf,et al.  Modal decomposition signal subspace algorithms , 1986, IEEE Trans. Acoust. Speech Signal Process..

[102]  Florian Roemer,et al.  Deterministic Cramér-Rao Bound for Strictly Non-Circular Sources and Analytical Analysis of the Achievable Gains , 2016, IEEE Transactions on Signal Processing.

[103]  Siliang Wu,et al.  Underdetermined DOA Estimation Under the Compressive Sensing Framework: A Review , 2016, IEEE Access.

[104]  Arogyaswami Paulraj,et al.  A harmonic noise model for direction finding in colored ambient noise , 1995, IEEE Signal Processing Letters.

[105]  Huaijin Gu Linearization method for finding Cramer-Rao bounds in signal processing , 2000, IEEE Trans. Signal Process..

[106]  P. Larzabal,et al.  On the High-SNR Conditional Maximum-Likelihood Estimator Full Statistical Characterization , 2006, IEEE Transactions on Signal Processing.

[107]  Johann F. Böhme,et al.  On the direction estimation Cramér-Rao bounds in the presence of uncorrelated unknown noise , 1999 .

[108]  P. P. Vaidyanathan,et al.  Super Nested Arrays: Linear Sparse Arrays With Reduced Mutual Coupling—Part I: Fundamentals , 2016, IEEE Transactions on Signal Processing.

[109]  Yimin D. Zhang,et al.  DOA Estimation Using Compressed Sparse Array , 2018, IEEE Transactions on Signal Processing.

[110]  Piya Pal,et al.  On Maximum-Likelihood Methods for Localizing More Sources Than Sensors , 2017, IEEE Signal Processing Letters.

[111]  Piya Pal,et al.  Cramér–Rao Bounds for Underdetermined Source Localization , 2016, IEEE Signal Processing Letters.

[112]  Piya Pal,et al.  Performance of Uniform and Sparse Non-Uniform Samplers In Presence of Modeling Errors: A Cramér-Rao Bound Based Study , 2017, IEEE Transactions on Signal Processing.

[113]  Wei Liu,et al.  An effective localization method for mixed far-field and near-field strictly non-circular sources , 2019, Digit. Signal Process..

[114]  Joseph M. Francos,et al.  Bounds for estimation of complex exponentials in unknown colored noise , 1995, IEEE Trans. Signal Process..

[115]  Jean Pierre Delmas,et al.  Cramer-Rao bounds of DOA estimates for BPSK and QPSK Modulated signals , 2006, IEEE Transactions on Signal Processing.

[116]  Björn E. Ottersten,et al.  A subspace method for direction of arrival estimation of uncorrelated emitter signals , 1999, IEEE Trans. Signal Process..

[117]  Petre Stoica,et al.  Spectral Analysis of Signals , 2009 .

[118]  Miriam A. Doron,et al.  Wavefield modeling and array processing. III. Resolution capacity , 1994, IEEE Trans. Signal Process..

[119]  Mostafa Kaveh,et al.  On the statistical sufficiency of the coherently averaged covariance matrix for the estimation of the parameters of wideband sources , 1987, ICASSP '87. IEEE International Conference on Acoustics, Speech, and Signal Processing.

[120]  Fabrizio Sellone Robust auto-focusing wideband DOA estimation , 2006, Signal Process..

[121]  J. Delmas,et al.  Gaussian Cramer-Rao bound for direction estimation of noncircular signals in unknown noise fields , 2005, IEEE Transactions on Signal Processing.