Rank-Constrained Maximum Likelihood Estimation of Structured Covariance Matrices

This paper develops and analyzes the performance of a structured covariance matrix estimate for the important practical problem of radar space-time adaptive processing in the face of severely limited training data. Traditional maximum likelihood (ML) estimators are effective when training data are abundant, but they lead to poor estimates, degraded false alarm rates, and detection loss in the realistic regime of limited training. The problem is exacerbated by recent advances, which have led to high-dimensional N of the observations arising from increased antenna elements, as well as higher temporal resolution (P time epochs and finally N = JP). This work addresses the problem by incorporating constraints in the ML estimation problem obtained from the geometry and physics of the airborne phased array radar scenario. In particular, we exploit the structure of the disturbance covariance and, importantly, knowledge of the clutter rank to derive a new rank-constrained maximum likelihood (RCML) estimator of clutter and disturbance covariance. We demonstrate that despite the presence of the challenging rank constraint, the estimation can be transformed to a convex problem and derive closed-form expressions for the estimated covariance matrix. Performance analysis using the knowledge-aided sensor signal processing and expert reasoning data set (where ground truth covariance is made available) shows that the proposed estimator outperforms state-of-the-art alternatives in the sense of a higher normalized signal-to-interference and noise ratio. Crucially, the RCML estimator excels for low training, including the notoriously difficult regime of K ≤ N training samples.

[1]  R. Klemm Principles of Space-Time Adaptive Processing , 2002 .

[2]  David A. Landgrebe,et al.  Covariance Matrix Estimation and Classification With Limited Training Data , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  A. Farina,et al.  Knowledge-aided covariance matrix estimation: A MAXDET approach , 2008 .

[4]  F. Gini,et al.  Knowledge Based Radar Detection, Tracking and Classification , 2008 .

[5]  R.C. Johnson,et al.  Introduction to adaptive arrays , 1982, Proceedings of the IEEE.

[6]  J.R. Guerci,et al.  Knowledge-aided adaptive radar at DARPA: an overview , 2006, IEEE Signal Processing Magazine.

[7]  T. W. Anderson ASYMPTOTIC THEORY FOR PRINCIPAL COMPONENT ANALYSIS , 1963 .

[8]  V. Monga,et al.  Rank constrained ML estimation of structured covariance matrices with applications in radar target detection , 2012, 2012 IEEE Radar Conference.

[9]  Qingwen Zhang,et al.  Parametric adaptive matched filter for airborne radar applications , 2000, IEEE Trans. Aerosp. Electron. Syst..

[10]  Braham Himed,et al.  A simplified parametric GLRT for STAP detection , 2009, 2009 IEEE Radar Conference.

[11]  W.L. Melvin,et al.  An approach to knowledge-aided covariance estimation , 2006, IEEE Transactions on Aerospace and Electronic Systems.

[12]  Muralidhar Rangaswamy,et al.  Robust adaptive signal processing methods for heterogeneous radar clutter scenarios , 2004, Signal Process..

[13]  A. Farina,et al.  Knowledge-based radar signal and data processing: a tutorial review , 2006, IEEE Signal Processing Magazine.

[14]  Hongbin Li,et al.  A Bayesian Parametric Test for Multichannel Adaptive Signal Detection in Nonhomogeneous Environments , 2010, IEEE Signal Processing Letters.

[15]  B. Carlson Covariance matrix estimation errors and diagonal loading in adaptive arrays , 1988 .

[16]  P. Gurram,et al.  Spectral-domain covariance estimation with a priori knowledge , 2006, IEEE Transactions on Aerospace and Electronic Systems.

[17]  H. Wang,et al.  A localized adaptive MTD processor , 1991 .

[18]  D. Tufts,et al.  Adaptive detection using low rank approximation to a data matrix , 1994 .

[19]  Douglas A. Gray,et al.  Positive-definite Toeplitz completion in DOA estimation for nonuniform linear antenna arrays. II. Partially augmentable arrays , 1998, IEEE Trans. Signal Process..

[20]  Thomas Kailath,et al.  Detection of signals by information theoretic criteria , 1985, IEEE Trans. Acoust. Speech Signal Process..

[21]  Jean-Yves Tourneret,et al.  Knowledge-Aided Bayesian Detection in Heterogeneous Environments , 2007, IEEE Signal Processing Letters.

[22]  Alfred O. Hero,et al.  Shrinkage Algorithms for MMSE Covariance Estimation , 2009, IEEE Transactions on Signal Processing.

[23]  Marco Lops,et al.  Adaptive detection schemes in compound-Gaussian clutter , 1998 .

[24]  Karl Gerlach,et al.  Fast converging adaptive processor or a structured covariance matrix , 2000, IEEE Trans. Aerosp. Electron. Syst..

[25]  A. Farina,et al.  Estimation of the covariance matrix based on multiple a-priori models , 2010, 2010 IEEE Radar Conference.

[26]  Daniel R. Fuhrmann,et al.  Application of Toeplitz covariance estimation to adaptive beamforming and detection , 1991, IEEE Trans. Signal Process..

[27]  Augusto Aubry,et al.  Maximum Likelihood Estimation of a Structured Covariance Matrix With a Condition Number Constraint , 2012, IEEE Transactions on Signal Processing.

[28]  Olivier Ledoit,et al.  Improved estimation of the covariance matrix of stock returns with an application to portfolio selection , 2003 .

[29]  S. Haykin,et al.  Cognitive radar: a way of the future , 2006, IEEE Signal Processing Magazine.

[30]  K. Gerlach,et al.  Errata: fast converging adaptive processor for a structured covariance matrix , 2001 .

[31]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[32]  Charles A. Bouman,et al.  Covariance Estimation for High Dimensional Data Vectors Using the Sparse Matrix Transform , 2008, NIPS.

[33]  Daniel R. Fuhrmann,et al.  A CFAR adaptive matched filter detector , 1992 .

[34]  James Ward,et al.  Space-time adaptive processing for airborne radar , 1994, 1995 International Conference on Acoustics, Speech, and Signal Processing.

[35]  A. Haimovich,et al.  The eigencanceler: adaptive radar by eigenanalysis methods , 1996, IEEE Transactions on Aerospace and Electronic Systems.

[36]  S. Applebaum,et al.  Adaptive arrays , 1976 .

[37]  M.C. Wicks,et al.  Space-time adaptive processing: a knowledge-based perspective for airborne radar , 2006, IEEE Signal Processing Magazine.

[38]  I. Reed,et al.  Rapid Convergence Rate in Adaptive Arrays , 1974, IEEE Transactions on Aerospace and Electronic Systems.

[39]  W.L. Melvin,et al.  Analyzing space-time adaptive processors using measured data , 1997, Conference Record of the Thirty-First Asilomar Conference on Signals, Systems and Computers (Cat. No.97CB36136).

[40]  A. Farina,et al.  Knowledge-aided covariance matrix estimation: A MAXDET approach , 2008, 2008 IEEE Radar Conference.

[41]  Jian Li,et al.  Computationally efficient maximum-likelihood estimation of structured covariance matrices , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[42]  A. Farina,et al.  Adaptive Radar Detection: A Bayesian Approach , 2006, 2006 International Radar Symposium.

[43]  K. Woodbridge,et al.  Knowledge-based resource management for multifunction radar: a look at scheduling and task prioritization , 2006, IEEE Signal Processing Magazine.

[44]  Seung-Jean Kim,et al.  Maximum Likelihood Covariance Estimation with a Condition Number Constraint , 2006, 2006 Fortieth Asilomar Conference on Signals, Systems and Computers.

[45]  Joseph R. Guerci,et al.  Space-Time Adaptive Processing for Radar , 2003 .

[46]  Min-Jea Tahk,et al.  IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS , 2022, IEEE Aerospace and Electronic Systems Magazine.

[47]  Andrea L. Kraay,et al.  A Physically Constrained Maximum-Likelihood Method for Snapshot-Deficient Adaptive Array Processing , 2007, IEEE Transactions on Signal Processing.

[48]  Ramon Nitzberg Application of Maximum Likelihood Estimation of Persymmetric Covariance Matrices to Adaptive Processing , 1980, IEEE Transactions on Aerospace and Electronic Systems.

[49]  Fulvio Gini,et al.  Knowledge-Based Radar Detection, Tracking, and Classification: Gini/Radar Detection , 2008 .

[50]  B. Widrow,et al.  Adaptive antenna systems , 1967 .

[51]  Jian Li,et al.  On Using a priori Knowledge in Space-Time Adaptive Processing , 2008, IEEE Transactions on Signal Processing.