Radar HRRP statistical recognition with temporal factor analysis by automatic Bayesian Ying-Yang harmony learning

Radar high-resolution range profiles (HRRPs) are typical high-dimensional and interdimension dependently distributed data, the statistical modeling of which is a challenging task for HRRP-based target recognition. Supposing that HRRP samples are independent and jointly Gaussian distributed, a recent work [Du L, Liu H W, Bao Z. IEEE Transactions on Signal Processing, 2008, 56(5): 1931–1944] applied factor analysis (FA) to model HRRP data with a two-phase approach for model selection, which achieved satisfactory recognition performance. The theoretical analysis and experimental results reveal that there exists high temporal correlation among adjacent HRRPs. This paper is thus motivated to model the spatial and temporal structure of HRRP data simultaneously by employing temporal factor analysis (TFA) model. For a limited size of high-dimensional HRRP data, the two-phase approach for parameter learning and model selection suffers from intensive computation burden and deteriorated evaluation. To tackle these problems, this work adopts the Bayesian Ying-Yang (BYY) harmony learning that has automatic model selection ability during parameter learning. Experimental results show stepwise improved recognition and rejection performances from the two-phase learning based FA, to the two-phase learning based TFA and to the BYY harmony learning based TFA with automatic model selection. In addition, adding many extra free parameters to the classic FA model and thus becoming even worse in identifiability, the model of a general linear dynamical system is even inferior to the classic FA model.

[1]  D. Cook.  Spotlight Synthetic Aperture Radar , 2012 .

[2]  Geoffrey E. Hinton,et al.  Variational Learning for Switching State-Space Models , 2000, Neural Computation.

[3]  Dorothy T. Thayer,et al.  EM algorithms for ML factor analysis , 1982 .

[4]  S.K. Wong.  High Range Resolution Profiles as Motion-Invariant Features for Moving Ground Targets Identification in SAR-Based Automatic Target Recognition , 2009, IEEE Transactions on Aerospace and Electronic Systems.

[5]  X. Lei.  Parameterizations make different model selections : Empirical findings from factor analysis , 2011 .

[6]  Christopher M. Bishop,et al.  Mixtures of Probabilistic Principal Component Analyzers , 1999, Neural Computation.

[7]  W. Carrara,et al.  Spotlight synthetic aperture radar : signal processing algorithms , 1995 .

[8]  Lei Xu,et al.  Temporal factor analysis (TFA): stable-identifiable family, orthogonal flow learning, and automated model selection , 2002, Proceedings of the 2002 International Joint Conference on Neural Networks. IJCNN'02 (Cat. No.02CH37290).

[9]  E. Parzen.  On Estimation of a Probability Density Function and Mode , 1962 .

[10]  Lei Xu,et al.  Codimensional matrix pairing perspective of BYY harmony learning: hierarchy of bilinear systems, joint decomposition of data-covariance, and applications of network biology , 2011 .

[11]  H. Akaike.  Factor analysis and AIC , 1987 .

[12]  Lei Xu.  Bayesian Ying-Yang System and Theory as a Unified Statistical Learning Approach: (V) Temporal Modeling for Temporal Perception and Control , 1998, ICONIP.

[13]  Zheng Bao,et al.  Radar HRRP statistical recognition with temporal factor analysis by automatic Bayesian Ying-Yang harmony learning , 2010, IEEE Transactions on Signal Processing.

[14]  Zheng Bao,et al.  Radar HRRP statistical recognition based on hypersphere model , 2008, Signal Process..

[15]  R. Shumway,et al.  AN APPROACH TO TIME SERIES SMOOTHING AND FORECASTING USING THE EM ALGORITHM , 1982 .

[16]  Xian-Da Zhang,et al.  Gabor Filter Approach to Joint Feature Extraction and Target Recognition , 2009, IEEE Transactions on Aerospace and Electronic Systems.

[17]  Lei Xu,et al.  Optimizing Financial Portfolios from the Perspective of Mining Temporal Structures of Stock Returns , 2003, MLDM.

[18]  Lei Xu,et al.  Machine learning and intelligence science: Sino-foreign-interchange workshop on IScIDE2010 (B) , 2011 .

[19]  D. Parkinson,et al.  Bayesian Methods in Cosmology: Model selection and multi-model inference , 2009 .

[20]  P. Kosir,et al.  Feature alignment techniques for pattern recognition , 1994, Proceedings of National Aerospace and Electronics Conference (NAECON'94).

[21]  James P. Egan,et al.  Signal detection theory and ROC analysis , 1975 .

[22]  David R. Anderson,et al.  Model Selection and Multimodel Inference , 2003 .

[23]  Lei Xu,et al.  Data smoothing regularization, multi-sets-learning, and problem solving strategies , 2003, Neural Networks.

[24]  Lei Xu,et al.  Arbitrage pricing theory-based Gaussian temporal factor analysis for adaptive portfolio management , 2004, Decis. Support Syst..

[25]  Zheng Bao,et al.  Radar HRRP Statistical Recognition: Parametric Model and Model Selection , 2008, IEEE Transactions on Signal Processing.

[26]  R. Shumway,et al.  Dynamic linear models with switching , 1991 .

[27]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[28]  L. Xu.  Independent Component Analysis and Extensions with Noise and Time: A Bayesian Ying-Yang Learning Perspective , 2003 .

[29]  John B. Moore,et al.  Hidden Markov Models: Estimation and Control , 1994 .

[30]  Lei Xu,et al.  Learning Algorithms for RBF Functions and Subspace Based Functions , 2012 .

[31]  H. Akaike.  A new look at the statistical model identification , 1974 .

[32]  Lei Xu,et al.  Temporal BYY encoding, Markovian state spaces, and space dimension determination , 2004, IEEE Transactions on Neural Networks.

[33]  Lei Xu,et al.  BYY harmony learning, independent state space, and generalized APT financial analyses , 2001, IEEE Trans. Neural Networks.

[34]  Mari Ostendorf,et al.  ML estimation of a stochastic linear system with the EM algorithm and its application to speech recognition , 1993, IEEE Trans. Speech Audio Process..

[35]  L. Xu.  Bayesian Ying-Yang system, best harmony learning, and five action circling , 2010 .

[36]  Zoubin Ghahramani,et al.  A Unifying Review of Linear Gaussian Models , 1999, Neural Computation.

[37]  Andrew R. Webb,et al.  Bayesian gamma mixture model approach to radar target recognition , 2003 .

[38]  Zheng Bao,et al.  A two-distribution compounded statistical model for Radar HRRP target recognition , 2006, IEEE Trans. Signal Process..

[39]  Lei Xu,et al.  Temporal BYY learning for state space approach, hidden Markov model, and blind source separation , 2000, IEEE Trans. Signal Process..

[40]  Lei Xu.  Temporal BYY learning and its applications to extended Kalman filtering, hidden Markov model, and sensor-motor integration , 1999, IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339).

[41]  Allen M. Waxman,et al.  Adaptive 3-D Object Recognition from Multiple Views , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[42]  Andrew R. Webb.  Gamma mixture models for target recognition , 2000, Pattern Recognit..

[43]  Lei Xu,et al.  Temporal Bayesian Ying-Yang dependence reduction, blind source separation and principal independent components , 1999, IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339).

[44]  David R. Anderson,et al.  Model Selection and Multimodel Inference , 2003 .

[45]  Lei Xu.  Bayesian Ying-Yang System and Theory as A Uni ed Statistical Learning Approach (II): From Unsupervised Learning to Supervised Learning and Temporal Modeling ? , 1997 .

[46]  Geoffrey E. Hinton,et al.  Parameter estimation for linear dynamical systems , 1996 .

[47]  Albert Ali Salah,et al.  Incremental mixtures of factor analysers , 2004, ICPR 2004.

[48]  Joseph A. O'Sullivan,et al.  Automatic target recognition using high-resolution radar range-profiles , 1997 .

[49]  H. Bozdogan.  Model selection and Akaike's Information Criterion (AIC): The general theory and its analytical extensions , 1987 .

[50]  Lei Xu,et al.  Bayesian Ying Yang System and Theory as A Uni ed Statistical Learning Approach I for Unsupervised and Semi Unsupervised Learning , 1997 .

[51]  Herman Rubin,et al.  Statistical Inference in Factor Analysis , 1956 .