Factorized discriminative conditional variational auto-encoder for radar HRRP target recognition

Abstract In this paper, we propose a conditional generative model for radar high resolution range profile (HRRP) target recognition to learn the discriminative representations and sufficiently encode the observed feature variability by taking the multi-layer perception (MLP) as the sufficient statistics of posterior approximation distribution, thus offering the potential to improve the overall recognition performance. Considering the target-aspect sensitivity of HRRP, the model is regularized through reconstructing the average profiles. Then we introduce three-way weight tensors for MLPs to capture the multiplicative interactions between label information and HRRP samples, which are then further factorized to effectively reduce model parameters. The extensive experimental results on the measured HRRP data demonstrate that the proposed algorithm achieves the promising target recognition and reconstruction performance.

[1]  Honglak Lee,et al.  Sparse deep belief net model for visual area V2 , 2007, NIPS.

[2]  Vladimir Stojanovic,et al.  Optimal control of hydraulically driven parallel robot platform based on firefly algorithm , 2015 .

[3]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[4]  Lan Du,et al.  Radar HRRP target recognition based on K-SVD algorithm , 2011, Proceedings of 2011 IEEE CIE International Conference on Radar.

[5]  Hua Yu,et al.  A direct LDA algorithm for high-dimensional data - with application to face recognition , 2001, Pattern Recognit..

[6]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[7]  Zheng Bao,et al.  A two-distribution compounded statistical model for Radar HRRP target recognition , 2006, IEEE Trans. Signal Process..

[8]  Enhong Chen,et al.  Image Denoising and Inpainting with Deep Neural Networks , 2012, NIPS.

[9]  Shaohong Li,et al.  One-Dimensional Frequency-Domain Features for Aircraft Recognition from Radar Range Profiles , 2010, IEEE Transactions on Aerospace and Electronic Systems.

[10]  Vladimir Stojanovic,et al.  A Nature Inspired Parameter Tuning Approach to Cascade Control for Hydraulically Driven Parallel Robot Platform , 2016, J. Optim. Theory Appl..

[11]  Zheng Bao,et al.  Radar automatic target recognition using complex high-resolution range profiles , 2007 .

[12]  David B. Dunson,et al.  Deep Learning with Hierarchical Convolutional Factor Analysis , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Lei Shi,et al.  Radar HRRP Statistical Recognition With Local Factor Analysis by Automatic Bayesian Ying-Yang Harmony Learning , 2011, IEEE Trans. Signal Process..

[14]  Richard S. Zemel,et al.  Prototypical Networks for Few-shot Learning , 2017, NIPS.

[15]  Zheng Bao,et al.  Radar HRRP target recognition based on dynamic multi-task hidden Markov model , 2011, 2011 IEEE RadarCon (RADAR).

[16]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[17]  Tara N. Sainath,et al.  Deep Neural Networks for Acoustic Modeling in Speech Recognition , 2012 .

[18]  Zheng Bao,et al.  Large Margin Feature Weighting Method via Linear Programming , 2009, IEEE Transactions on Knowledge and Data Engineering.

[19]  Peter Swerling,et al.  Probability of detection for fluctuating targets , 1960, IRE Trans. Inf. Theory.

[20]  Hongwei Liu,et al.  Radar HRRP target recognition with deep networks , 2017, Pattern Recognit..

[21]  V. Stojanovic,et al.  Robust identification of pneumatic servo actuators in the real situations , 2011 .

[22]  Yoram Singer,et al.  Adaptive Subgradient Methods for Online Learning and Stochastic Optimization , 2011, J. Mach. Learn. Res..

[23]  H. Baudrand.  The CGG-FFT Method: Application of Signal Processing Techniques to Electromagnetics , 1997 .

[24]  Vladimir Stojanovic,et al.  Robust identification of OE model with constrained output using optimal input design , 2016, J. Frankl. Inst..

[25]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[26]  Daan Wierstra,et al.  Stochastic Backpropagation and Approximate Inference in Deep Generative Models , 2014, ICML.

[27]  Yang Hua.  Aircraft target recognition using feature correlation coefficients , 2001 .

[28]  Yoshua Bengio,et al.  Deep Learning of Representations for Unsupervised and Transfer Learning , 2011, ICML Unsupervised and Transfer Learning.

[29]  Juha Karhunen,et al.  Building Blocks for Variational Bayesian Learning of Latent Variable Models , 2007, J. Mach. Learn. Res..

[30]  Mark W. Schmidt,et al.  Faster Stochastic Variational Inference using Proximal-Gradient Methods with General Divergence Functions , 2015, UAI.

[31]  Zheng Bao,et al.  Bayesian Spatiotemporal Multitask Learning for Radar HRRP Target Recognition , 2011, IEEE Transactions on Signal Processing.

[32]  Zheng Bao,et al.  Radar HRRP statistical recognition based on hypersphere model , 2008, Signal Process..

[33]  Ruslan Salakhutdinov,et al.  Importance Weighted Autoencoders , 2015, ICLR.

[34]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Jaakko Astola,et al.  Classification of aircraft using micro-Doppler bicoherence-based features , 2014, IEEE Transactions on Aerospace and Electronic Systems.

[36]  V. Stojanovic,et al.  Application of cuckoo search algorithm to constrained control problem of a parallel robot platform , 2016, The International Journal of Advanced Manufacturing Technology.

[37]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Zheng Bao,et al.  A new feature vector using selected bispectra for signal classification with application in radar target recognition , 2001, IEEE Trans. Signal Process..

[39]  Jing Liang,et al.  Fuzzy logic classifier design for air targets recognition based on HRRP , 2014, Phys. Commun..

[40]  Z. Bao,et al.  Properties of high-resolution range profiles , 2002 .

[41]  Mengdao Xing,et al.  Radar HRRP target recognition based on higher order spectra , 2005, IEEE Transactions on Signal Processing.

[42]  Honglak Lee,et al.  Learning Structured Output Representation using Deep Conditional Generative Models , 2015, NIPS.

[43]  J. Keller,et al.  Geometrical theory of diffraction. , 1962, Journal of the Optical Society of America.

[44]  Ole Winther,et al.  Ladder Variational Autoencoders , 2016, NIPS.

[45]  Inderjit S. Dhillon,et al.  Clustering with Bregman Divergences , 2005, J. Mach. Learn. Res..

[46]  Michael Elad,et al.  Dictionaries for Sparse Representation Modeling , 2010, Proceedings of the IEEE.

[47]  Zheng Bao,et al.  Noise Robust Radar HRRP Target Recognition Based on Multitask Factor Analysis With Small Training Data Size , 2012, IEEE Transactions on Signal Processing.

[48]  Zheng Bao,et al.  Radar HRRP Statistical Recognition: Parametric Model and Model Selection , 2008, IEEE Transactions on Signal Processing.

[49]  Vladimir Stojanovic,et al.  Joint state and parameter robust estimation of stochastic nonlinear systems , 2016 .

[50]  Pascal Vincent,et al.  Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion , 2010, J. Mach. Learn. Res..

[51]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[52]  Samy Bengio,et al.  Generating Sentences from a Continuous Space , 2015, CoNLL.

[53]  Zhe Gan,et al.  Factored Temporal Sigmoid Belief Networks for Sequence Learning , 2016, ICML.

[54]  Joseph A. O'Sullivan,et al.  Automatic target recognition using sequences of high resolution radar range-profiles , 2000, IEEE Trans. Aerosp. Electron. Syst..

[55]  W. Carrara,et al.  Spotlight synthetic aperture radar : signal processing algorithms , 1995 .

[56]  Feng Zhu,et al.  Nonstationary Hidden Markov Models for Multiaspect Discriminative Feature Extraction From Radar Targets , 2007, IEEE Transactions on Signal Processing.

[57]  Geoffrey E. Hinton,et al.  Factored conditional restricted Boltzmann Machines for modeling motion style , 2009, ICML '09.

[58]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[59]  Lawrence Carin,et al.  Identification of ground targets from sequential high-range-resolution radar signatures , 2002 .

[60]  Tara N. Sainath,et al.  Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups , 2012, IEEE Signal Processing Magazine.

[61]  Kjersti Engan,et al.  Frame based signal compression using method of optimal directions (MOD) , 1999, ISCAS'99. Proceedings of the 1999 IEEE International Symposium on Circuits and Systems VLSI (Cat. No.99CH36349).