Manifold and transfer subspace learning for cross-domain vehicle recognition in dynamic systems

Transfer Subspace Learning has gained recent popularity in the literature for its ability to perform cross-dataset and cross-domain object recognition - enablers for data fusion. The ability to leverage existing data without the need for additional data collections is attractive for Automatic Target Recognition applications. For Automatic Target Recognition (or object assessment) applications, Transfer Subspace Learning is a game changer for dynamic systems, as it enables the incorporation of sparse and dynamically collected data into existing systems that utilize large, dense databases. A baseline Transfer Subspace Learning technique is the Transfer Fisher's Linear Discriminative Analysis, an approach based on Bregman divergence-based regularization. This paper modifies the implementation of the Transfer Fisher's Linear Discriminative Analysis technique by combining it with Manifold Learning and adjusting it to allow for a more systematic search of tuning parameters. Specifically, the Diffusion Map approach is utilized, a Manifold Learning approach based on heat diffusion. The modified technique is then utilized for cross-data and cross-domain electro-optical vehicle recognition.

[1]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[2]  Erik Blasch,et al.  Comparison of information theoretic divergences for sensor management , 2011, Defense + Commercial Sensing.

[3]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[4]  O. Mendoza-Schrock,et al.  Electro-optical synthetic civilian vehicle data domes , 2012, 2012 IEEE National Aerospace and Electronics Conference (NAECON).

[5]  B. Nadler,et al.  Diffusion maps, spectral clustering and reaction coordinates of dynamical systems , 2005, math/0503445.

[6]  Erik Blasch,et al.  Dynamic Data Driven Applications Systems (DDDAS) modeling for automatic target recognition , 2013, Defense, Security, and Sensing.

[7]  Luis Mateus Rocha,et al.  Singular value decomposition and principal component analysis , 2003 .

[8]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[9]  Dacheng Tao,et al.  Bregman Divergence-Based Regularization for Transfer Subspace Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[10]  Matthew P. Wand,et al.  Kernel Smoothing , 1995 .

[11]  Erik Blasch,et al.  Operating condition modeling for ATR fusion assessment , 2007, SPIE Defense + Commercial Sensing.

[12]  Olga Mendoza-Schrock,et al.  Applying manifold learning techniques to the CAESAR database , 2010, Defense + Commercial Sensing.

[13]  Juan Ramirez,et al.  Diffusion maps for exploring electro-optical synthetic vehicle image data , 2012, 2012 IEEE National Aerospace and Electronics Conference (NAECON).

[14]  Anne-Laure Jousselme,et al.  Sensor-based allocation for path planning and area coverage using UGSs , 2010, Proceedings of the IEEE 2010 National Aerospace & Electronics Conference.

[15]  Avinash C. Kak,et al.  PCA versus LDA , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Mikhail Belkin,et al.  Laplacian Eigenmaps for Dimensionality Reduction and Data Representation , 2003, Neural Computation.

[17]  Ronald R. Coifman,et al.  Data Fusion and Multicue Data Matching by Diffusion Maps , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  R. Coifman Perspectives and Challenges to Harmonic Analysis and Geometry in High Dimensions: Geometric Diffusions as a Tool for Harmonic Analysis and Structure Definition of Data , 2005 .

[19]  Gregory Arnold,et al.  Diffusion maps and radar data analysis , 2007, SPIE Defense + Commercial Sensing.

[20]  Michael Nowak,et al.  Layered Sensing: Its Definition, Attributes, and Guiding Principles for AFRL Strategic Technology Development , 2008 .

[21]  Yi Wu,et al.  A general framework for transfer sparse subspace learning , 2012, Neural Computing and Applications.

[22]  Steven W. Zucker,et al.  Diffusion Maps and Geometric Harmonics for Automatic Target Recognition (ATR). Volume 2. Appendices , 2007 .

[23]  Erik Blasch,et al.  Pattern Activity Clustering and Evaluation (PACE) , 2012, Defense + Commercial Sensing.

[24]  Li Bai,et al.  Multiple Kernel Learning for vehicle detection in wide area motion imagery , 2012, 2012 15th International Conference on Information Fusion.

[25]  Qiang Yang,et al.  Boosting for transfer learning , 2007, ICML '07.

[26]  Stéphane Lafon,et al.  Diffusion maps , 2006 .

[27]  Li Bai,et al.  Multiple source data fusion via sparse representation for robust visual tracking , 2011, 14th International Conference on Information Fusion.

[28]  Li Bai,et al.  Robust infrared vehicle tracking across target pose change using L1 regularization , 2010, 2010 13th International Conference on Information Fusion.

[29]  T. Chai,et al.  Root mean square error (RMSE) or mean absolute error (MAE)? – Arguments against avoiding RMSE in the literature , 2014 .