Tracking feature extraction based on manifold learning framework

Manifold learning is a fast growing area of research recently. The main purpose of manifold learning is to search for intrinsic variables underlying high-dimensional inputs which lie on or are close to a low-dimensional manifold. Different from current theoretical works and applications of manifold learning approaches, in our work manifold learning framework is transferred to tracking feature extraction for the first time. The contributions of this article include three aspects. Firstly, in this article, we focus on tracking feature extraction for dynamic visual tracking on dynamic systems. The feature extracted in this article is based on manifold learning framework and is particular for dynamic tracking purpose. It can be directly applied to system control of dynamic systems. This is different from most traditional tracking features which are used for recognition and detection. Secondly, the proposed tracking feature extraction method has been successfully applied to three different dynamic systems: dynamic robot system, intelligent vehicle system and aircraft visual navigation system. Thirdly, experimental results have proven the validity of the tracking method based on manifold learning framework. Particularly, in the tracking experiments the vision system is dynamic. The tracking method is also compared with the well-known mean-shift tracking method, and tracking results have shown that our method outperforms the latter.

[1]  Bernt Schiele,et al.  Towards robust multi-cue integration for visual tracking , 2001, Machine Vision and Applications.

[2]  Alexander J. Smola,et al.  Kernel extrapolation , 2006, Neurocomputing.

[3]  Dorin Comaniciu,et al.  Kernel-Based Object Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Wen Gao,et al.  Enhancing Human Face Detection by Resampling Examples Through Manifolds , 2007, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[5]  Bogdan Kwolek,et al.  Stereovision-Based Head Tracking Using Color and Ellipse Fitting in a Particle Filter , 2004, ECCV.

[6]  Thomas L. Ainsworth,et al.  Exploiting manifold geometry in hyperspectral imagery , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[7]  H. Sebastian Seung,et al.  The Manifold Ways of Perception , 2000, Science.

[8]  Joshua B. Tenenbaum,et al.  Global Versus Local Methods in Nonlinear Dimensionality Reduction , 2002, NIPS.

[9]  Michael Isard,et al.  ICONDENSATION: Unifying Low-Level and High-Level Tracking in a Stochastic Framework , 1998, ECCV.

[10]  Mikhail Belkin,et al.  Laplacian Eigenmaps for Dimensionality Reduction and Data Representation , 2003, Neural Computation.

[11]  Yuxiao Hu,et al.  Face recognition using Laplacianfaces , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  D. Donoho,et al.  Hessian Eigenmaps : new locally linear embedding techniques for high-dimensional data , 2003 .

[13]  Stéphane Lafon,et al.  Diffusion maps , 2006 .

[14]  Stanley T. Birchfield,et al.  Elliptical head tracking using intensity gradients and color histograms , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[15]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.

[16]  Liang Wang,et al.  Learning and Matching of Dynamic Shape Manifolds for Human Action Recognition , 2007, IEEE Transactions on Image Processing.

[17]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[18]  Myung Jin Chung,et al.  Robust multi-view face tracking , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  Ahmed M. Elgammal,et al.  Nonlinear manifold learning for dynamic shape and dynamic appearance , 2007, Comput. Vis. Image Underst..

[20]  Peng Guo,et al.  Neural Network Based Visual Tracking with Multi-cue Adaptive Fusion , 2007, ISNN.

[21]  I. Holopainen Riemannian Geometry , 1927, Nature.

[22]  Nicolas Le Roux,et al.  Out-of-Sample Extensions for LLE, Isomap, MDS, Eigenmaps, and Spectral Clustering , 2003, NIPS.

[23]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[24]  Hongyuan Zha,et al.  Principal Manifolds and Nonlinear Dimension Reduction via Local Tangent Space Alignment , 2002, ArXiv.

[25]  Ying Wu,et al.  Robust Visual Tracking by Integrating Multiple Cues Based on Co-Inference Learning , 2004, International Journal of Computer Vision.

[26]  D. Donoho,et al.  Hessian eigenmaps: Locally linear embedding techniques for high-dimensional data , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[27]  Jochen Triesch,et al.  Democratic Integration: Self-Organized Integration of Adaptive Cues , 2001, Neural Computation.

[28]  Dorin Comaniciu,et al.  Real-time tracking of non-rigid objects using mean shift , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[29]  Hongbin Zha,et al.  Riemannian Manifold Learning , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Kilian Q. Weinberger,et al.  Unsupervised Learning of Image Manifolds by Semidefinite Programming , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[31]  H. Zha,et al.  Principal manifolds and nonlinear dimensionality reduction via tangent space alignment , 2004, SIAM J. Sci. Comput..

[32]  Stephen Lin,et al.  Graph Embedding and Extensions: A General Framework for Dimensionality Reduction , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.