Feature selection for appearance-based vehicle tracking in geospatial video

Current video tracking systems often employ a rich set of intensity, edge, texture, shape and object level features combined with descriptors for appearance modeling. This approach increases tracker robustness but is compu- tationally expensive for realtime applications and localization accuracy can be adversely affected by including distracting features in the feature fusion or object classification processes. This paper explores offline feature subset selection using a filter-based evaluation approach for video tracking to reduce the dimensionality of the feature space and to discover relevant representative lower dimensional subspaces for online tracking. We com- pare the performance of the exhaustive FOCUS algorithm to the sequential heuristic SFFS, SFS and RELIEF feature selection methods. Experiments show that using offline feature selection reduces computational complex- ity, improves feature fusion and is expected to translate into better online tracking performance. Overall SFFS and SFS perform very well, close to the optimum determined by FOCUS, but RELIEF does not work as well for feature selection in the context of appearance-based object tracking.

[1]  Adel Hafiane,et al.  UAV-Video Registration Using Block-Based Features , 2008, IGARSS 2008 - 2008 IEEE International Geoscience and Remote Sensing Symposium.

[2]  Kannappan Palaniappan.  Network-based Visualization Using the Distributed Image SpreadSheet (DISS) , 2001 .

[3]  Guna Seetharaman,et al.  Robust Orientation and Appearance Adaptation for Wide-Area Large Format Video Object Tracking , 2012, 2012 IEEE Ninth International Conference on Advanced Video and Signal-Based Surveillance.

[4]  Bertrand Zavidovique,et al.  Rotationally Invariant Hashing of Median Binary Patterns for Texture Classification , 2008, ICIAR.

[5]  Sanmay Das,et al.  Filters, Wrappers and a Boosting-Based Hybrid for Feature Selection , 2001, ICML.

[6]  Guna Seetharaman,et al.  A piecewise affine model for image registration in nonrigid motion analysis , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[7]  Michael I. Jordan,et al.  Feature selection for high-dimensional genomic microarray data , 2001, ICML.

[8]  Guna Seetharaman,et al.  Efficient feature extraction and likelihood fusion for vehicle tracking in low frame rate airborne video , 2010, 2010 13th International Conference on Information Fusion.

[9]  D. Chesters,et al.  VISUALIZATION OF MULTISPECTRAL AND MULTISOURCE DATA USING AN INTERACTIVE IMAGE SPREADSHEET (IISS) , 2011 .

[10]  Kannappan Palaniappan,et al.  Visualization of Automated and Manual Trajectories in Wide-Area Motion Imagery , 2011, 2011 15th International Conference on Information Visualisation.

[11]  Anil K. Jain,et al.  Feature Selection: Evaluation, Application, and Small Sample Performance , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Thomas G. Dietterich,et al.  Learning with Many Irrelevant Features , 1991, AAAI.

[13]  Kannappan Palaniappan,et al.  Interactive target tracking for persistent wide-area surveillance , 2012 .

[14]  Ron Kohavi,et al.  Wrappers for performance enhancement and oblivious decision graphs , 1995 .

[15]  Guna Seetharaman,et al.  VISUAL TRACKING WITH ROBUST TARGET LOCALIZATION , 2012 .

[16]  Guna Seetharaman,et al.  Parallel Implementation of the Integral Histogram , 2011, ACIVS.

[17]  Guna Seetharaman,et al.  Efficient GPU Implementation of the Integral Histogram , 2012, ACCV Workshops.

[18]  Kannappan Palaniappan,et al.  Contemporary concerns in Geographical/Geospatial Information Systems (GIS) processing , 2011, Proceedings of the 2011 IEEE National Aerospace and Electronics Conference (NAECON).

[19]  Kannappan Palaniappan,et al.  A high performance Interactive Image Spreadsheet (IISS) , 1994 .

[20]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[21]  Ming-Hsuan Yang,et al.  Robust Object Tracking with Online Multiple Instance Learning , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Kannappan Palaniappan,et al.  Exploratory Analysis of Satellite Data Using the Interactive Image Spreadsheet (IISS) Environment , 1993 .

[23]  Naftali Tishby,et al.  Margin based feature selection - theory and algorithms , 2004, ICML.

[24]  K. Palaniappan,et al.  MULTIRESOLUTION TILING FOR INTERACTIVE VIEWING OF LARGE DATASETS , 2001 .

[25]  Guna Seetharaman,et al.  Persistent target tracking using likelihood fusion in wide-area and full motion video sequences , 2012, 2012 15th International Conference on Information Fusion.

[26]  Josef Kittler,et al.  Floating search methods in feature selection , 1994, Pattern Recognit. Lett..

[27]  B. Krauskopf,et al.  Proc of SPIE , 2003 .

[28]  Thomas S. Huang,et al.  Image processing , 1971 .

[29]  Guna Seetharaman,et al.  Feature prominence-based weighting scheme for video tracking , 2012, ICVGIP '12.

[30]  Daphne Koller,et al.  Toward Optimal Feature Selection , 1996, ICML.

[31]  Kannappan Palaniappan,et al.  Multi-feature contour evolution for automatic live cell segmentation in time lapse imagery , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[32]  Kannappan Palaniappan,et al.  Moving Object Segmentation Using the Flux Tensor for Biological Video Microscopy , 2007, PCM.

[33]  Jeffrey K. Uhlmann,et al.  The challenge of scalable and distributed fusion of disparate sources of information , 2006, SPIE Defense + Commercial Sensing.

[34]  Fatih Murat Porikli,et al.  Integral histogram: a fast way to extract histograms in Cartesian spaces , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[35]  Rich Caruana,et al.  Greedy Attribute Selection , 1994, ICML.

[36]  Josef Kittler,et al.  Pattern recognition : a statistical approach , 1982 .

[37]  Kannappan Palaniappan,et al.  Classification of cell cycle phases in 3D confocal microscopy using PCNA and chromocenter features , 2010, ICVGIP '10.

[38]  Kannappan Palaniappan,et al.  Dual Channel Colocalization for Cell Cycle Analysis Using 3D Confocal Microscopy , 2010, 2010 20th International Conference on Pattern Recognition.

[39]  Larry A. Rendell,et al.  A Practical Approach to Feature Selection , 1992, ML.

[40]  Kannappan Palaniappan,et al.  Adaptive Robust Structure Tensors for Orientation Estimation and Image Segmentation , 2005, ISVC.

[41]  Lluís A. Belanche Muñoz,et al.  Feature selection algorithms: a survey and experimental evaluation , 2002, 2002 IEEE International Conference on Data Mining, 2002. Proceedings..

[42]  G. Seetharaman,et al.  Wide-Area Persistent Airborne Video: Architecture and Challenges , 2011 .

[43]  Guna Seetharaman,et al.  Feature fusion using ranking for object tracking in aerial imagery , 2012 .

[44]  Filippo Menczer,et al.  Feature selection in unsupervised learning via evolutionary search , 2000, KDD '00.

[45]  Huan Liu,et al.  Toward integrating feature selection algorithms for classification and clustering , 2005, IEEE Transactions on Knowledge and Data Engineering.