Visual Object Tracking in RGB-D Data via Genetic Feature Learning

Visual object tracking is a fundamental component in many computer vision applications. Extracting robust features of object is one of the most important steps in tracking. As trackers, only formulated on RGB data, are usually affected by occlusions, appearance, or illumination variations, we propose a novel RGB-D tracking method based on genetic feature learning in this paper. Our approach addresses feature learning as an optimization problem. As owning the advantage of parallel computing, genetic algorithm (GA) has fast speed of convergence and excellent global optimization performance. At the same time, unlike handcrafted feature and deep learning methods, GA can be employed to solve the problem of feature representation without prior knowledge, and it has no use for a large number of parameters to be learned. The candidate solution in RGB or depth modality is represented as an encoding of an image in GA, and genetic feature is learned through population initialization, fitness evaluation, selection, crossover, and mutation. The proposed RGB-D tracker is evaluated on popular benchmark dataset, and experimental results indicate that our method achieves higher accuracy and faster tracking speed.

[1]  Bao-Liang Lu,et al.  Online Depth Image-Based Object Tracking with Sparse Representation and Object Detection , 2016, Neural Processing Letters.

[2]  Zhenzhou Tang,et al.  Visual Object Tracking Based on Cross-Modality Gaussian-Bernoulli Deep Boltzmann Machines with RGB-D Sensors , 2017, Sensors.

[3]  Lai Soon Lee,et al.  Optimised crossover genetic algorithm for capacitated vehicle routing problem , 2012 .

[4]  Haiyan Zhang,et al.  Multimodal Deep Feature Fusion (MMDFF) for RGB-D Tracking , 2018, Complex..

[5]  Jian Zhang,et al.  RGB-D Tracking Based on Kernelized Correlation Filter with Deep Features , 2017, ICONIP.

[6]  Massimo Piccardi,et al.  Prototype-based budget maintenance for tracking in depth videos , 2016, Multimedia Tools and Applications.

[7]  Hamid Abrishami Moghaddam,et al.  A survey on player tracking in soccer videos , 2017, Comput. Vis. Image Underst..

[8]  Majid Mirmehdi,et al.  DS-KCF: a real-time tracker for RGB-D data , 2016, Journal of Real-Time Image Processing.

[9]  Shin Ishii,et al.  An occlusion-aware particle filter tracker to handle complex and persistent occlusions , 2016, Computer Vision and Image Understanding.

[10]  Qi Tian,et al.  Geometric Hypergraph Learning for Visual Tracking , 2016, IEEE Transactions on Cybernetics.

[11]  Pascal Fua,et al.  Probability occupancy maps for occluded depth images , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Heiko Wersing,et al.  Evolutionary optimization of a hierarchical object recognition model , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[13]  Kathiravan Srinivasan,et al.  Robust RGB-D Hand Tracking Using Deep Learning Priors , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Bir Bhanu,et al.  Evolutionary feature synthesis for object recognition , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[15]  Yuqing Gao,et al.  Robust Fusion of Color and Depth Data for RGB-D Target Tracking Using Adaptive Range-Invariant Depth Models and Spatio-Temporal Consistency Constraints , 2018, IEEE Transactions on Cybernetics.

[16]  Mohammed Bennamoun,et al.  Evolutionary Feature Learning for 3-D Object Recognition , 2018, IEEE Access.

[17]  Jianxiong Xiao,et al.  Tracking Revisited Using RGBD Camera: Unified Benchmark and Baselines , 2013, 2013 IEEE International Conference on Computer Vision.

[18]  Jaime S. Cardoso,et al.  Toward a generic evaluation of image segmentation , 2005, IEEE Transactions on Image Processing.

[19]  James J. Little,et al.  Learning to Track and Identify Players from Broadcast Sports Videos , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Bo Gao,et al.  Driving Style Recognition for Intelligent Vehicle Control and Advanced Driver Assistance: A Survey , 2018, IEEE Transactions on Intelligent Transportation Systems.

[21]  Arash Ahmadi,et al.  Realistic Hodgkin–Huxley Axons Using Stochastic Behavior of Memristors , 2017, Neural Processing Letters.

[22]  Jitendra Malik,et al.  Learning Rich Features from RGB-D Images for Object Detection and Segmentation , 2014, ECCV.

[23]  Ahmet Altindal,et al.  Kinetic Studies of the Adsorption of Chlorinated Hydrocarbons Onto Phthalocyanine Thin Film , 2017, IEEE Sensors Journal.

[24]  Huchuan Lu,et al.  Dual Deep Network for Visual Tracking , 2016, IEEE Transactions on Image Processing.

[25]  Xiaogang Wang,et al.  Intelligent multi-camera video surveillance: A review , 2013, Pattern Recognit. Lett..

[26]  Komal Komal,et al.  Analysis of Selection Schemes for Solving an Optimization Problem in Genetic Algorithm , 2014 .

[27]  Ning An,et al.  Online RGB-D tracking via detection-learning-segmentation , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).