Occlusion-Aware Correlation Particle Filter Target Tracking Based on RGBD Data

In recent decades, there have been considerable improvements in target-tracking algorithms. However, aspects such as target occlusion, scale variation, and illumination changes still present significant challenges to existing algorithms. In this paper, we describe an occlusion-aware correlation particle filter target-tracking method based on RGBD data. First, we derive a target occlusion judgment mechanism based on a depth image and the histogram of oriented gradients (HOG) feature. We then formulate the tracking mechanism for the target prediction–tracking–optimization–redetection process using a correlation maximum likelihood estimation particle filter algorithm. We propose an adaptive update strategy whereby the system saves a well-tracked model when no occlusion occurs, and then uses this saved model to replace poorly tracked models in the event of occlusion. Furthermore, we consider the scale variation and adjust the target size according to the depth image, but we leave the HOG feature vector dimension of the target area unchanged. Thus, the problems such as model offset, scale variation, and loss of features are corrected over time. The experimental results demonstrate that the proposed target-tracking algorithm can detect target occlusion and track targets well, requires fewer calculations to perform target prediction–tracking–optimization–redetection, reduces the impact of illumination changes, and achieves better real-time performance and accuracy than many existing algorithms.

[1]  Li Bai,et al.  Efficient Minimum Error Bounded Particle Resampling L1 Tracker With Occlusion Detection , 2013, IEEE Transactions on Image Processing.

[2]  Horst Bischof,et al.  Semi-supervised On-Line Boosting for Robust Tracking , 2008, ECCV.

[3]  Luc Van Gool,et al.  An adaptive color-based particle filter , 2003, Image Vis. Comput..

[4]  Bernhard Schölkopf,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2005, IEEE Transactions on Neural Networks.

[5]  Lei Zhang,et al.  Object Tracking via Dual Linear Structured SVM and Explicit Feature Map , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Li Bai,et al.  Inverse Nonnegative Local Coordinate Factorization for Visual Tracking , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Rui Caseiro,et al.  High-Speed Tracking with Kernelized Correlation Filters , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Shengyong Chen,et al.  Robust Adaptive Fusion Tracking Based on Complex Cells and Keypoints , 2017, IEEE Access.

[9]  A. Atiya,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2005, IEEE Transactions on Neural Networks.

[10]  Shin Ishii,et al.  An occlusion-aware particle filter tracker to handle complex and persistent occlusions , 2016, Computer Vision and Image Understanding.

[11]  Rui Caseiro,et al.  Exploiting the Circulant Structure of Tracking-by-Detection with Kernels , 2012, ECCV.

[12]  Bohyung Han,et al.  Learning occlusion with likelihoods for visual tracking , 2011, 2011 International Conference on Computer Vision.

[13]  Dacheng Tao,et al.  Robust Visual Tracking Revisited: From Correlation Filter to Template Matching , 2018, IEEE Transactions on Image Processing.

[14]  Ales Leonardis,et al.  An adaptive coupled-layer visual model for robust visual tracking , 2011, 2011 International Conference on Computer Vision.

[15]  Ming-Hsuan Yang,et al.  Incremental Learning for Robust Visual Tracking , 2008, International Journal of Computer Vision.

[16]  Jiri Matas,et al.  Robust scale-adaptive mean-shift for tracking , 2013, Pattern Recognit. Lett..

[17]  Sridha Sridharan,et al.  An adaptive optical flow technique for person tracking systems , 2007, Pattern Recognit. Lett..

[18]  Simon Lucey,et al.  Learning Background-Aware Correlation Filters for Visual Tracking , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[19]  Ming-Hsuan Yang,et al.  Visual tracking with online Multiple Instance Learning , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Junseok Kwon,et al.  Visual tracking decomposition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[21]  Cedric Nishan Canagarajah,et al.  Sequential Monte Carlo tracking by fusing multiple cues in video sequences , 2007, Image Vis. Comput..

[22]  Jianxiong Xiao,et al.  Tracking Revisited Using RGBD Camera: Unified Benchmark and Baselines , 2013, 2013 IEEE International Conference on Computer Vision.

[23]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.

[24]  Simon Baker,et al.  Lucas-Kanade 20 Years On: A Unifying Framework , 2004, International Journal of Computer Vision.

[25]  Shin Ishii,et al.  Switching particle filters for efficient visual tracking , 2006, Robotics Auton. Syst..

[26]  Majid Mirmehdi,et al.  DS-KCF: a real-time tracker for RGB-D data , 2016, Journal of Real-Time Image Processing.

[27]  Soumyabrata Ghosh,et al.  Tracking of object using optimal adaptive Kalman filter , 2016, 2016 IEEE International Conference on Engineering and Technology (ICETECH).

[28]  Luca Bertinetto,et al.  End-to-End Representation Learning for Correlation Filter Based Tracking , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Patrick Pérez,et al.  Data fusion for visual tracking with particles , 2004, Proceedings of the IEEE.

[30]  Michael Felsberg,et al.  Discriminative Scale Space Tracking , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Zhihai He,et al.  Supplementary Virtual Keypoints of Weight-Based Correspondences for Occluded Object Tracking , 2018, IEEE Access.

[32]  Bruce A. Draper,et al.  Visual object tracking using adaptive correlation filters , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[33]  Qiang Wu,et al.  PageRank Tracker: From Ranking to Tracking , 2014, IEEE Transactions on Cybernetics.

[34]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[35]  Jitendra Malik,et al.  Large Displacement Optical Flow: Descriptor Matching in Variational Motion Estimation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Jianke Zhu,et al.  A Scale Adaptive Kernel Correlation Filter Tracker with Feature Integration , 2014, ECCV Workshops.

[37]  Zdenek Kalal,et al.  Tracking-Learning-Detection , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Dorin Comaniciu,et al.  Kernel-Based Object Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  Luca Bertinetto,et al.  Staple: Complementary Learners for Real-Time Tracking , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[40]  Lei Zhang,et al.  Real-Time Compressive Tracking , 2012, ECCV.

[41]  Weiming Yang,et al.  Adaptive Online Learning Based Robust Visual Tracking , 2018, IEEE Access.