Towards Occlusion Handling: Object Tracking With Background Estimation

The appearance model of the target needs to be updated for online single object tracking. However, the variation of the observation can be caused by active appearance change of the target, or the occlusion from the background. For the former case, we should update the appearance model and for the latter, the current model should be preserved. In this paper, we distinguish these two cases and resist the impact from heavy occlusion by estimating the background in the scene with moving cameras, while retaining the adaptivity to stationary cameras at the same time. The proposed method formulates the background as a Gaussian model and the target is determined in a coarse-to-fine manner. Experimental results demonstrate that our method achieves competitive results in the sequences with appearance changes and outperforms the state-of-the-art algorithms in dealing with complex occlusions.

[1]  Huchuan Lu,et al.  Robust Visual Tracking via Multiple Kernel Boosting With Affinity Constraints , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Bohyung Han,et al.  Generalized Background Subtraction Using Superpixels with Label Integrated Motion Estimation , 2014, ECCV.

[3]  Ming-Hsuan Yang,et al.  Incremental Learning for Robust Visual Tracking , 2008, International Journal of Computer Vision.

[4]  Yanning Zhang,et al.  Part-Based Visual Tracking with Online Latent Structural Learning , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Bohyung Han,et al.  Generalized background subtraction based on hybrid inference by belief propagation and Bayesian filtering , 2011, 2011 International Conference on Computer Vision.

[6]  Jin Gao,et al.  Transfer Learning Based Visual Tracking with Gaussian Processes Regression , 2014, ECCV.

[7]  Ahmed M. Elgammal,et al.  Online Moving Camera Background Subtraction , 2012, ECCV.

[8]  Narendra Ahuja,et al.  Robust visual tracking via multi-task sparse learning , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Qi Wang,et al.  Multi-cue based tracking , 2014, Neurocomputing.

[10]  Thierry Bouwmans,et al.  Subspace Learning for Background Modeling: A Survey , 2009 .

[11]  Horst Bischof,et al.  Semi-supervised On-Line Boosting for Robust Tracking , 2008, ECCV.

[12]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[13]  Shai Avidan,et al.  Ensemble Tracking , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Zdenek Kalal,et al.  Tracking-Learning-Detection , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Shuicheng Yan,et al.  Object Tracking With Only Background Cues , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  Takeo Kanade,et al.  Background Subtraction for Freely Moving Cameras , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[17]  Haibin Ling,et al.  Real time robust L1 tracker using accelerated proximal gradient approach , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[19]  Rui Caseiro,et al.  High-Speed Tracking with Kernelized Correlation Filters , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Qi Wang,et al.  Robust Superpixel Tracking via Depth Fusion , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[21]  Nanning Zheng,et al.  Constructing Adaptive Complex Cells for Robust Visual Tracking , 2013, 2013 IEEE International Conference on Computer Vision.

[22]  Ming-Hsuan Yang,et al.  Visual tracking with online Multiple Instance Learning , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Yuan Xie,et al.  Discriminative subspace learning with sparse representation view-based model for robust visual tracking , 2014, Pattern Recognit..

[24]  Haibin Ling,et al.  Robust Visual Tracking and Vehicle Classification via Sparse Representation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Isabelle Bloch,et al.  Fragments based tracking with adaptive cue integration , 2012, Comput. Vis. Image Underst..

[26]  Junzhou Huang,et al.  Background Subtraction Using Low Rank and Group Sparsity Constraints , 2012, ECCV.

[27]  Minyoung Kim,et al.  Correlation-based incremental visual tracking , 2012, Pattern Recognit..

[28]  James W. Davis,et al.  A Multi-transformational Model for Background Subtraction with Moving Cameras , 2014, ECCV.

[29]  Lei Zhang,et al.  Real-Time Compressive Tracking , 2012, ECCV.

[30]  Qi Wang,et al.  An Incremental Framework for Video-Based Traffic Sign Detection, Tracking, and Recognition , 2017, IEEE Transactions on Intelligent Transportation Systems.

[31]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[32]  Horst Bischof,et al.  Real-Time Tracking via On-line Boosting , 2006, BMVC.

[33]  David Suter,et al.  A consensus-based method for tracking: Modelling background scenario and foreground appearance , 2007, Pattern Recognit..

[34]  Ehud Rivlin,et al.  Robust Fragments-based Tracking using the Integral Histogram , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).