Robust PCA-Based Visual Tracking by Adaptively Maximizing the Matching Residual Likelihood

A new similarity measure called matching residual likelihood (MRL) is presented for the task of visual tracking. MRL estimates the likelihood of the matching residual between the object representation model and the new candidate image based on previous matching errors. A posterior probability called a posterior matching residual probability is modeled based on the matching residual likelihood, the object motion model between sequential states, and the prior probability to estimate the density distribution of the object location. At every frame, an on-line algorithm is used to learn a low-dimensional PCA model from the object image. Then the object is located by maximizing the posterior matching residual probability distribution of the object state based on a robust factored sampling algorithm. The proposed method cab readily update the similarity measure to handle significant appearance changes while it is still robust to outliers and occlusion. In our experiments, the proposed tracker is applied on several challenging image sequences and the result is compared with other state-of-the-art methods and the ground truth data. The comparison results show the robustness and accuracy of our tracker in existence of large object motion and appearance variation, occlusion, outliers, and illumination changes.

[1]  Ieee Xplore,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence Information for Authors , 2022, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Harvey F. Silverman,et al.  A Class of Algorithms for Fast Digital Image Registration , 1972, IEEE Transactions on Computers.

[3]  Baba C. Vemuri,et al.  Non-Rigid Multi-Modal Image Registration Using Cross-Cumulative Residual Entropy , 2007, International Journal of Computer Vision.

[4]  David Beymer,et al.  A real-time computer vision system for vehicle tracking and traffic surveillance , 1998 .

[5]  Ming-Hsuan Yang,et al.  Visual tracking with online Multiple Instance Learning , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Éric Marchand,et al.  Video mosaicing using a mutual information-based motion estimation process , 2011, 2011 18th IEEE International Conference on Image Processing.

[7]  Dorin Comaniciu,et al.  Kernel-Based Object Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Alessandro Leone,et al.  Shadow detection for moving objects based on texture analysis , 2007, Pattern Recognit..

[9]  Shai Avidan,et al.  Support Vector Tracking , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[10]  Tieniu Tan,et al.  A survey on visual surveillance of object motion and behaviors , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[11]  Antonio M. López,et al.  Variance reduction techniques in particle-based visual contour tracking , 2009, Pattern Recognit..

[12]  P. Anandan,et al.  Hierarchical Model-Based Motion Estimation , 1992, ECCV.

[13]  Geraldo F. Silveira,et al.  Unified Direct Visual Tracking of Rigid and Deformable Surfaces Under Generic Illumination Changes in Grayscale and Color Images , 2010, International Journal of Computer Vision.

[14]  Russell H. Taylor,et al.  Visual tracking using the sum of conditional variance , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  Simon Baker,et al.  Active Appearance Models Revisited , 2004, International Journal of Computer Vision.

[16]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.

[17]  Rogério Schmidt Feris,et al.  Video Analytics in Urban Environments , 2009, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[18]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[19]  Timothy F. Cootes,et al.  Active Appearance Models , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Takahiro Ishikawa,et al.  The template update problem , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Michael J. Black,et al.  EigenTracking: Robust Matching and Tracking of Articulated Objects Using a View-Based Representation , 1996, International Journal of Computer Vision.

[22]  Gregory D. Hager,et al.  Joint probabilistic techniques for tracking multi-part objects , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[23]  Haibin Ling,et al.  Real time robust L1 tracker using accelerated proximal gradient approach , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Irene Y. H. Gu,et al.  Robust Visual Object Tracking Using Multi-Mode Anisotropic Mean Shift and Particle Filters , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[25]  Ming-Hsuan Yang,et al.  Incremental Learning for Robust Visual Tracking , 2008, International Journal of Computer Vision.

[26]  Zdenek Kalal,et al.  Tracking-Learning-Detection , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Qing Wang,et al.  Adaptive multi-cue tracking by online appearance learning , 2011, Neurocomputing.

[28]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[29]  Y. Bar-Shalom Tracking and data association , 1988 .

[30]  Gregory D. Hager,et al.  Efficient Region Tracking With Parametric Models of Geometry and Illumination , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Robert L. Stevenson,et al.  Studentized Dynamical System for Robust Object Tracking , 2011, IEEE Transactions on Image Processing.

[32]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.