Visual-Model Based Spatial Tracking in the Presence of Occlusions

A key criticism for using a template/visual-model based object-tracker is that they often lack robustness to partial occlusions. This results from the global nature of the algorithm as opposed to operating on local features as in feature-based methods. Nevertheless, visual-model based methods could have significant advantage as they can model more complex objects and use more of the available data than their feature-based counterparts. This paper presents a novel per-pixel occlusion-rejection algorithm for a spatial (3D) visual-model based object tracker. It detects occlusions based on violations of the brightness-constancy assumption of the optical-flow algorithm, which is an essential part of the tracker. Experimental results have clearly shown that using such an occlusion-rejection algorithm facilitates accurate tracking in the presence of partial occlusions that typically cause the object tracker to fail. This is achieved with no noticeable loss of performance; the frame-rate at which the object-tracker operates would remain the same.

[1]  B. Benhabib,et al.  Tracking of rigid-bodies for autonomous surveillance , 2005, IEEE International Conference Mechatronics and Automation, 2005.

[2]  Markus Vincze,et al.  Vision for Robotics: a tool for model-based object tracking , 2005, IEEE Robotics & Automation Magazine.

[3]  Danica Kragic,et al.  Integration of Model-based and Model-free Cues for Visual Object Tracking in 3D , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[4]  David J. Fleet,et al.  Robust Online Appearance Models for Visual Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Kevin Barraclough,et al.  I and i , 2001, BMJ : British Medical Journal.

[6]  Éric Marchand,et al.  A real-time tracker for markerless augmented reality , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[7]  Katsushi Ikeuchi,et al.  Occlusion robust tracking utilizing spatio-temporal Markov random field model , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[8]  Roberto Cipolla,et al.  Real-Time Visual Tracking of Complex Structures , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Longin Jan Latecki,et al.  Object Tracking with Dynamic Template Update and Occlusion Detec , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[10]  Michel Dhome,et al.  Real Time Robust Template Matching , 2002, BMVC.

[11]  Gang Hua,et al.  Switching observation models for contour tracking in clutter , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[12]  Patrick Bouthemy,et al.  A 2D-3D model-based approach to real-time visual tracking , 2001, Image Vis. Comput..

[13]  Bo Hu,et al.  Robust Occlusion Handling in Object Tracking , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Beno Benhabib,et al.  Colour-Gradient Redundancy for Real-time Spatial Pose Tracking in Autonomous Robot Navigation , 2006, The 3rd Canadian Conference on Computer and Robot Vision (CRV'06).

[15]  Kenneth R. Smith,et al.  The OpenGL Reference Manual , 1992 .

[16]  Yi-Ping Hung,et al.  Discriminative Descriptor-Based Observation Model for Visual Tracking , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[17]  Avinash C. Kak,et al.  Accurate 3D Tracking of Rigid Objects with Occlusion Using Active Appearance Models , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[18]  Li-Qun Xu,et al.  A hybrid blob- and appearance-based framework for multi-object tracking through complex occlusions , 2005, 2005 IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance.

[19]  Arnold W. M. Smeulders,et al.  Fast occluded object tracking by a robust appearance filter , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Marco La Cascia,et al.  Fast, Reliable Head Tracking under Varying Illumination: An Approach Based on Registration of Texture-Mapped 3D Models , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Camillo Gentile,et al.  Segmentation for robust tracking in the presence of severe occlusion , 2001, IEEE Transactions on Image Processing.

[22]  In-So Kweon,et al.  Robust model-based 3D object recognition by combining feature matching with tracking , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[23]  Joerg Liebelt,et al.  Precise Registration of 3D Models To Images by Swarming Particles , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Ioannis Pitas,et al.  Occlusion resistant object tracking , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).