Automatic Bootstrapping and Tracking of Object Contours

A new fully automatic object tracking and segmentation framework is proposed. The framework consists of a motion-based bootstrapping algorithm concurrent to a shape-based active contour. The shape-based active contour uses finite shape memory that is automatically and continuously built from both the bootstrap process and the active-contour object tracker. A scheme is proposed to ensure that the finite shape memory is continuously updated but forgets unnecessary information. Two new ways of automatically extracting shape information from image data given a region of interest are also proposed. Results demonstrate that the bootstrapping stage provides important motion and shape information to the object tracker. This information is found to be essential for good (fully automatic) initialization of the active contour. Further results also demonstrate convergence properties of the content of the finite shape memory and similar object tracking performance in comparison with an object tracker with unlimited shape memory. Tests with an active contour using a fixed-shape prior also demonstrate superior performance for the proposed bootstrapped finite-shape-memory framework and similar performance when compared with a recently proposed active contour that uses an alternative online learning model.

[1]  Bruno Lameyre,et al.  SAP: A robust approach to track objects in video streams with Snakes And Points , 2004, BMVC.

[2]  Robert L. Stevenson,et al.  Studentized Dynamical System for Robust Object Tracking , 2011, IEEE Transactions on Image Processing.

[3]  Olivier D. Faugeras,et al.  Statistical shape influence in geodesic active contours , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[4]  Michael J. Black,et al.  Learning the Statistics of People in Images and Video , 2003, International Journal of Computer Vision.

[5]  W. Eric L. Grimson,et al.  A shape-based approach to the segmentation of medical imagery using level sets , 2003, IEEE Transactions on Medical Imaging.

[6]  Xianghua Xie,et al.  On-line Learning of Shape Information for Object Segmentation and Tracking , 2009, BMVC.

[7]  Brendan McCane.  Snakes and spiders [motion tracking and object segmentation] , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[8]  Dan Schonfeld,et al.  A complete system for head tracking using motion-based particle filter and randomly perturbed active contour , 2005, IS&T/SPIE Electronic Imaging.

[9]  Michael J. Black,et al.  A Framework for Robust Subspace Learning , 2003, International Journal of Computer Vision.

[10]  Donald B. Rubin,et al.  Max-imum Likelihood from Incomplete Data , 1972 .

[11]  Yogesh Rathi,et al.  A Framework for Image Segmentation Using Shape Models and Kernel Space Shape Priors , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Michael Isard,et al.  Learning to track curves in motion , 1994, Proceedings of 1994 33rd IEEE Conference on Decision and Control.

[13]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[14]  Thomas S. Huang,et al.  Online updating appearance generative mixture model for meanshift tracking , 2006, Machine Vision and Applications.

[15]  Xin Li,et al.  Contour-based object tracking with occlusion handling in video acquired using mobile cameras , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Timothy F. Cootes,et al.  Trainable method of parametric shape description , 1992, Image Vis. Comput..

[17]  Ming-Hsuan Yang,et al.  Incremental Learning for Robust Visual Tracking , 2008, International Journal of Computer Vision.

[18]  Brendan McCane.  Snakes and Spiders , 2000, ICPR.

[19]  Daniel Cremers,et al.  Kernel Density Estimation and Intrinsic Alignment for Shape Priors in Level Set Segmentation , 2006, International Journal of Computer Vision.

[20]  David G. Kirkpatrick,et al.  On the shape of a set of points in the plane , 1983, IEEE Trans. Inf. Theory.

[21]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[22]  V. Hlavác,et al.  Detection and Tracking of Humans in Single View Sequences Using 2 D Articulated Model , 2007 .

[23]  Stephen M. Smith,et al.  ASSET-2: Real-Time Motion Segmentation and Shape Tracking , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Michal Irani,et al.  Detecting and Tracking Multiple Moving Objects Using Temporal Integration , 1992, ECCV.

[25]  Daniel Cremers,et al.  Dynamical statistical shape priors for level set-based tracking , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  J.-Y. Bouguet,et al.  Pyramidal implementation of the lucas kanade feature tracker , 1999 .

[27]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[28]  Markus Huff,et al.  Conflicting motion information impairs multiple object tracking. , 2010, Journal of vision.

[29]  Xianghua Xie,et al.  Generic Motion based Object Segmentation for Assisted Navigation , 2009, VISAPP.

[30]  Stefano Soatto,et al.  Deformotion: Deforming Motion, Shape Average and the Joint Registration and Approximation of Structures in Images , 2003, International Journal of Computer Vision.

[31]  Danijel Skocaj,et al.  Weighted and robust incremental method for subspace learning , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[32]  Nikos Paragios,et al.  On the Representation of Shapes Using Implicit Functions , 2006, Statistics and Analysis of Shapes.

[33]  Ronen Basri,et al.  Actions as space-time shapes , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[34]  Joanna Isabelle Olszewska,et al.  Non-rigid object tracker based on a robust combination of parametric active contour and point distribution model , 2007, Electronic Imaging.

[35]  David C. Hogg,et al.  An efficient method for contour tracking using active shape models , 1994, Proceedings of 1994 IEEE Workshop on Motion of Non-rigid and Articulated Objects.

[36]  Dan Schonfeld,et al.  Visual Tracking Using High-Order Particle Filtering , 2011, IEEE Signal Processing Letters.

[37]  Luc Van Gool,et al.  Object Tracking with an Adaptive Color-Based Particle Filter , 2002, DAGM-Symposium.

[38]  Rachid Deriche,et al.  A level set framework using a new incremental, robust Active Shape Model for object segmentation and tracking , 2009, Image Vis. Comput..

[39]  Timothy F. Cootes,et al.  A Trainable Method of Parametric Shape Description , 1991, BMVC.

[40]  Quan Pan,et al.  Real-time multiple objects tracking with occlusion handling in dynamic scenes , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[41]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[42]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[43]  Gjlles Aubert,et al.  Mathematical problems in image processing , 2001 .