Histogram-Based Partial Differential Equation for Object Tracking

Traditional object tracking based on color histograms can only represent objects with rectangles or ellipses, thus having very limited ability to follow objects with complex shapes or with highly non-rigid motion. In addressing this problem, we formulate histogram-based tracking as a functional optimization problem based on Jesson-Shannon divergence that is bounded, symmetric and a true metric. Optimization of the functional consists in searching for a candidate image region of possibly very complex shape, whose color distribution is the most similar to the known, target distribution. By using two different techniques of shape derivative and variational derivative (in section 2 and appendix respectively), we derive the partial differential equation (PDE) that describes the evolution of the object contour. Level set algorithm is used to compute the solution of the PDE. Experiments show that the proposed work is globally convergent and can track objects with complex shapes and/or with highly non-rigid motion.

[1]  Peihua Li,et al.  A clustering-based color model and integral images for fast object tracking , 2006, Signal Process. Image Commun..

[2]  Ross T. Whitaker,et al.  Interactive, GPU-Based Level Sets for 3D Segmentation , 2003, MICCAI.

[3]  Alper Yilmaz,et al.  Object Tracking by Asymmetric Kernel Mean Shift with Automatic Scale and Orientation Selection , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  James A. Sethian,et al.  Level Set Methods and Fast Marching Methods , 1999 .

[5]  Dominik Endres,et al.  A new metric for probability distributions , 2003, IEEE Transactions on Information Theory.

[6]  M. Delfour,et al.  Shapes and Geometries: Analysis, Differential Calculus, and Optimization , 1987 .

[7]  Li Peihua,et al.  A clustering-based color model and integral images for fast object tracking , 2006 .

[8]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[9]  Alan L. Yuille,et al.  Region Competition: Unifying Snakes, Region Growing, and Bayes/MDL for Multiband Image Segmentation , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Dorin Comaniciu,et al.  Real-time tracking of non-rigid objects using mean shift , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[11]  Ehud Rivlin,et al.  Visual Tracking by Affine Kernel Fitting Using Color and Object Boundary , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[12]  Ronald Fedkiw,et al.  Level set methods and dynamic implicit surfaces , 2002, Applied mathematical sciences.

[13]  Olivier D. Faugeras,et al.  Image Segmentation Using Active Contours: Calculus of Variations or Shape Gradients? , 2003, SIAM J. Appl. Math..

[14]  Stanley T. Birchfield,et al.  Elliptical head tracking using intensity gradients and color histograms , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[15]  Anthony J. Yezzi,et al.  Gradient flows and geometric active contour models , 1995, Proceedings of IEEE International Conference on Computer Vision.