CAMSHIFT improvement on multi-hue and multi-object tracking

CAMSHIFT (Continuously Adaptive Mean-Shift) has been well accepted as one of the prominent methods in object tracking. CAMSHIFT is good for single hue object tracking and in the condition where object's color is different with background's color. In this paper, we enhance CAMSHIFT so it can be used for multi-object tracking and improve the robustness of CAMSHIFT for multi-hue object tracking especially in the situation where object's colors are similar with background's colors. We propose a more precise object localization by selecting each dominant color object part using a combination of Mean-Shift segmentation and region growing. Hue-distance, saturation and value color histogram are used to describe the object. We also track the dominant color object parts separately and combine them together to improve robustness of the tracking on multi-hue object. For multi-object tracking, we use a separate tracker for each object. Our experiments showed that those methods improved CAMSHIFT robustness significantly and enable CAMSHIFT for multi-object tracking.

[1]  Rafael C. González,et al.  Digital image processing using MATLAB , 2006 .

[2]  Shirong Liu,et al.  Kernel-based target tracking with multiple features fusion , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[3]  Larry D. Hostetler,et al.  The estimation of the gradient of a density function, with applications in pattern recognition , 1975, IEEE Trans. Inf. Theory.

[4]  Alex Zelinsky,et al.  Learning OpenCV---Computer Vision with the OpenCV Library (Bradski, G.R. et al.; 2008)[On the Shelf] , 2009, IEEE Robotics & Automation Magazine.

[5]  Raphaël Canals,et al.  Tracking system using CamShift and feature points , 2006, 2006 14th European Signal Processing Conference.

[6]  Ruimin Hu,et al.  Improved Object Tracking Algorithm Based on New HSV Color Probability Model , 2009, ISNN.

[7]  David Zhang,et al.  Robust Object Tracking Using Joint Color-Texture Histogram , 2009, Int. J. Pattern Recognit. Artif. Intell..

[8]  Gary Bradski,et al.  Computer Vision Face Tracking For Use in a Perceptual User Interface , 1998 .

[9]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Rustam Stolkin,et al.  Efficient visual servoing with the ABCshift tracking algorithm , 2008, 2008 IEEE International Conference on Robotics and Automation.

[11]  Fernando Torres,et al.  Tracking based on hue-saturation features with a miniaturized active vision system , 2009 .

[12]  Jesse S. Jin,et al.  Tracking Using CamShift Algorithm and Multiple Quantized Feature Spaces , 2004, VIP.