Fast and robust CAMShift tracking

CAMShift is a well-established and fundamental algorithm for kernel-based visual object tracking. While it performs well with objects that have a simple and constant appearance, it is not robust in more complex cases. As it solely relies on back projected probabilities it can fail in cases when the object's appearance changes (e.g., due to object or camera movement, or due to lighting changes), when similarly colored objects have to be re-detected or when they cross their trajectories. We propose low-cost extensions to CAMShift that address and resolve all of these problems. They allow the accumulation of multiple histograms to model more complex object appearances and the continuous monitoring of object identities to handle ambiguous cases of partial or full occlusion. Most steps of our method are carried out on the GPU for achieving real-time tracking of multiple targets simultaneously. We explain efficient GPU implementations of histogram generation, probability back projection, computation of image moments, and histogram intersection. All of these techniques make full use of a GPU's high parallelization capabilities.

[1]  Abdolhossein Sarrafzadeh,et al.  Face Tracking Using Mean-Shift Algorithm: A Fuzzy Approach for Boundary Detection , 2005, ACII.

[2]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[3]  Jonathan Campbell,et al.  Shaogang Gong, Stephen J. McKenna, Alexandra Psarrou, Dynamic Vision: From Images to Face Recognition , 2000, Artificial Intelligence Review.

[4]  Alex K. B. See,et al.  FACE DETECTION AND TRACKING UTILIZING ENHANCED CAMSHIFT MODEL , 2007 .

[5]  Gary Bradski,et al.  Computer Vision Face Tracking For Use in a Perceptual User Interface , 1998 .

[6]  Yizong Cheng,et al.  Mean Shift, Mode Seeking, and Clustering , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Ehud Rivlin,et al.  Robust Fragments-based Tracking using the Integral Histogram , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[8]  R. Collins,et al.  On-line selection of discriminative tracking features , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[9]  Rustam Stolkin,et al.  An Adaptive Background Model for Camshift Tracking with a Moving Camera , 2006 .

[10]  Jesse S. Jin,et al.  Mean shift object tracking for a SIMD computer , 2005, Third International Conference on Information Technology and Applications (ICITA'05).

[11]  Hubert Nguyen,et al.  GPU Gems 3 , 2007 .

[12]  Peihua Li,et al.  Mean Shift Parallel Tracking on GPU , 2009, IbPRIA.

[13]  Xuanyin Wang,et al.  Real-time follow-up head tracking in dynamic complex environments , 2009 .

[14]  Jesse S. Jin,et al.  Tracking Using CamShift Algorithm and Multiple Quantized Feature Spaces , 2004, VIP.

[15]  Yuansong Qiao,et al.  An Improved CamShift Algorithm for Target Tracking in Video Surveillance , 2009 .

[16]  Dorin Comaniciu,et al.  Robust analysis of feature spaces: color image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.