An Efficient Particle Filter–based Tracking Method Using Graphics Processing Unit (GPU)

Particle filter has been proven very robust in handling non-linear and non-Gaussian problems and has been widely used in the area of object tracking. One of the main problems in particle filter-based object tracking is, however, its high computational cost induced by the most time-consuming stage of measurement model computation. This paper makes progress in resolving the problem by proposing an efficient particle filter-based tracking algorithm using color information. First, a compact color cooccurrence histogram is presented, which considers both spatial and color information and can effectively represent color distribution with a very small number of histogram bins. The paper also introduces integral images by which the cooccurrence histogram can be obtained with simple array reference operations. However, the construction of the integral images on the CPU may be computationally expensive. Hence, this paper develops parallel algorithms on a desktop Graphics Processing Unit (GPU), which accomplishes the integral images construction and cooccurrence histogram computation after bin index determination. The resulting algorithm is quite efficient and has better performance than the traditional histogram-based tracking algorithm. The tracking time of the proposed algorithm increases insignificantly with the growth of particle number, and it remains consistent among varying image sequences and stable throughout all frames in the same image sequence due to its irrelevance to object size. Experiments in diverse image sequences validate our conclusions.

[1]  Katja Nummiaro A Color-based Particle Filter , 2002 .

[2]  William J. Dally,et al.  Scatter-add in data parallel architectures , 2005, 11th International Symposium on High-Performance Computer Architecture.

[3]  Anil K. Jain Data clustering: 50 years beyond K-means , 2008, Pattern Recognit. Lett..

[4]  Peter F. Sturm,et al.  Adaptive Tracking of Non-Rigid Objects Based on Color Histograms and Automatic Parameter Selection , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[5]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[6]  Shamik Sural,et al.  An Integrated Color and Intensity Co-occurrence Matrix , 2007, Pattern Recognit. Lett..

[7]  Andrew Blake,et al.  A framework for spatiotemporal control in the tracking of visual contours , 1993, International Journal of Computer Vision.

[8]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[9]  Simon J. Godsill,et al.  On sequential Monte Carlo sampling methods for Bayesian filtering , 2000, Stat. Comput..

[10]  Luc Van Gool,et al.  An adaptive color-based particle filter , 2003, Image Vis. Comput..

[11]  Michael Isard,et al.  Contour Tracking by Stochastic Propagation of Conditional Density , 1996, ECCV.

[12]  Peihua Li,et al.  Visual contour tracking based on particle filters , 2003, Image Vis. Comput..

[13]  Guy E. Blelloch,et al.  Prefix sums and their applications , 1990 .

[14]  Natan Peterfreund,et al.  Robust Tracking of Position and Velocity With Kalman Snakes , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Michael Isard,et al.  Active Contours: The Application of Techniques from Graphics, Vision, Control Theory and Statistics to Visual Tracking of Shapes in Motion , 2000 .

[16]  Alois Knoll,et al.  A GPU-accelerated particle filter with pixel-level likelihood , 2008, VMV.

[17]  Emilio Maggio,et al.  Multi-part target representation for color tracking , 2005, IEEE International Conference on Image Processing 2005.

[18]  David Suter,et al.  Adaptive Object Tracking Based on an Effective Appearance Filter , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Jesús Martínez del Rincón,et al.  An efficient particle filter for color-based tracking in complex scenes , 2007, 2007 IEEE Conference on Advanced Video and Signal Based Surveillance.

[20]  Dorin Comaniciu,et al.  Real-time tracking of non-rigid objects using mean shift , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[21]  Fredrik Gustafsson,et al.  On Resampling Algorithms for Particle Filters , 2006, 2006 IEEE Nonlinear Statistical Signal Processing Workshop.

[22]  Victor Podlozhnyuk,et al.  Histogram calculation in CUDA, NVIDIA GPU Computing SDK CUDA Advanced Topics Whitepaper , 2007 .

[23]  Eric Moulines,et al.  Comparison of resampling schemes for particle filtering , 2005, ISPA 2005. Proceedings of the 4th International Symposium on Image and Signal Processing and Analysis, 2005..

[24]  Petar M. Djuric,et al.  Resampling algorithms and architectures for distributed particle filters , 2005, IEEE Transactions on Signal Processing.

[25]  Yasushi Yagi,et al.  Adaptive Mean-Shift Tracking With Auxiliary Particles , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[26]  Baoxin Li,et al.  Adaptive Rao–Blackwellized Particle Filter and Its Evaluation for Tracking in Surveillance , 2007, IEEE Transactions on Image Processing.

[27]  Ryusuke Miyamoto,et al.  Hardware implementation of a cascade particle filter , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[28]  Larry S. Davis,et al.  Fast multiple object tracking via a hierarchical particle filter , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[29]  Christoph Palm,et al.  Color texture classification by integrative Co-occurrence matrices , 2004, Pattern Recognit..

[30]  Fredrik Gustafsson,et al.  A graphics processing unit implementation of the particle filter , 2007, 2007 15th European Signal Processing Conference.

[31]  Joaquín Míguez,et al.  Analysis of parallelizable resampling algorithms for particle filtering , 2007, Signal Process..

[32]  Peihua Li,et al.  Object Tracking with Particle Filter Using Color Information , 2007, MIRAGE.

[33]  Johnny Park,et al.  A Parallel Implementation of the Color-Based Particle Filter for Object Tracking , 2008 .

[34]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[35]  Richard Szeliski,et al.  Tracking with Kalman snakes , 1993 .

[36]  Juan José Pantrigo,et al.  Multiscale and local search methods for real time region tracking with particle filters: local search driven by adaptive scale estimation on GPUs , 2009, Machine Vision and Applications.

[37]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[38]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.

[39]  Bohyung Han,et al.  Bayesian Filtering and Integral Image for Visual Tracking , 2005 .

[40]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[41]  Rodney A. Kennedy,et al.  Efficient Histogram Algorithms for NVIDIA CUDA Compatible Devices , 2007 .

[42]  John Krumm,et al.  Object recognition with color cooccurrence histograms , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[43]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[44]  Patrick Pérez,et al.  Color-Based Probabilistic Tracking , 2002, ECCV.