A parallel color-based particle filter for object tracking

Porting well known computer vision algorithms to low power, high performance computing devices such as SIMD linear processor arrays can be a challenging task. One especially useful such algorithm is the color-based particle filter, which has been applied successfully by many research groups to the problem of tracking non-rigid objects. In this paper, we propose an implementation of the color-based particle filter suitable for SIMD processors. The main focus of our work is on the parallel computation of the particle weights. This step is the major bottleneck of standard implementations of the color-based particle filter since it requires the knowledge of the histograms of the regions surrounding each hypothesized target position. We expect this approach to perform faster in an SIMD processor than an implementation in a standard desktop computer even running at much lower clock speeds.

[1]  Luc Van Gool,et al.  Object Tracking with an Adaptive Color-Based Particle Filter , 2002, DAGM-Symposium.

[2]  Ryusuke Miyamoto,et al.  A Real-Time Object Recognition System on Cell Broadband Engine , 2007, PSIVT.

[3]  James J. Little,et al.  A Boosted Particle Filter: Multitarget Detection and Tracking , 2004, ECCV.

[4]  Shorin Kyo,et al.  Efficient Implementation of Image Processing Algorithms on Linear Processor Arrays Using the Data Parallel Language IDC , 1996, MVA.

[5]  Deborah Estrin,et al.  Cyclops: in situ image sensing and interpretation in wireless sensor networks , 2005, SenSys '05.

[6]  Luc Van Gool,et al.  An adaptive color-based particle filter , 2003, Image Vis. Comput..

[7]  Richard P. Kleihorst,et al.  REAL-TIME FACE DETECTION ON A "DUAL-SENSOR" SMART CAMERA USING SMOOTH- EDGES TECHNIQUE , 2006 .

[8]  Luc Van Gool,et al.  Color-Based Object Tracking in Multi-camera Environments , 2003, DAGM-Symposium.

[9]  Jeffrey K. Uhlmann,et al.  New extension of the Kalman filter to nonlinear systems , 1997, Defense, Security, and Sensing.

[10]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.

[11]  Branko Ristic,et al.  A color-based particle filter for joint detection and tracking of multiple objects , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[12]  Simon Maskell,et al.  A Single Instruction Multiple Data Particle Filter , 2006, 2006 IEEE Nonlinear Statistical Signal Processing Workshop.

[13]  Shorin Kyo,et al.  An Integrated Memory Array Processor for Embedded Image Recognition Systems , 2007, IEEE Transactions on Computers.

[14]  Chen Wu,et al.  Mapping Vision Algorithms on SIMD Architecture Smart Cameras , 2007, 2007 First ACM/IEEE International Conference on Distributed Smart Cameras.

[15]  Greg Welch,et al.  Welch & Bishop , An Introduction to the Kalman Filter 2 1 The Discrete Kalman Filter In 1960 , 1994 .

[16]  Richard P. Kleihorst,et al.  An Embedded Low Power High Efficient Object Tracker for Surveillance Systems , 2007, 2007 First ACM/IEEE International Conference on Distributed Smart Cameras.

[17]  Patrick Pérez,et al.  Data fusion for visual tracking with particles , 2004, Proceedings of the IEEE.

[18]  Petar M. Djuric,et al.  Gaussian particle filtering , 2003, IEEE Trans. Signal Process..

[19]  Petar M. Djuric,et al.  Resampling algorithms and architectures for distributed particle filters , 2005, IEEE Transactions on Signal Processing.

[20]  Paul Wielage,et al.  Xetal: a low-power high-performance smart camera processor , 2001, ISCAS 2001. The 2001 IEEE International Symposium on Circuits and Systems (Cat. No.01CH37196).

[21]  R.P. Kleihorst,et al.  Xetal-II: A 107 GOPS, 600 mW Massively Parallel Processor for Video Scene Analysis , 2008, IEEE Journal of Solid-State Circuits.

[22]  Katja Nummiaro.  A Color-based Particle Filter , 2002 .

[23]  Wolfgang Straßer,et al.  Adaptive Probabilistic Tracking Embedded in a Smart Camera , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[24]  Fatih Murat Porikli,et al.  Integral histogram: a fast way to extract histograms in Cartesian spaces , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[25]  Patrick Pérez,et al.  Towards Improved Observation Models for Visual Tracking: Selective Adaptation , 2002, ECCV.

[26]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[27]  Patrick Pérez,et al.  Color-Based Probabilistic Tracking , 2002, ECCV.

[28]  Richard P. Kleihorst,et al.  Computing Stereo-Vision in Video Real-Time with Low-Cost SIMD-Hardware , 2005, ACIVS.

[29]  Abhijit Sinha,et al.  An Optimization-Based Parallel Particle Filter for Multitarget Tracking , 2005, IEEE Transactions on Aerospace and Electronic Systems.

[30]  Dorin Comaniciu,et al.  Real-time tracking of non-rigid objects using mean shift , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[31]  Petar M. Djuric,et al.  Architectures for efficient implementation of particle filters , 2004 .