Hardware/software co-design of a real-time kernel based tracking system

The probabilistic visual tracking methods using color histograms have been proven to be robust to target model variations and background illumination changes as shown by the recent research. However, the required computational cost is high due to intensive image data processing. The embedded solution of such algorithms become challenging due to high computational power demand and algorithm complexity. This paper presents a hardware/software co-design architecture for implementation of the well-known kernel based mean shift tracking algorithm. The design uses color histogram of the target as tracking feature. The target is searched in the consecutive images by maximizing the statistical match of the color distributions. The target localization is based on gradient based iterative search instead of exhaustive search which makes the system capable of achieving frame rate up to hundreds of frames per second while tracking multiple targets. The design, which is fully standalone, is implemented on a low-cost medium-size field programmable gate array (FPGA) device. The hardware cost of the design is compared with some other tracking systems. The performance of the system in terms of speed is evaluated and compared with the software based implementation. It is expected that the proposed solution will find its utility in applications like embedded automatic video surveillance systems.

[1]  Fatih Murat Porikli,et al.  Achieving real-time object detection and tracking under extreme conditions , 2006, Journal of Real-Time Image Processing.

[2]  Dorin Comaniciu,et al.  Real-time tracking of non-rigid objects using mean shift , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[3]  Jae Wook Jeon,et al.  FPGA-based real-time visual tracking system using adaptive color histograms , 2007, 2007 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[4]  Jae Wook Jeon,et al.  A Real-Time Object Tracking System Using a Particle Filter , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[6]  Jason Schlessman,et al.  Hardware/Software Co-Design of an FPGA-based Embedded Tracking System , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[7]  Patrick Pérez,et al.  Color-Based Probabilistic Tracking , 2002, ECCV.

[8]  Matthew P. Wand,et al.  Kernel Smoothing , 1995 .

[9]  Viktor Öwall,et al.  An Embedded Real-Time Surveillance System: Implementation and Evaluation , 2008, J. Signal Process. Syst..

[10]  G. Pflug.  Kernel Smoothing. Monographs on Statistics and Applied Probability - M. P. Wand; M. C. Jones. , 1996 .

[11]  Peihua Li,et al.  Mean Shift Parallel Tracking on GPU , 2009, IbPRIA.

[12]  Javier Díaz,et al.  FPGA-based real-time optical-flow system , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  Mohammad Bilal Malik,et al.  State-space recursive least-squares: Part I , 2004, Signal Process..

[14]  Usman Ali,et al.  FPGA/soft-processor based real-time object tracking system , 2009, 2009 5th Southern Conference on Programmable Logic (SPL).

[15]  Mohammad Bilal Malik,et al.  State-space recursive least squares: Part II , 2004, Signal Process..

[16]  Daniel P. Huttenlocher,et al.  A multi-resolution technique for comparing images using the Hausdorff distance , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Larry D. Hostetler,et al.  The estimation of the gradient of a density function, with applications in pattern recognition , 1975, IEEE Trans. Inf. Theory.

[18]  T. Kailath.  The Divergence and Bhattacharyya Distance Measures in Signal Selection , 1967 .

[19]  Y. Bar-Shalom.  Tracking and data association , 1988 .