Real time tracking using an active pan-tilt-zoom network camera

We present here a real time active vision system on a PTZ network camera to track an object of interest. We address two critical issues in this paper. One is the control of the camera through network communication to follow a selected object. The other is to track an arbitrary type of object in real time under conditions of pose, viewpoint and illumination changes. We analyze the difficulties in the control through the network and propose a practical solution for tracking using a PTZ network camera. Moreover, we propose a robust real time tracking approach, which enhances the effectiveness by using complementary features under a two-stage particle filtering framework and a multi-scale mechanism. To improve time performance, the tracking algorithm is implemented as a multi-threaded process in OpenMP. Comparative experiments with state-of-the-art methods demonstrate the efficiency and robustness of our system in various applications such as pedestrian tracking, face tracking, and vehicle tracking.

[1]  Yanxi Liu,et al.  Online selection of discriminative tracking features , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Richard Bowden,et al.  Simultaneous modeling and tracking (SMAT) of feature sets , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[3]  Mohan S. Kankanhalli,et al.  Coopetitive multi-camera surveillance using model predictive control , 2008, Machine Vision and Applications.

[4]  Gerard Ledwich,et al.  Extension of the Dahlin-Higham controller to multivariable systems with time delays , 1994 .

[5]  Daniel Cremers,et al.  Globally optimal shape-based tracking in real-time , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Langis Gagnon,et al.  A system to automatically track humans and vehicles with a PTZ camera , 2007, SPIE Defense + Commercial Sensing.

[7]  Ming-Hsuan Yang,et al.  Incremental Learning for Robust Visual Tracking , 2008, International Journal of Computer Vision.

[8]  ZuWhan Kim.  Real time object tracking based on dynamic feature grouping with background subtraction , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Philippe Martinet,et al.  Object tracking with a pan-tilt-zoom camera: application to car driving assistance , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[10]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Gang Hua,et al.  Multi-scale visual tracking by sequential belief propagation , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[12]  Yuan Li,et al.  Tracking in Low Frame Rate Video: A Cascade Particle Filter with Discriminative Observers of Different Lifespans , 2007, CVPR.

[13]  Ian D. Reid,et al.  Robust Real-Time Visual Tracking Using Pixel-Wise Posteriors , 2008, ECCV.

[14]  Dorin Comaniciu,et al.  Kernel-Based Object Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Aleksandar Micic,et al.  On the modified Smith predictor for controlling a process with an integrator and long dead-time , 1999, IEEE Trans. Autom. Control..

[16]  James W. Davis,et al.  An Efficient Active Camera Model for Video Surveillance , 2008, 2008 IEEE Workshop on Applications of Computer Vision.

[17]  Xiaoqin Zhang,et al.  Robust Visual Tracking Based on Incremental Tensor Subspace Learning , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[18]  Rainer Stiefelhagen,et al.  Automatic Person Detection and Tracking using Fuzzy Controlled Active Cameras , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[20]  M. Matausek,et al.  A modified Smith predictor for controlling a process with an integrator and long dead-time , 1996, IEEE Trans. Autom. Control..

[21]  R. Sharma,et al.  Visual servoing with independently controlled cameras using a learned invariant representation , 1998, Proceedings of the 37th IEEE Conference on Decision and Control (Cat. No.98CH36171).

[22]  Ehud Rivlin,et al.  Bittracker—A Bitmap Tracker for Visual Tracking under Very General Conditions , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.

[24]  Paul A. Viola,et al.  Robust Real-time Object Detection , 2001 .

[25]  Luc Van Gool,et al.  Object Tracking with an Adaptive Color-Based Particle Filter , 2002, DAGM-Symposium.

[26]  Hiroyasu Koshimizu,et al.  Hierarchical face tracking by using PTZ camera , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..