Robust Feedback Zoom Tracking for Digital Video Surveillance

Zoom tracking is an important function in video surveillance, particularly in traffic management and security monitoring. It involves keeping an object of interest in focus during the zoom operation. Zoom tracking is typically achieved by moving the zoom and focus motors in lenses following the so-called “trace curve”, which shows the in-focus motor positions versus the zoom motor positions for a specific object distance. The main task of a zoom tracking approach is to accurately estimate the trace curve for the specified object. Because a proportional integral derivative (PID) controller has historically been considered to be the best controller in the absence of knowledge of the underlying process and its high-quality performance in motor control, in this paper, we propose a novel feedback zoom tracking (FZT) approach based on the geometric trace curve estimation and PID feedback controller. The performance of this approach is compared with existing zoom tracking methods in digital video surveillance. The real-time implementation results obtained on an actual digital video platform indicate that the developed FZT approach not only solves the traditional one-to-many mapping problem without pre-training but also improves the robustness for tracking moving or switching objects which is the key challenge in video surveillance.

[1]  Johannes Burge,et al.  Optimal defocus estimation in individual natural images , 2011, Proceedings of the National Academy of Sciences.

[2]  Sung-Jea Ko,et al.  A video camera system with adaptive zoom tracking , 2002, 2002 Digest of Technical Papers. International Conference on Consumer Electronics (IEEE Cat. No.02CH37300).

[3]  Pankaj Kumar,et al.  Real Time Target Tracking with Pan Tilt Zoom Camera , 2009, 2009 Digital Image Computing: Techniques and Applications.

[4]  Sedat Dogan,et al.  Real Time Speed Estimation of Moving Vehicles from Side View Images from an Uncalibrated Video Camera , 2010, Sensors.

[5]  M. Domínguez-Morales,et al.  A Neuro-Inspired Spike-Based PID Motor Controller for Multi-Motor Robots with Low Cost FPGAs , 2012, Sensors.

[6]  José-Enrique Simó-Ten,et al.  Video Sensor Architecture for Surveillance Applications , 2012, Sensors.

[7]  Lihong Xu,et al.  Multi-Objective Control Optimization for Greenhouse Environment Using Evolutionary Algorithms , 2011, Sensors.

[8]  K. Astr,et al.  Revisiting the Ziegler – Nichols step response method for PID control , 2004 .

[9]  Weng Khuen Ho,et al.  Performance and gain and phase margins of well-known PID tuning formulas , 1995, IEEE Trans. Control. Syst. Technol..

[10]  Gian Luca Foresti,et al.  Visual Sensor Technology for Advanced Surveillance Systems: Historical View, Technological Aspects and Research Activities in Italy , 2009, Sensors.

[11]  Nasser Kehtarnavaz,et al.  Real-time implementation of autofocus on the TI DSC processor , 2004, IS&T/SPIE Electronic Imaging.

[12]  Hyeran Byun,et al.  Salient human detection for robot vision , 2007, Pattern Analysis and Applications.

[13]  K. Åström,et al.  Revisiting the Ziegler-Nichols step response method for PID control , 2004 .

[14]  Ju-Yi Lee,et al.  Development of an auto-focus system based on the moiré method , 2011 .

[15]  Nasser Kehtarnavaz,et al.  Development and real-time implementation of a rule-based auto-focus algorithm , 2003, Real Time Imaging.

[16]  Ehud Rivlin,et al.  Zoom tracking and its applications , 2001, Machine Vision and Applications.

[17]  Chung-Feng Jeffrey Kuo,et al.  Improved Auto-Focus Search Algorithms for CMOS Image-Sensing Module , 2011, J. Inf. Sci. Eng..

[18]  Nasser Kehtarnavaz,et al.  A relational approach to zoom tracking for digital still cameras , 2005, IEEE Transactions on Consumer Electronics.

[19]  H. S. Wolff,et al.  iRun: Horizontal and Vertical Shape of a Region-Based Graph Compression , 2022, Sensors.

[20]  Ming-Shi Wang,et al.  A Vision Based Top-View Transformation Model for a Vehicle Parking Assistant , 2012, Sensors.

[21]  Biao Huang,et al.  Performance assessment of PID control loops subject to setpoint changes , 2011 .

[22]  Ken'ichi Kamijo,et al.  Stock price pattern recognition-a recurrent neural network approach , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[23]  Ze-Nian Li,et al.  Automatic Detection of Object of Interest and Tracking in Active Video , 2009, J. Signal Process. Syst..

[24]  Shyan-Ming Yuan,et al.  A Vision-Based Driver Nighttime Assistance and Surveillance System Based on Intelligent Image Sensing Techniques and a Heterogamous Dual-Core Embedded System Architecture , 2012, Sensors.

[25]  Feng Ding,et al.  Input-output data filtering based recursive least squares identification for CARARMA systems , 2010, Digit. Signal Process..

[26]  Wan-Young Chung,et al.  Visual Sensor Based Abnormal Event Detection with Moving Shadow Removal in Home Healthcare Applications , 2012, Sensors.

[27]  Chang Chieh Hang,et al.  Performance and gain and phase margins of well-known PI tuning formulas , 1995, IEEE Trans. Control. Syst. Technol..

[28]  Igor Kharitonenko,et al.  Digital zoom camera with image sharpening and suppression , 2004, IEEE Transactions on Consumer Electronics.

[29]  Nasser Kehtarnavaz,et al.  Real-time predictive zoom tracking for digital still cameras , 2007, Journal of Real-Time Image Processing.

[30]  Nasser Kehtarnavaz,et al.  Real-Time Implementation Issues in Passive Automatic Focusing for Digital Still Cameras , 2005, Journal of Imaging Science and Technology.

[31]  Larry S. Davis,et al.  W4: Real-Time Surveillance of People and Their Activities , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Kuntal Sengupta,et al.  Framework for real-time behavior interpretation from traffic video , 2005, IEEE Transactions on Intelligent Transportation Systems.

[33]  Sung-Jea Ko,et al.  A video camera system with enhanced zoom tracking and auto white balance , 2002, IEEE Trans. Consumer Electron..

[34]  Hsu-Yung Cheng,et al.  Intelligent Highway Traffic Surveillance With Self-Diagnosis Abilities , 2011, IEEE Transactions on Intelligent Transportation Systems.

[35]  John Illingworth,et al.  Automatic control of camera pan, zoom and focus for improving object recognition , 1995 .

[36]  David W. Murray,et al.  A method of reactive zoom control from uncertainty in tracking , 2007, Comput. Vis. Image Underst..

[37]  Stuart Bennett,et al.  A History of Control Engineering 1930-1955 , 1993 .

[38]  David Fernández Llorca,et al.  Complete Vision-Based Traffic Sign Recognition Supported by an I2V Communication System , 2012, Sensors.

[39]  Nasser Kehtarnavaz,et al.  Real-time implementation of zoom tracking on TI DM processor , 2005, IS&T/SPIE Electronic Imaging.