Kinematics modeling for Tele-Observation robotic camera

Modern surveillance systems commonly use pan-tilt-zoom camera to monitor the wildlife. With the expansion of monitored area, it is a fundamental problem to acquire clear images of the interested target by controlling camera. In this paper, we propose a kinematics model of a pan-tilt-zoom robotic camera to address this problem. The pan-tilt-zoom camera can be regarded as a special Tele-Observation robot with three degrees of freedom: pan, tilt and zoom. The field of view of the pan-tilt-zoom camera is taken as the end-effector of the Tele-Observation robot. A model of the Tele-Observation robot is proposed and the model parameters are estimated. The zoom model that reflects how focal length vary as a function of zoom scale is introduced. This model has higher accuracy of target's spatial location compared with existing method, especially on the aspect of depth information. The experiments demonstrate the feasibility and effectiveness of our new model. The average relative error of the field experiment is 0.49%, which can satisfy the requirement for wild surveillance.

[1]  PollefeysMarc,et al.  Pan-tilt-zoom camera calibration and high-resolution mosaic generation , 2006 .

[2]  Robert T. Collins,et al.  Calibration of an outdoor active camera system , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[3]  Min Tan,et al.  A novel pan-tilt camera control approach for visual tracking , 2014, Proceeding of the 11th World Congress on Intelligent Control and Automation.

[4]  Anil K. Jain,et al.  Face Tracking and Recognition at a Distance: A Coaxial and Concentric PTZ Camera System , 2013, IEEE Transactions on Information Forensics and Security.

[5]  Kamini Kanta Mohanty,et al.  A semi-automatic relative calibration of a fixed and PTZ camera pair for master-slave control , 2011, 3rd European Workshop on Visual Information Processing.

[6]  Max Lu,et al.  Robust and efficient foreground analysis for real-time video surveillance , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[7]  Chin-Shyurng Fahn,et al.  A high-definition human face tracking system using the fusion of omni-directional and PTZ cameras mounted on a mobile robot , 2010, 2010 5th IEEE Conference on Industrial Electronics and Applications.

[8]  Dezhen Song,et al.  Systems and algorithms for autonomous and scalable crowd surveillance using robotic PTZ cameras assisted by a wide-angle camera , 2010, Auton. Robots.

[9]  Francis L. Merat,et al.  Introduction to robotics: Mechanics and control , 1987, IEEE J. Robotics Autom..

[10]  Xing Chen,et al.  Calibrating pan-tilt cameras in wide-area surveillance networks , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[11]  Yu-Chee Tseng,et al.  A web-based, real-time video surveillance system by leveraging PTZ cameras , 2015, 2015 IEEE Tenth International Conference on Intelligent Sensors, Sensor Networks and Information Processing (ISSNIP).

[12]  Dezhen Song,et al.  A minimum variance calibration algorithm for pan-tilt robotic cameras in natural environments , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[13]  Barry F. Kavanagh,et al.  Surveying principles and applications , 1984 .

[14]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[15]  Peng Zhou,et al.  Dual cameras collaborative tracking system based on SOPC , 2014, 2014 7th International Congress on Image and Signal Processing.

[16]  Ziyan Wu,et al.  Keeping a Pan-Tilt-Zoom Camera Calibrated , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Dezhen Song,et al.  Systems and algorithms for autonomously simultaneous observation of multiple objects using robotic PTZ cameras assisted by a wide-angle camera , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Toshiaki Fujii,et al.  A new vision system for traffic sign recognition , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[19]  Marc Pollefeys,et al.  Pan-tilt-zoom camera calibration and high-resolution mosaic generation , 2006, Comput. Vis. Image Underst..