A Dual-Camera-Based Ultrafast Tracking System for Simultaneous Multi-target Zooming

In this paper, we develop a novel dual-camera system that can simultaneously capture zooming-in targets by combining an ultrafast pan-tilt camera and a fixed wide-view camera. According to the positions of all the targets recognized with deep learning in the wide-view camera, the pan and tilt angles of multiple pan-tilt cameras are controlled virtually on the ultra-fast pan-tilt camera through multi-thread viewpoint control to simultaneously capture the zooming-in images of all the targets. Our system can generate five hundred virtual cameras with different zooming views in a second, and the effectiveness of our system is demonstrated by showing experimental results in simultaneous zoom shooting for multiple running persons and cars in the range of 70 m or more in a natural outdoor scene.

[1]  Anil K. Jain,et al.  Face Tracking and Recognition at a Distance: A Coaxial and Concentric PTZ Camera System , 2013, IEEE Transactions on Information Forensics and Security.

[2]  Mohan S. Kankanhalli,et al.  Multi-Camera Coordination and Control in Surveillance Systems , 2015, ACM Trans. Multim. Comput. Commun. Appl..

[3]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[4]  Hua Yang,et al.  Vibration Sensing of a Bridge Model Using a Multithread Active Vision System , 2017, IEEE/ASME Transactions on Mechatronics.

[5]  Amit K. Roy-Chowdhury,et al.  Collaborative Sensing in a Distributed PTZ Camera Network , 2012, IEEE Transactions on Image Processing.

[6]  Dezhen Song,et al.  Systems and algorithms for autonomous and scalable crowd surveillance using robotic PTZ cameras assisted by a wide-angle camera , 2010, Auton. Robots.

[7]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[8]  Takeshi Takaki,et al.  Real-Time Monocular Three-Dimensional Motion Tracking Using a Multithread Active Vision System , 2018, J. Robotics Mechatronics.

[9]  Nikolaos Papanikolopoulos,et al.  Multi-Camera Human Activity Monitoring , 2008, J. Intell. Robotic Syst..

[10]  Takeshi Takaki,et al.  Monocular Stereo Measurement Using High-Speed Catadioptric Tracking , 2017, Sensors.

[11]  Hiromasa Oku,et al.  Design Principles of a High-Speed Omni-Scannable Gaze Controller , 2016, IEEE Robotics and Automation Letters.

[12]  Hugo Proença,et al.  Visible-wavelength iris/periocular imaging and recognition surveillance environments , 2016, Image Vis. Comput..

[13]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Masatoshi Ishikawa,et al.  High-speed gaze controller for millisecond-order pan/tilt camera , 2011, 2011 IEEE International Conference on Robotics and Automation.

[15]  Tadayoshi Aoyama,et al.  Vision-Based Modal Analysis Using Multiple Vibration Distribution Synthesis to Inspect Large-Scale Structures , 2018, Journal of Dynamic Systems, Measurement, and Control.