Panoptes: Servicing Multiple Applications Simultaneously Using Steerable Cameras

Steerable surveillance cameras offer a unique opportunity to support multiple vision applications simultaneously. However, state-of-art camera systems do not support this as they are often limited to one application per camera. We believe that we should break the one-to-one binding between the steerable camera and the application. By doing this we can quickly move the camera to a new view needed to support a different vision application. When done well, the scheduling algorithm can support a larger number of applications over an existing network of surveillance cameras. With this in mind we developed Panoptes, a technique that virtualizes a camera view and presents a different fixed view to different applications. A scheduler uses camera controls to move the camera appropriately providing the expected view for each application in a timely manner, minimizing the impact on application performance. Experiments with a live camera setup demonstrate that Panoptes can support multiple applications, capturing up to 80% more events of interest in a wide scene, compared to a fixed view camera.

[1]  Raúl Rojas,et al.  Kalman filter for vision tracking , 2005 .

[2]  Demetri Terzopoulos,et al.  Planning ahead for PTZ camera assignment and handoff , 2009, 2009 Third ACM/IEEE International Conference on Distributed Smart Cameras (ICDSC).

[3]  A. Çapar,et al.  License Plate Recognition From Still Images and Video Sequences: A Survey , 2008, IEEE Transactions on Intelligent Transportation Systems.

[4]  M. Tekalp,et al.  Automatic Vehicle Counting from Video for Traffic Flow Analysis , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[5]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[6]  M. Abidi,et al.  Computer Vision and Image Understanding 114 (2010) 179–197 Contents lists available at ScienceDirect Computer Vision and Image Understanding , 2022 .

[7]  Greg Welch,et al.  On-line control of active camera networks for computer vision tasks , 2011, 2011 Fifth ACM/IEEE International Conference on Distributed Smart Cameras.

[8]  Sei-Wang Chen,et al.  Automatic license plate recognition , 2004, IEEE Transactions on Intelligent Transportation Systems.

[9]  Luc Van Gool,et al.  Color-Based Object Tracking in Multi-camera Environments , 2003, DAGM-Symposium.

[10]  Jitendra Malik,et al.  A real-time computer vision system for measuring traffic parameters , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[11]  Paul A. Viola,et al.  Detecting Pedestrians Using Patterns of Motion and Appearance , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[12]  Hironobu Fujiyoshi,et al.  Moving target classification and tracking from real-time video , 1998, Proceedings Fourth IEEE Workshop on Applications of Computer Vision. WACV'98 (Cat. No.98EX201).

[13]  I-Jeng Wang,et al.  Surveillance Camera Coordination Through Distributed Scheduling , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[14]  Hugo Proença,et al.  Dynamic camera scheduling for visual surveillance in crowded scenes using Markov random fields , 2015, 2015 12th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[15]  Prashant J. Shenoy,et al.  MultiSense: fine-grained multiplexing for steerable camera sensor networks , 2011, MMSys.

[16]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[17]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[18]  Shichang Xu,et al.  Mobilyzer: An Open Platform for Controllable Mobile Network Measurements , 2015, MobiSys.

[19]  Nuno Vasconcelos,et al.  Anomaly detection in crowded scenes , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[20]  C. Diehl,et al.  Scheduling an active camera to observe people , 2004, VSSN '04.

[21]  Yi Yao,et al.  Adaptive online camera coordination for multi-camera multi-target surveillance , 2010, Comput. Vis. Image Underst..

[22]  Max Lu,et al.  Acquiring Multi-Scale Images by Pan-Tilt-Zoom Control and Automatic Multi-Camera Calibration , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[23]  Hung Hai Bui,et al.  Mutliple camera coordination in a surveillance system , 2003 .

[24]  Nuno Vasconcelos,et al.  Privacy preserving crowd monitoring: Counting people without people models or tracking , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Paul A. Viola,et al.  Detecting Pedestrians Using Patterns of Motion and Appearance , 2005, International Journal of Computer Vision.

[26]  B. K. Julsing,et al.  Face Recognition with Local Binary Patterns , 2012 .

[27]  Matti Pietikäinen,et al.  Face Recognition with Local Binary Patterns , 2004, ECCV.