Scalable Decision-Theoretic Coordination and Control for Real-time Active Multi-Camera Surveillance

This paper presents an overview of our novel decision-theoretic multi-agent approach for controlling and coordinating multiple active cameras in surveillance. In this approach, a surveillance task is modeled as a stochastic optimization problem, where the active cameras are controlled and coordinated to achieve the desired surveillance goal in presence of uncertainties. We enumerate the practical issues in active camera surveillance and discuss how these issues are addressed in our decision-theoretic approach. We focus on two novel surveillance tasks: maximize the number of targets observed in active cameras with guaranteed image resolution and to improve the fairness in observation of multiple targets. We discuss the overview of our novel decision-theoretic frameworks: Markov Decision Process and Partially Observable Markov Decision Process frameworks for coordinating active cameras in uncertain and partially occluded environments.

[1]  No One is Left "Unwatched": Fairness in Observation of Crowds of Mobile Targets in Active Camera Surveillance , 2014, ECAI.

[2]  Gian Luca Foresti,et al.  An integrated surveillance system for outdoor security , 2005, IEEE Conference on Advanced Video and Signal Based Surveillance, 2005..

[3]  Gian Luca Foresti,et al.  PTZ camera network reconfiguration , 2009, 2009 Third ACM/IEEE International Conference on Distributed Smart Cameras (ICDSC).

[4]  John S. Boreczky,et al.  FlySPEC: a multi-user video camera system with hybrid human and automatic control , 2002, MULTIMEDIA '02.

[5]  Amit K. Roy-Chowdhury,et al.  Opportunistic sensing in a distributed PTZ camera network , 2012, 2012 Sixth International Conference on Distributed Smart Cameras (ICDSC).

[6]  Mohan S. Kankanhalli,et al.  Decision-theoretic approach to maximizing observation of multiple targets in multi-camera surveillance , 2012, AAMAS.

[7]  Mohan S. Kankanhalli,et al.  Multi-camera Skype: Enhancing the Quality of Experience of Video Conferencing , 2013 .

[8]  Norimichi Ukita,et al.  Real-time multitarget tracking by a cooperative distributed vision system , 2002, Proc. IEEE.

[9]  Faisal Z. Qureshi Collaborative sensing via local negotiations in ad hoc networks of smart cameras , 2010, ICDSC '10.

[10]  Kian Hsiang Low,et al.  Autonomic mobile sensor network with self-coordinated task allocation and execution , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[11]  Mohan S. Kankanhalli,et al.  Decision-theoretic coordination and control for active multi-camera surveillance in uncertain, partially observable environments , 2012, 2012 Sixth International Conference on Distributed Smart Cameras (ICDSC).

[12]  Kian Hsiang Low,et al.  Task Allocation via Self-Organizing Swarm Coalitions in Distributed Mobile Sensor Network , 2004, AAAI.

[13]  Amit K. Roy-Chowdhury,et al.  Decentralized camera network control using game theory , 2008, 2008 Second ACM/IEEE International Conference on Distributed Smart Cameras.

[14]  Takeo Kanade,et al.  Algorithms for cooperative multisensor surveillance , 2001, Proc. IEEE.

[15]  Faisal Z. Qureshi,et al.  Multi-tasking smart cameras for intelligent video surveillance systems , 2011, 2011 8th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[16]  Eric Sommerlade,et al.  Probabilistic surveillance with multiple active cameras , 2010, 2010 IEEE International Conference on Robotics and Automation.

[17]  Bruce A. Draper,et al.  Visual object tracking using adaptive correlation filters , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[18]  Tarak Gandhi,et al.  Multi-camera Based Traffic Flow Characterization & Classification , 2007, 2007 IEEE Intelligent Transportation Systems Conference.

[19]  Pedro U. Lima,et al.  A Decision-Theoretic Approach to Dynamic Sensor Selection in Camera Networks , 2009, ICAPS.

[20]  Mohan S. Kankanhalli,et al.  Coopetitive multi-camera surveillance using model predictive control , 2008, Machine Vision and Applications.