A novel approach for global abnormal event detection in multi-camera surveillance system

In this paper, a novel global abnormal event detection algorithm is proposed for multiple disjoint synchronous camera network. We treat detecting unusual global events as discovering context-incoherent patterns through learning temporal dependencies between distributed local activities observed within and across camera views. Trajectories are firstly extracted using mean-shift approach in each camera view. As local activities are learned by applying clustering algorithm for trajectories, we model global event patterns using a probabilistic graphical model with different nodes representing entry/exit regions from different views and the directed links between nodes encoding their temporal dependencies. A novel two-stage structure learning algorithm is formulated to learn globally optimized temporal dependencies. Modified Dynamic Time Warping is used to learning the links in unobservable regions in camera network. Then, Monte Carlo(MC) algorithm is used to refine the structure and produce a final dependency structure. We validate the effectiveness of the proposed approach using a synthetic data set and videos captured from a camera network installed at a research institute.

[1]  Mingyi Wang,et al.  A hybrid Bayesian network learning method for constructing gene networks , 2007, Comput. Biol. Chem..

[2]  Matthew A. Brown,et al.  Recognising panoramas , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[3]  David Maxwell Chickering,et al.  Learning Bayesian Networks: The Combination of Knowledge and Statistical Data , 1994, Machine Learning.

[4]  Bill Triggs,et al.  Camera pose and calibration from 4 or 5 known 3D points , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[5]  Hanning Zhou,et al.  Unusual Event Detection via Multi-camera Video Mining , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[6]  Mubarak Shah,et al.  Appearance modeling for tracking in multiple non-overlapping cameras , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[7]  Shaogang Gong,et al.  Modelling activity global temporal dependencies using Time Delayed Probabilistic Graphical Model , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[8]  Tieniu Tan,et al.  A system for learning statistical motion patterns , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Pierre Gurdjos,et al.  Methods and geometry for plane-based self-calibration , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[10]  S. Gong,et al.  Global Abnormal Behaviour Detection Using a Network of CCTV Cameras , 2008 .

[11]  Peter Bühlmann,et al.  Estimating High-Dimensional Directed Acyclic Graphs with the PC-Algorithm , 2007, J. Mach. Learn. Res..

[12]  Shaogang Gong,et al.  Multi-camera activity correlation analysis , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Xiaogang Wang,et al.  Shape and Appearance Context Modeling , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[14]  Tim J. Ellis,et al.  Bridging the gaps between cameras , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[15]  W. Eric L. Grimson,et al.  Inference of non-overlapping camera network topology by measuring statistical dependence , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[16]  Mubarak Shah,et al.  Tracking across multiple cameras with disjoint views , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[17]  Richard I. Hartley,et al.  Person Reidentification Using Spatiotemporal Appearance , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[18]  W. Eric L. Grimson,et al.  Correspondence-Free Activity Analysis and Scene Modeling in Multiple Camera Views , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.