Panoramic Background Generation and Abnormal Behavior Detection in PTZ Camera Networks

In this paper, we present a novel method to abnormal behavior detection in PTZ camera networks. To extract motion information of scene in moving camera environment, we use panoramic background which is generated by frames. In contrast with previous methods, we use MRF framework to integrate temporal and spatial information of frames to generate panoramic background. In addition, we introduce a panoramic activity map to detect abnormal behavior of people. The panoramic activity map is useful in various abnormal situation since it includes multiple features such as location, motion, direction and pace of objects. Experimental results from real sequences demonstrate the effectiveness of our method.

[1]  Matthew A. Brown,et al.  Automatic Panoramic Image Stitching using Invariant Features , 2007, International Journal of Computer Vision.

[2]  Qin Li,et al.  Panoramic background model for PTZ camera , 2010, 2010 3rd International Congress on Image and Signal Processing.

[3]  Zhenjiang Miao,et al.  Automatic panorama image mosaic and ghost eliminating , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[4]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[5]  Richard Szeliski,et al.  Construction of Panoramic Image Mosaics with Global and Local Alignment , 2001 .

[6]  Mongi A. Abidi,et al.  Real-time video tracking using PTZ cameras , 2003, International Conference on Quality Control by Artificial Vision.

[7]  Venkatesh Saligrama,et al.  Abnormal behavior detection and behavior matching for networked cameras , 2008, 2008 Second ACM/IEEE International Conference on Distributed Smart Cameras.

[8]  S. B. Kang,et al.  Panoramic vision : sensors, theory, and applications , 2001 .

[9]  Yingen Xiong,et al.  Eliminating Ghosting Artifacts for Panoramic Images , 2009, 2009 11th IEEE International Symposium on Multimedia.

[10]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[11]  Martin Kampel,et al.  Unexpected Human Behavior Recognition in Image Sequences Using Multiple Features , 2010, 2010 20th International Conference on Pattern Recognition.

[12]  Massimo Piccardi,et al.  Background subtraction techniques: a review , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[13]  Matthew A. Brown,et al.  Recognising panoramas , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[14]  Mubarak Shah,et al.  Learning object motion patterns for anomaly detection and improved object detection , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  David C. Hogg,et al.  Learning the distribution of object trajectories for event recognition , 1996, Image Vis. Comput..