Night-time Outdoor Surveillance with Mobile Cameras

This paper addresses the problem of video surveillance by mobile cameras. We present a method that allows online change detection in night-time outdoor surveillance. Because of the camera movement, background frames are not available and must be "localized" in former sequences and registered with the current frames. To this end, we propose a Frame Localization And Registration (FLAR) approach that solves the problem efficiently. Frames of former sequences define a database which is queried by current frames in turn. To quickly retrieve nearest neighbors, database is indexed through a visual dictionary method based on the SURF descriptor. Furthermore, the frame localization is benefited by a temporal filter that exploits the temporal coherence of videos. Next, the recently proposed ECC alignment scheme is used to spatially register the synchronized frames. Finally, change detection methods apply to aligned frames in order to mark suspicious areas. Experiments with real night sequences recorded by in-vehicle cameras demonstrate the performance of the proposed method and verify its efficiency and effectiveness against other methods.

[1]  Richard Szeliski,et al.  Computer Vision - Algorithms and Applications , 2011, Texts in Computer Science.

[2]  Shishir K. Shah,et al.  Disparity Map Refinement for Video Based Scene Change Detection Using a Mobile Stereo Camera Platform , 2010, 2010 20th International Conference on Pattern Recognition.

[3]  S. Thrun,et al.  Change Detection From Multiple Camera Images Extended to Non-Stationary Cameras , 2005 .

[4]  Ramesh Jain,et al.  Experiential Sampling for video surveillance , 2003, IWVS '03.

[5]  Georgios D. Evangelidis,et al.  Parametric Image Alignment Using Enhanced Correlation Coefficient Maximization , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Jean Ponce,et al.  Detecting Abandoned Objects With a Moving Camera , 2010, IEEE Transactions on Image Processing.

[7]  Carlo S. Regazzoni,et al.  "A multi-resolution outdoor dual camera system for robust video-event metadata extraction" , 2002, Proceedings of the Fifth International Conference on Information Fusion. FUSION 2002. (IEEE Cat.No.02EX5997).

[8]  Antonio Torralba,et al.  SIFT Flow: Dense Correspondence across Different Scenes , 2008, ECCV.

[9]  Joan Serrat,et al.  Alignment of videos recorded from moving vehicles , 2007, 14th International Conference on Image Analysis and Processing (ICIAP 2007).

[10]  B. P. Lathi Signal Processing And Linear Systems , 1998 .

[11]  Seth Teller,et al.  Video matching , 2004, SIGGRAPH 2004.

[12]  Joan Serrat,et al.  Video Alignment for Change Detection , 2011, IEEE Transactions on Image Processing.

[13]  Punarjay Chakravarty,et al.  Anomaly detection and tracking for a patrolling robot , 2007 .

[14]  Bonhwa Ku,et al.  Robust Dynamic Super Resolution under Inaccurate Motion Estimation , 2010, 2010 7th IEEE International Conference on Advanced Video and Signal Based Surveillance.

[15]  Badrinath Roysam,et al.  Image change detection algorithms: a systematic survey , 2005, IEEE Transactions on Image Processing.

[16]  Chia-Ling Tsai,et al.  Registration of Challenging Image Pairs: Initialization, Estimation, and Decision , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[18]  Andrew Zisserman,et al.  Efficient Visual Search of Videos Cast as Text Retrieval , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Shishir K. Shah,et al.  Quantitative comparison of metrics for change detection in video patrolling applications , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[20]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .