Change Detection From Multiple Camera Images Extended to Non-Stationary Cameras

We describe an approach for analysis of surveillance video taken from moving vehicles making repeated passes through a specific, well-defined corridor. Our goal is to detect stationary objects which have appeared in scenes along the established route. Our motivation is to address security concerns in hostile theaters where stationary surveillance cameras would be destroyed almost immediately; yet mobile camera platforms; i.e., group transport vehicles/convoys are plentiful. Challenges include illumination changes from different time/day, and handling parallax resulting from our non-stationary camera. We provide an example using artificial surveillance images taken on the Stanford University campus. Scale-up to critical security theaters would be straightforward. The approach is equally applicable to images collected by aircraft.

[1]  Marc Pollefeys,et al.  Multiple view geometry , 2005 .

[2]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[3]  Seth J. Teller,et al.  Video matching , 2004, Encyclopedia of Multimedia.

[4]  Rudolph van der Merwe,et al.  Sigma-Point Kalman Filters for Integrated Navigation , 2004 .

[5]  Richard Szeliski,et al.  Visual odometry and map correlation , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[6]  Antonio Torralba,et al.  Context-based vision system for place and object recognition , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[7]  Sebastian Thrun,et al.  Robotic mapping: a survey , 2003 .

[8]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[9]  Sebastian Thrun,et al.  FastSLAM: a factored solution to the simultaneous localization and mapping problem , 2002, AAAI/IAAI.

[10]  D. Scharstein,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, Proceedings IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV 2001).

[11]  Rudolph van der Merwe,et al.  The unscented Kalman filter for nonlinear estimation , 2000, Proceedings of the IEEE 2000 Adaptive Systems for Signal Processing, Communications, and Control Symposium (Cat. No.00EX373).

[12]  Kentaro Toyama,et al.  Wallflower: principles and practice of background maintenance , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[13]  Emanuele Trucco,et al.  Introductory techniques for 3-D computer vision , 1998 .

[14]  Richard Szeliski,et al.  Creating full view panoramic image mosaics and texture-mapped models , 1997, International Conference on Computer Graphics and Interactive Techniques.

[15]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.