Detection of moving objects with a moving camera using non-panoramic background model

This paper presents a fast and reliable method for moving object detection with moving cameras (including pan–tilt–zoom and hand-held cameras). Instead of building large panoramic background model as conventional approaches, we construct a small-size background model, whose size is the same as input frame, to decrease computation time and memory storage without loss of detection performance. The small-size background model is built by the proposed single spatio-temporal distributed Gaussian model and this can solve false detection results arising from registration error and background adaptation problem in moving background. More than the proposed background model based on spatial and temporal information, several pre- and post-processing methods are adopted and organized systematically to enhance the detection performances. We evaluate the proposed method with several video sequences under difficult conditions, such as illumination change, large zoom variation, and fast camera movement, and present outperforming detection results of our algorithm with fast computation time.

[1]  Monica N. Nicolescu,et al.  Improving target detection by coupling it with tracking , 2009, Machine Vision and Applications.

[2]  Yan Zhang,et al.  Robust Moving Object Detection at Distance in the Visible Spectrum and Beyond Using A Moving Camera , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[3]  Rita Cucchiara,et al.  Advanced video surveillance with pan tilt zoom cameras , 2006 .

[4]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[5]  Jan-Olof Eklundh,et al.  Statistical background subtraction for a mobile observer , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[6]  Serge Miguet,et al.  Real Time Foreground Object Detection using PTZ Camera , 2009, VISAPP.

[7]  H. Wilson,et al.  Threshold visibility of frequency gradient patterns , 1977, Vision Research.

[8]  Alessandro Bevilacqua,et al.  Joint Spatial and Tonal Mosaic Alignment for Motion Detection with PTZ Camera , 2006, ICIAR.

[9]  Chin-Seng Chua,et al.  Motion detection with non-stationary background , 2001, Proceedings 11th International Conference on Image Analysis and Processing.

[10]  Monica N. Nicolescu,et al.  Non-parametric statistical background modeling for efficient foreground region detection , 2008, Machine Vision and Applications.

[11]  Mohan M. Trivedi,et al.  Novel concepts and challenges for the next generation of video surveillance systems , 2007, Machine Vision and Applications.

[12]  Robert T. Collins,et al.  An Open Source Tracking Testbed and Evaluation Web Site , 2005 .

[13]  Luigi di Stefano,et al.  An effective real-time mosaicing algorithm apt to detect motion through background subtraction using a PTZ camera , 2005, IEEE Conference on Advanced Video and Signal Based Surveillance, 2005..

[14]  Mongi A. Abidi,et al.  Real-time video tracking using PTZ cameras , 2003, International Conference on Quality Control by Artificial Vision.

[15]  Pradeep K. Khosla,et al.  Motion detection and segmentation using image mosaics , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[16]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[17]  Xiaokang Yang,et al.  Efficient Spatio-temporal Segmentation for Extracting Moving Objects in Video Sequences , 2007, IEEE Transactions on Consumer Electronics.

[18]  Yaser Sheikh,et al.  Bayesian modeling of dynamic scenes for object detection , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Jean-Marc Lavest,et al.  Background subtraction adapted to PTZ cameras by keypoint density estimation , 2010, BMVC.

[20]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[21]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[22]  Norman S. Nise,et al.  Control Systems Engineering , 1991 .

[23]  Rui Zhang,et al.  Moving Objects Detection Method Based on Brightness Distortion and Chromaticity Distortion , 2007, IEEE Transactions on Consumer Electronics.

[24]  Ninad Thakoor,et al.  AUTOMATIC OBJECT DETECTION IN VIDEO SEQUENCES WITH CAMERA IN MOTION , 2004 .

[25]  Deborah Estrin,et al.  Warping background subtraction , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[26]  I. Haritaoglu,et al.  Background and foreground modeling using nonparametric kernel density estimation for visual surveillance , 2002 .

[27]  John See,et al.  An integrated vision-based architecture for home security system , 2007, IEEE Transactions on Consumer Electronics.

[28]  Daniel P. Huttenlocher,et al.  Scene modeling for wide area surveillance and image synthesis , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).