Evaluation of foreground detection methodology for a moving camera

Detection of moving objects is one of the key steps for vision based applications. Many previous works leverage background subtraction using background models and assume that image sequences are captured from a stationary camera. These methods are not directly applied to image sequences from a moving camera because both foreground and background objects move with respect to the camera. One of the approaches to tackle this problem is to estimate background movement by computing pixel correspondences between frames such as homography. With this approach, moving objects can be detected by using existing background subtraction. In this paper, we evaluate detection of foreground objects for image sequences from a moving camera. Especially, we focus on homography as a camera motion. In our evaluation we change the following parameters: changing feature points, the number of them and estimation methods of homography. We analyze its effect on detection of moving objects in regard to detection accuracy, processing time. Through experiments, we show requirement of background models in image sequences form a moving camera.

[1]  René Vidal,et al.  A Benchmark for the Comparison of 3-D Motion Segmentation Algorithms , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  James W. Davis,et al.  A Multi-transformational Model for Background Subtraction with Moving Cameras , 2014, ECCV.

[3]  Larry S. Davis,et al.  Non-parametric Model for Background Subtraction , 2000, ECCV.

[4]  Takeo Kanade,et al.  Background Subtraction for Freely Moving Cameras , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[5]  Marc Van Droogenbroeck,et al.  ViBE: A powerful random technique to estimate the background in video sequences , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[6]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[7]  Atsushi Shimada,et al.  Background Model Based on Statistical Local Difference Pattern , 2012, ACCV Workshops.

[8]  Bohyung Han,et al.  Generalized Background Subtraction Using Superpixels with Label Integrated Motion Estimation , 2014, ECCV.

[9]  Ahmed M. Elgammal,et al.  Online Moving Camera Background Subtraction , 2012, ECCV.

[10]  Hyung Jin Chang,et al.  Detection of Moving Objects with Non-stationary Cameras in 5.8ms: Bringing Motion Detection to Your Mobile Device , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[11]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[12]  Lucia Maddalena,et al.  Neural Background Subtraction for Pan-Tilt-Zoom Cameras , 2014, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[13]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[14]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[15]  P. Rousseeuw Least Median of Squares Regression , 1984 .