A novel temporal-spatial variable scale algorithm for detecting multiple moving objects

In this paper, a novel temporal-spatial variable scale algorithm (TSVSA) is presented which proposes to solve the problem of detecting multiple moving objects from complex backgrounds. In general, moving objects have multiscale characteristics in both spatial and temporal domains. In the spatial domain, objects differ in size while in temporal domain they differ in moving speed, which means each object has an optimum temporal-spatial detection window. Here we have formalized the detection of moving objects as the problem of searching in the temporal-spatial domain for multiple distinct optimum subspaces where significant evidence for motion exists. Such subspaces that differ in scale determine the positions in the temporal-spatial domain, moving traces, and other such features of moving objects. Then a criterion for a measurement of motion salience is provided, and a fast recursive algorithm called “octree decomposition of the temporal-spatial domain” is proposed. The proposed method can detect and track the objects simultaneously, greatly reducing the incidence of false alarms and miss detection rate. Extensive experiments and detailed analysis are provided in this paper, and multiple experimental results have confirmed the validity and effectiveness of the proposed method.

[1]  Marc Van Droogenbroeck,et al.  ViBE: A powerful random technique to estimate the background in video sequences , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[2]  Lu Wang,et al.  Extraction of Moving Objects From Their Background Based on Multiple Adaptive Thresholds and Boundary Evaluation , 2010, IEEE Transactions on Intelligent Transportation Systems.

[3]  A J Ahumada,et al.  Model of human visual-motion sensing. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[4]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[5]  Guojun Lu,et al.  Segmentation of moving objects in image sequence: A review , 2001 .

[6]  W. R. Wallace,et al.  The use of track-before-detect in pulse-Doppler radar , 2002, RADAR 2002.

[7]  R. Kerekes,et al.  Enhanced Video-Based Target Detection using Multi-Frame Correlation Filtering , 2009, IEEE Transactions on Aerospace and Electronic Systems.

[8]  Zoran Zivkovic,et al.  Improved adaptive Gaussian mixture model for background subtraction , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[9]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[10]  Wei Zhang,et al.  Algorithms for optical weak small targets detection and tracking: review , 2003, International Conference on Neural Networks and Signal Processing, 2003. Proceedings of the 2003.

[11]  Lap-Pui Chau,et al.  Hexagon-based search pattern for fast block motion estimation , 2002, IEEE Trans. Circuits Syst. Video Technol..

[12]  Daniel R. Fuhrmann,et al.  Quadtree Traversal Algorithms for Pointer-Based and Depth-First Representations , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Shireen Elhabian,et al.  Moving Object Detection in Spatial Domain using Background Removal Techniques - State-of-Art , 2008 .

[14]  Benjamin Friedlander,et al.  A Frequency Domain Algorithm for Multiframe Detection and Estimation of Dim Targets , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Oksam Chae,et al.  Statistical Background Modeling: An Edge Segment Based Moving Object Detection Approach , 2010, 2010 7th IEEE International Conference on Advanced Video and Signal Based Surveillance.

[16]  Young Hoon Joo,et al.  Fast and robust algorithm of tracking multiple moving objects for intelligent video surveillance systems , 2011, IEEE Transactions on Consumer Electronics.

[17]  Michael Teutsch,et al.  Detection, Segmentation, and Tracking of Moving Objects in UAV Videos , 2012, 2012 IEEE Ninth International Conference on Advanced Video and Signal-Based Surveillance.

[18]  Kanad K. Biswas,et al.  Salient object detection using a fuzzy theoretic approach , 2012, ICVGIP '12.

[19]  Daniel Cremers,et al.  Detection and Segmentation of Independently Moving Objects from Dense Scene Flow , 2009, EMMCVPR.

[20]  S. Buzzi,et al.  Track-before-detect procedures in a multi-target environment , 2008, IEEE Transactions on Aerospace and Electronic Systems.

[21]  Kai-Tai Song,et al.  Real-time image tracking for automatic traffic monitoring and enforcement applications , 2004, Image Vis. Comput..

[22]  Pong C. Yuen,et al.  Object motion detection using information theoretic spatio-temporal saliency , 2009, Pattern Recognit..

[23]  W. Eric L. Grimson,et al.  Learning Patterns of Activity Using Real-Time Tracking , 2000, IEEE Trans. Pattern Anal. Mach. Intell..