Tracking-based moving object detection

We present a novel approach for multi-object detection in aerial videos based on tracking. The proposed method mainly involves four steps. Firstly, both the motion history image and the tracking trajectory are employed to extract candidate target regions. Secondly, the spatial-temporal saliency is used to detect moving objects in the candidate regions. Thirdly, the previous detected objects are tracked by mean shift in the current frame. And finally, the detection results are fused with the tracking results to get refined detection results, in turn the modified detection results are used to update the tracking models. The proposed algorithm is evaluated on VIVID aerial videos, and the results show that our approach can reliably detect moving objects even in challenging situations. Meanwhile, the proposed method can process videos in real time, without the effect of time delay.

[1]  Mubarak Shah,et al.  Geometric Constraints for Human Detection in Aerial Imagery , 2010, ECCV.

[2]  Marcel Worring,et al.  Backtracking: Retrospective multi-target tracking , 2012, Comput. Vis. Image Underst..

[3]  Shi-Min Hu,et al.  Global contrast based salient region detection , 2011, CVPR 2011.

[4]  Álvaro García-Martín,et al.  On collaborative people detection and tracking in complex scenarios , 2012, Image Vis. Comput..

[5]  Josiane Zerubia,et al.  Detection of Object Motion Regions in Aerial Image Pairs With a Multilayer Markovian Model , 2009, IEEE Transactions on Image Processing.

[6]  Hui Cheng,et al.  Segmentation of Aerial Surveillance Video Using a Mixture of Experts , 2005, Digital Image Computing: Techniques and Applications (DICTA'05).

[7]  Mubarak Shah,et al.  Visual attention detection in video sequences using spatiotemporal cues , 2006, MM '06.

[8]  Mubarak Shah,et al.  Motion and Appearance Contexts for Tracking and Re-Acquiring Targets in Aerial Videos , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Yuan Li,et al.  Tracking in Low Frame Rate Video: A Cascade Particle Filter with Discriminative Observers of Different Lifespans , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Yanxi Liu,et al.  Online Selection of Discriminative Tracking Features , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Jens Leitloff,et al.  REAL-TIME IMAGE PROCESSING FOR ROAD TRAFFIC DATA EXTRACTION FROM AERIAL IMAGES , 2010 .

[12]  Zdenek Kalal,et al.  Tracking-Learning-Detection , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Robert T. Collins,et al.  Moving Object Localization in Thermal Imagery by Forward-backward MHI , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[14]  Gérard G. Medioni,et al.  Multiple-Target Tracking by Spatiotemporal Monte Carlo Markov Chain Data Association , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.