Robust Detection of Moving Vehicles in Wide Area Motion Imagery

Multiple object tracking in Wide Area Motion Imagery (WAMI) data is usually based on initial detections coming from background subtraction or frame differencing. However, these methods are prone to produce split and merged detections. Appearance based vehicle detection can be an alternative but is not well-suited for WAMI data since classifier models are of weak discriminative power for vehicles in top view at low resolution. We introduce a moving vehicle detection algorithm that combines 2-frame differencing with a vehicle appearance model to improve object detection. Our main contributions are (1) integration of robust vehicle detection with split/merge handling and (2) estimation of assignment likelihoods between object hypotheses in consecutive frames using an appearance based similarity measure. Without using any prior knowledge, we achieve state-of-the-art detection rates and produce tracklets that considerably simplify the data association problem for multiple object tracking.

[1]  Pietro Perona,et al.  Integral Channel Features , 2009, BMVC.

[2]  Mubarak Shah,et al.  Multiframe Many–Many Point Correspondence for Vehicle Tracking in High Density Wide Area Aerial Videos , 2013, International Journal of Computer Vision.

[3]  Erik Blasch,et al.  Context-driven moving vehicle detection in wide area motion imagery , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[4]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[5]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[6]  Gérard G. Medioni,et al.  Persistent Tracking for Wide Area Aerial Surveillance , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Toby P. Breckon,et al.  Real-time people and vehicle detection from UAV imagery , 2011, Electronic Imaging.

[8]  Wilhelm Burger,et al.  Digital Image Processing - An Algorithmic Introduction using Java , 2008, Texts in Computer Science.

[9]  Michael Teutsch,et al.  Robust and fast detection of moving vehicles in aerial videos using sliding windows , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[10]  A. G. Amitha Perera,et al.  Multi-Object Tracking Through Simultaneous Long Occlusions and Split-Merge Conditions , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[11]  Mubarak Shah,et al.  Motion and Appearance Contexts for Tracking and Re-Acquiring Targets in Aerial Videos , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Genshe Chen,et al.  Multiway histogram intersection for multi-target tracking , 2015, 2015 18th International Conference on Information Fusion (Fusion).

[13]  Wolfgang Krüger,et al.  Extended image differencing for change detection in UAV video mosaics , 2014, Electronic Imaging.

[14]  Anthony Hoogs,et al.  Real-time multi-target tracking at 210 megapixels/second in Wide Area Motion Imagery , 2014, IEEE Winter Conference on Applications of Computer Vision.

[15]  Andrew Zisserman,et al.  Three things everyone should know to improve object retrieval , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[17]  Genshe Chen,et al.  Vehicle detection in wide area aerial surveillance using Temporal Context , 2013, Proceedings of the 16th International Conference on Information Fusion.

[18]  Luc Van Gool,et al.  Pedestrian detection at 100 frames per second , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Rainer Stiefelhagen,et al.  Local appearance based face recognition using discrete cosine transform , 2005, 2005 13th European Signal Processing Conference.

[20]  Harpreet S. Sawhney,et al.  Vehicle detection and tracking in wide field-of-view aerial video , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[21]  Frank Y. Shih,et al.  Image Processing and Pattern Recognition: Fundamentals and Techniques , 2010 .

[22]  Matthew E. Antone,et al.  Detecting and tracking all moving objects in wide-area aerial video , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[23]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Mohan M. Trivedi,et al.  Looking at Vehicles on the Road: A Survey of Vision-Based Vehicle Detection, Tracking, and Behavior Analysis , 2013, IEEE Transactions on Intelligent Transportation Systems.

[25]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[26]  M. Keck,et al.  Real-time tracking of low-resolution vehicles for wide-area persistent surveillance , 2013, 2013 IEEE Workshop on Applications of Computer Vision (WACV).

[27]  Li Bai,et al.  Multiple Kernel Learning for vehicle detection in wide area motion imagery , 2012, 2012 15th International Conference on Information Fusion.

[28]  Larry S. Davis,et al.  Vehicle Detection Using Partial Least Squares , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Guna Seetharaman,et al.  Persistent target tracking using likelihood fusion in wide-area and full motion video sequences , 2012, 2012 15th International Conference on Information Fusion.

[30]  Haroon Idrees,et al.  Detection and Tracking of Large Number of Targets in Wide Area Surveillance , 2010, ECCV.

[31]  Gerard Medioni,et al.  Motion propagation detection association for multi-target tracking in wide area aerial surveillance , 2015, 2015 12th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[32]  Michael Teutsch,et al.  Evaluation of object segmentation to improve moving vehicle detection in aerial videos , 2014, 2014 11th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[33]  Michael Grinberg,et al.  Feature-Based Probabilistic Data Association (FBPDA) for visual multi-target detection and tracking under occlusions and split and merge effects , 2009, 2009 12th International IEEE Conference on Intelligent Transportation Systems.

[34]  Uwe Stilla,et al.  Airborne Vehicle Detection in Dense Urban Areas Using HoG Features and Disparity Maps , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[35]  Xuelong Li,et al.  Vehicle Detection and Motion Analysis in Low-Altitude Airborne Video Under Urban Environment , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[36]  Matti Pietikäinen,et al.  Face Description with Local Binary Patterns: Application to Face Recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).