A Hybrid Vehicle Detection Method Based on Viola-Jones and HOG + SVM from UAV Images

A new hybrid vehicle detection scheme which integrates the Viola-Jones (V-J) and linear SVM classifier with HOG feature (HOG + SVM) methods is proposed for vehicle detection from low-altitude unmanned aerial vehicle (UAV) images. As both V-J and HOG + SVM are sensitive to on-road vehicles’ in-plane rotation, the proposed scheme first adopts a roadway orientation adjustment method, which rotates each UAV image to align the roads with the horizontal direction so the original V-J or HOG + SVM method can be directly applied to achieve fast detection and high accuracy. To address the issue of descending detection speed for V-J and HOG + SVM, the proposed scheme further develops an adaptive switching strategy which sophistically integrates V-J and HOG + SVM methods based on their different descending trends of detection speed to improve detection efficiency. A comprehensive evaluation shows that the switching strategy, combined with the road orientation adjustment method, can significantly improve the efficiency and effectiveness of the vehicle detection from UAV images. The results also show that the proposed vehicle detection method is competitive compared with other existing vehicle detection methods. Furthermore, since the proposed vehicle detection method can be performed on videos captured from moving UAV platforms without the need of image registration or additional road database, it has great potentials of field applications. Future research will be focusing on expanding the current method for detecting other transportation modes such as buses, trucks, motors, bicycles, and pedestrians.

[1]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Xinkai Wu,et al.  Vehicle Detection and Tracking from Airborne Images , 2015 .

[3]  Dana H. Ballard,et al.  Generalizing the Hough transform to detect arbitrary shapes , 1981, Pattern Recognit..

[4]  Xinkai Wu,et al.  Pedestrian Detection and Tracking from Low-Resolution Unmanned Aerial Vehicle Thermal Imagery , 2016, Sensors.

[5]  Martial Hebert,et al.  A Flow-Based Approach to Vehicle Detection and Background Mosaicking in Airborne Video , 2005, CVPR.

[6]  Allen R. Hanson,et al.  Extracting Straight Lines , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Paul A. Viola,et al.  Fast Multi-view Face Detection , 2003 .

[8]  Mark R. McCord,et al.  Roadway traffic monitoring from an unmanned aerial vehicle , 2006 .

[9]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Mark D. Hickman,et al.  Methods of analyzing traffic imagery collected from aerial platforms , 2003, IEEE Trans. Intell. Transp. Syst..

[11]  Farid Melgani,et al.  Detecting Cars in UAV Images With a Catalog-Based Approach , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[13]  Latha Venkataraman Viewpoint: Benzene provides the missing link in molecular junctions , 2008 .

[14]  David Carr,et al.  Autonomous Chemical Vapour Detection by Micro UAV , 2015, Remote. Sens..

[15]  H Lieu,et al.  TRAFFIC-FLOW THEORY , 1999 .

[16]  Marc Van Droogenbroeck,et al.  ViBe: A Universal Background Subtraction Algorithm for Video Sequences , 2011, IEEE Transactions on Image Processing.

[17]  Xuelong Li,et al.  Linear SVM classification using boosting HOG features for vehicle detection in low-altitude airborne videos , 2011, 2011 18th IEEE International Conference on Image Processing.

[18]  Moshe Ben-Akiva,et al.  Automatic Vehicle Trajectory Extraction by Aerial Remote Sensing , 2014 .

[19]  Gellért Máttyus,et al.  Fast Multiclass Vehicle Detection on Aerial Images , 2015, IEEE Geoscience and Remote Sensing Letters.

[20]  Shiming Xiang,et al.  Vehicle Detection in Satellite Images by Hybrid Deep Convolutional Neural Networks , 2014, IEEE Geoscience and Remote Sensing Letters.

[21]  Pietro Perona,et al.  Integral Channel Features , 2009, BMVC.

[22]  Filiberto Chiabrando,et al.  UAV Deployment Exercise for Mapping Purposes: Evaluation of Emergency Response Applications , 2015, Sensors.

[23]  Uwe Stilla,et al.  Airborne Vehicle Detection in Dense Urban Areas Using HoG Features and Disparity Maps , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[24]  Xuelong Li,et al.  Vehicle Detection and Motion Analysis in Low-Altitude Airborne Video Under Urban Environment , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[25]  J. Friedman Special Invited Paper-Additive logistic regression: A statistical view of boosting , 2000 .

[26]  Richard Szeliski,et al.  Eliminating ghosting and exposure artifacts in image mosaics , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[27]  Hai Tao,et al.  Object Tracking with Bayesian Estimation of Dynamic Layer Representations , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Rachid Deriche,et al.  The Depth and Motion Analysis Machine , 1992, Int. J. Pattern Recognit. Artif. Intell..

[29]  Rafael Grompone von Gioi,et al.  LSD: A Fast Line Segment Detector with a False Detection Control , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Peter Reinartz,et al.  An Operational System for Estimating Road Traffic Information from Aerial Images , 2014, Remote. Sens..

[31]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Robert A. Schowengerdt,et al.  Airborne video registration and traffic-flow parameter estimation , 2005, IEEE Transactions on Intelligent Transportation Systems.

[33]  Xinkai Wu,et al.  Measuring Algorithm for the Distance to a Preceding Vehicle on Curve Road Using On-Board Monocular Camera , 2015, Int. J. Bifurc. Chaos.

[34]  Paola Mello,et al.  Image analysis and rule-based reasoning for a traffic monitoring system , 2000, IEEE Trans. Intell. Transp. Syst..

[35]  Sandra Johnson,et al.  Unmanned Aerial Vehicles (UAVs) and Artificial Intelligence Revolutionizing Wildlife Monitoring and Conservation , 2016, Sensors.

[36]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[37]  Rafael Grompone von Gioi,et al.  LSD: a Line Segment Detector , 2012, Image Process. Line.

[38]  A. Agrawal,et al.  Automated extraction of queue lengths from airborne imagery , 2004, Proceedings. The 7th International IEEE Conference on Intelligent Transportation Systems (IEEE Cat. No.04TH8749).

[39]  Farid Melgani,et al.  Automatic Car Counting Method for Unmanned Aerial Vehicle Images , 2014, IEEE Transactions on Geoscience and Remote Sensing.