Detection and Identification of Vehicles from High-Resolution Aerial Images Using Deep Learning Approaches with the Tuned Parameters

Unmanned aerial vehicles have been utilized in various applications for the management of the civil and defense infrastructure. These applications include the surveillance of the crowd, transport, and disaster management and the inspection of the building architecture. This excessive use of the unmanned aerial vehicles also demands the devices and the deployed system that devices are fully autonomous, efficient, and accurate. Classification of vehicle type is the major component of intelligent transportation system. Traditional approaches like (Bayesian prior models, scale-invariant feature transform, speeded-up robust features, and support vector machine) image processing and machine learning are used by many researchers to automate the transportation system. However, they failed to provide the promising results because of limited viewpoints and lack of dataset. With the advancement in technology, deep learning has inspired us all with its autonomous feature extraction and accuracy. In this chapter we present a deep learning-based approach which involves two phases: region proposal network and classification network; both networks use the features from convolution neural network (CNN). Proposed system first detects the vehicle and then classifies its brand type accurately on self-generated dataset with the help of UAVs. Proposed system classifies the vehicles with the average accuracy of 96.2% on six types of vehicles.

[1]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Yunde Jia,et al.  Vehicle Type Classification Using a Semisupervised Convolutional Neural Network , 2015, IEEE Transactions on Intelligent Transportation Systems.

[3]  Wen-Chung Chang,et al.  Online Boosting for Vehicle Detection , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[4]  Chunfang Liu,et al.  Vehicle Detection and Classification Using Convolutional Neural Networks , 2018, 2018 IEEE 7th Data Driven Control and Learning Systems Conference (DDCLS).

[5]  Zezhi Chen,et al.  Vehicle detection, tracking and classification in urban traffic , 2012, 2012 15th International IEEE Conference on Intelligent Transportation Systems.

[6]  Ting Liu,et al.  Recent advances in convolutional neural networks , 2015, Pattern Recognit..

[7]  Yingfeng Cai,et al.  A Vehicle Detection Algorithm Based on Deep Belief Network , 2014, TheScientificWorldJournal.

[8]  Asadollah Shahbahrami,et al.  Vehicle counting method based on digital image processing algorithms , 2015, 2015 2nd International Conference on Pattern Recognition and Image Analysis (IPRIA).

[9]  Xiang Zhang,et al.  OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks , 2013, ICLR.

[10]  Qiaosong Wang,et al.  Object Recognition in Aerial Images Using Convolutional Neural Networks , 2017, J. Imaging.

[11]  Gunter Kompa,et al.  Applications using a low-cost baseband pulsed microwave radar sensor , 2001, IMTC 2001. Proceedings of the 18th IEEE Instrumentation and Measurement Technology Conference. Rediscovering Measurement in the Age of Informatics (Cat. No.01CH 37188).

[12]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[13]  Jinhui Lan,et al.  Vehicle detection and classification by measuring and processing magnetic signal , 2011 .

[14]  Shilei Sun,et al.  Vehicle detection from high-resolution aerial images using spatial pyramid pooling-based deep convolutional neural networks , 2016, Multimedia Tools and Applications.

[15]  Xiao Xu,et al.  Deep classification of vehicle makers and models: The effectiveness of pre-training and data enhancement , 2015, 2015 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[16]  Richard Szeliski,et al.  Car make and model recognition using 3D curve alignment , 2014, IEEE Winter Conference on Applications of Computer Vision.

[17]  Ling Shao,et al.  A rapid learning algorithm for vehicle classification , 2015, Inf. Sci..

[18]  Luis Salgado,et al.  Robust Vehicle Detection Through Multidimensional Classification for on Board Video Based Systems , 2007, 2007 IEEE International Conference on Image Processing.

[19]  Jian Sun,et al.  Single image haze removal using dark channel prior , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Chen Zhang,et al.  Vehicle detection and classification based on convolutional neural network , 2015, ICIMCS '15.

[21]  Luis Salgado,et al.  A Study of Feature Combination for Vehicle Detection Based on Image Processing , 2014, TheScientificWorldJournal.

[22]  Anila Cyril,et al.  EXPLORING SOUND SIGNATURE FOR VEHICLE DETECTION AND CLASSIFICATION USING ANN , 2013 .

[23]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Pradeep Kumar Mishra,et al.  Multiple Kernel Based KNN Classifiers for Vehicle Classification , 2013 .

[25]  M. Saquib Sarfraz,et al.  Bayesian prior models for vehicle make and model recognition , 2009, FIT.

[26]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[27]  Shahid Mumtaz,et al.  Deep Unified Model For Face Recognition Based on Convolution Neural Network and Edge Computing , 2019, IEEE Access.

[28]  Toshiyuki Nakamiya,et al.  Robust Vehicle Detection under Various Environments to Realize Road Traffic Flow Surveillance Using an Infrared Thermal Camera , 2015, TheScientificWorldJournal.

[29]  Fadi Al-Turjman,et al.  Cognitive routing protocol for disaster-inspired Internet of Things , 2017, Future Gener. Comput. Syst..

[30]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[31]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  Hamid Reza Pourreza,et al.  Vehicle Recognition Based on Fourier, Wavelet and Curvelet Transforms - a Comparative Study , 2007, Fourth International Conference on Information Technology (ITNG'07).

[33]  Fan Yang,et al.  Vehicle classification in WAMI imagery using deep network , 2016, SPIE Defense + Security.

[34]  Naif Alajlan,et al.  Deep Learning Approach for Car Detection in UAV Imagery , 2017, Remote. Sens..

[35]  Fadi Al-Turjman QoS - aware data delivery framework for safety-inspired multimedia in integrated vehicular-IoT , 2018, Comput. Commun..

[36]  Inbum Jung,et al.  Analysis of Vehicle Detection with WSN-Based Ultrasonic Sensors , 2014, Sensors.

[37]  Yi Li,et al.  R-FCN: Object Detection via Region-based Fully Convolutional Networks , 2016, NIPS.