Vehicle Detection in High-Resolution Aerial Images Based on Fast Sparse Representation Classification and Multiorder Feature

This paper presents an algorithm for vehicle detection in high-resolution aerial images through a fast sparse representation classification method and a multiorder feature descriptor that contains information of texture, color, and high-order context. To speed up computation of sparse representation, a set of small dictionaries, instead of a large dictionary containing all training items, is used for classification. To extract the context information of a patch, we proposed a high-order context information extraction method based on the proposed fast sparse representation classification method. To effectively extract the color information, the RGB color space is transformed into color name space. Then, the color name information is embedded into the grids of histogram of oriented gradient feature to represent the low-order feature of vehicles. By combining low- and high-order features together, a multiorder feature is used to describe vehicles. We also proposed a sample selection strategy based on our fast sparse representation classification method to construct a complete training subset. Finally, a set of dictionaries, which are trained by the multiorder features of the selected training subset, is used to detect vehicles based on superpixel segmentation results of aerial images. Experimental results illustrate the satisfactory performance of our algorithm.

[1]  Azriel Rosenfeld,et al.  Optimal edge-based shape detection , 2002, IEEE Trans. Image Process..

[2]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[3]  Shiming Xiang,et al.  Vehicle Detection in Satellite Images by Hybrid Deep Convolutional Neural Networks , 2014, IEEE Geoscience and Remote Sensing Letters.

[4]  Antonio Torralba,et al.  Contextual Models for Object Detection Using Boosted Random Fields , 2004, NIPS.

[5]  Ming-Hsuan Yang,et al.  Top-down visual saliency via joint CRF and dictionary learning , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Rong Du,et al.  Effective Urban Traffic Monitoring by Vehicular Sensor Networks , 2015, IEEE Transactions on Vehicular Technology.

[7]  Somprakash Bandyopadhyay,et al.  Road traffic congestion monitoring and measurement using active RFID and GSM technology , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[8]  Naoto Yokoya,et al.  Object Detection Based on Sparse Representation and Hough Voting for Optical Remote Sensing Imagery , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[9]  Matti Pietikäinen,et al.  Face Description with Local Binary Patterns: Application to Face Recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Wen Liu,et al.  Automated Vehicle Extraction and Speed Determination From QuickBird Satellite Images , 2011, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[11]  Jing Xiao,et al.  Detection Evolution with Multi-order Contextual Co-occurrence , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[13]  Daphne Koller,et al.  Learning Spatial Context: Using Stuff to Find Things , 2008, ECCV.

[14]  Hao Zhang,et al.  Expression-insensitive 3D face recognition using sparse representation , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Yihong Gong,et al.  Linear spatial pyramid matching using sparse coding for image classification , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .

[17]  Farid Melgani,et al.  A SIFT-SVM method for detecting cars in UAV images , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[18]  Liujuan Cao,et al.  Oil spill detection based on a superpixel segmentation method for SAR image , 2014, 2014 IEEE Geoscience and Remote Sensing Symposium.

[19]  Joel A. Tropp,et al.  Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit , 2007, IEEE Transactions on Information Theory.

[20]  Huimin Yu,et al.  Shape Sparse Representation for Joint Object Classification and Segmentation , 2013, IEEE Transactions on Image Processing.

[21]  Hsu-Yung Cheng,et al.  Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks , 2012, IEEE Transactions on Image Processing.

[22]  Olivier Jamet,et al.  Vehicle detection on aerial images: a structural approach , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[23]  Katsushi Ikeuchi,et al.  Traffic monitoring and accident detection at intersections , 2000, IEEE Trans. Intell. Transp. Syst..

[24]  Ming Cheng,et al.  Sparse Representation Based Pansharpening Using Trained Dictionary , 2014, IEEE Geoscience and Remote Sensing Letters.

[25]  Christine Guillemot,et al.  Image Compression Using Sparse Representations and the Iteration-Tuned and Aligned Dictionary , 2011, IEEE Journal of Selected Topics in Signal Processing.

[26]  Liujuan Cao,et al.  Vehicle Detection in High-Resolution Aerial Images via Sparse Representation and Superpixels , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Thomas S. Huang,et al.  Image super-resolution as sparse representation of raw image patches , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[28]  Xiaoting Wang,et al.  Vehicle detection based on morphology from highway aerial images , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[29]  Peng Li,et al.  3-D Point Cloud Object Detection Based on Supervoxel Neighborhood With Hough Forest Framework , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[30]  Xuelong Li,et al.  Linear SVM classification using boosting HOG features for vehicle detection in low-altitude airborne videos , 2011, 2011 18th IEEE International Conference on Image Processing.

[31]  Horst Bischof,et al.  On-line boosting-based car detection from aerial images , 2008 .

[32]  Curt H. Davis,et al.  Vehicle detection from high-resolution satellite imagery using morphological shared-weight neural networks , 2007, Image Vis. Comput..

[33]  Peng Li,et al.  Object Detection in Terrestrial Laser Scanning Point Clouds Based on Hough Forest , 2014, IEEE Geoscience and Remote Sensing Letters.

[34]  Farid Melgani,et al.  Detecting Cars in UAV Images With a Catalog-Based Approach , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[35]  D. Donoho For most large underdetermined systems of linear equations the minimal 𝓁1‐norm solution is also the sparsest solution , 2006 .

[36]  Farid Melgani,et al.  Automatic Car Counting Method for Unmanned Aerial Vehicle Images , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[37]  Uwe Stilla,et al.  Vehicle Detection in Very High Resolution Satellite Images of City Areas , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[38]  S. Hinz,et al.  Detection and counting of cars in aerial images , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[39]  Cordelia Schmid,et al.  Learning Color Names for Real-World Applications , 2009, IEEE Transactions on Image Processing.

[40]  Stefan Hinz,et al.  Vehicle Detection in Aerial Images Using Generic Features, Grouping, and Context , 2001, DAGM-Symposium.

[41]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[42]  Hui Cheng,et al.  3D model based vehicle classification in aerial imagery , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[43]  Haiyan Guan,et al.  Rotation-Invariant Object Detection in High-Resolution Satellite Imagery Using Superpixel-Based Deep Hough Forests , 2015, IEEE Geoscience and Remote Sensing Letters.

[44]  Harpreet S. Sawhney,et al.  Vehicle detection and tracking in wide field-of-view aerial video , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[45]  Jae-Young Choi,et al.  Vehicle Detection from Aerial Images Using Local Shape Information , 2009, PSIVT.

[46]  Kunfeng Wang,et al.  Video processing techniques for traffic flow monitoring: A survey , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[47]  Marie Lachaise,et al.  Traffic monitoring with serial images from airborne cameras , 2006 .

[48]  Larry S. Davis,et al.  Vehicle Detection Using Partial Least Squares , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[49]  Jie Liu,et al.  Car detection from high-resolution aerial imagery using multiple features , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[50]  Yong Wang,et al.  A Novel Vehicle Detection Method With High Resolution Highway Aerial Image , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.