Vehicle detection from highway satellite images via transfer learning

Coming with the era of highway satellites, nowadays there is a massive amount of remote sensing images captured. Therefore, it is now feasible to detect vehicles directly from these satellite images, which has attracted extensive research attentions for both academic and industrial applications. However, it is not an easy task at all, mainly due to the difficulty to obtain training data to train vehicle detectors. On the contrary, there has been sufficient amount of labeled information regarding vehicle regions in the domain of aerial images. In this paper, we study the problem of detecting vehicles on highway satellite images, without the time-consuming step of collecting sufficient training data in this domain. Our key idea is to adopt a novel transfer learning technology that transfers vehicle detectors trained in the aerial image domain to the satellite image domain. In doing so, several cutting-edge vehicle detection algorithms can be directly applied. More specifically, our transfer learning scheme is based on a supervised super-resolution algorithm, which learns mutually correlative sparse coefficients between high and low resolution image patches. Then, a linear SVM based detector is trained, the loss function of which is integrated into the sparse coding operation above. Experimental results have shown that the proposed framework can achieve significant improvement over several alternative and state-of-the-art schemes, with high precision and low false alarms.

[1]  Xuelong Li,et al.  Visual Attention Accelerated Vehicle Detection in Low-Altitude Airborne Video of Urban Environment , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Hsu-Yung Cheng,et al.  Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks , 2012, IEEE Transactions on Image Processing.

[3]  Alexei A. Efros,et al.  Ensemble of exemplar-SVMs for object detection and beyond , 2011, 2011 International Conference on Computer Vision.

[4]  Matthieu Guillaumin,et al.  Segmentation Propagation in ImageNet , 2012, ECCV.

[5]  Curt H. Davis,et al.  Vehicle detection from high-resolution satellite imagery using morphological shared-weight neural networks , 2007, Image Vis. Comput..

[6]  Liujuan Cao,et al.  Localizing web videos using social images , 2015, Inf. Sci..

[7]  P. Gong,et al.  Object-based Detection and Classification of Vehicles from High-resolution Aerial Photography , 2009 .

[9]  Bernt Schiele,et al.  Transfer Learning in a Transductive Setting , 2013, NIPS.

[10]  Shiming Xiang,et al.  Vehicle Detection in Satellite Images by Parallel Deep Convolutional Neural Networks , 2013, 2013 2nd IAPR Asian Conference on Pattern Recognition.

[11]  Lang Hong,et al.  Energy-based video tracking using joint target density processing with an application to unmanned aerial vehicle surveillance , 2008 .

[12]  Stefan Hinz,et al.  Vehicle Detection in Aerial Images Using Generic Features, Grouping, and Context , 2001, DAGM-Symposium.

[13]  Duen-Ren Liu,et al.  Outlier detection from vehicle trajectories to discover roaming events , 2015, Inf. Sci..

[14]  Hong Qiao,et al.  Airborne moving vehicle detection for video surveillance of urban traffic , 2009, 2009 IEEE Intelligent Vehicles Symposium.

[15]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[16]  Jae-Young Choi,et al.  Vehicle Detection from Aerial Images Using Local Shape Information , 2009, PSIVT.

[17]  Wilfred Ng,et al.  A transfer learning based framework of crowd-selection on twitter , 2013, KDD.

[18]  Mais Nijim,et al.  Object identification and classification in a high resolution satellite data using data mining techniques for knowledge extraction , 2013, 2013 IEEE International Systems Conference (SysCon).

[19]  S. Hinz DETECTION OF VEHICLES AND VEHICLE QUEUES IN HIGH RESOLUTION AERIAL IMAGES , 2003 .

[20]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Line Eikvil,et al.  Classification-based vehicle detection in high-resolution satellite images , 2009 .

[22]  Martino Pesaresi,et al.  VEHICLES DETECTION FROM VERY HIGH RESOLUTION SATELLITE IMAGERY , 2005 .

[23]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[24]  Larry S. Davis,et al.  Vehicle Detection Using Partial Least Squares , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Li Li,et al.  A Morphological Neural Network Approach for Vehicle Detection from High Resolution Satellite Imagery , 2006, ICONIP.

[26]  Ralf Reulke,et al.  Fast Vehicle Detection and Tracking in Aerial Image Bursts , 2009 .

[27]  Ling Shao,et al.  A rapid learning algorithm for vehicle classification , 2015, Inf. Sci..

[28]  Uwe Stilla,et al.  Vehicle Detection in Very High Resolution Satellite Images of City Areas , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Simon Coupland,et al.  Fuzzy Transfer Learning: Methodology and application , 2015, Inf. Sci..

[30]  J. Leitloff,et al.  Automatic traffic monitoring based on aerial image sequences , 2008, Pattern Recognition and Image Analysis.