Towards Domain Adaptive Vehicle Detection in Satellite Image by Supervised Super-Resolution Transfer

Vehicle detection in satellite image has attracted extensive research attentions with various emerging applications. However, the detector performance has been significantly degenerated due to the low resolutions of satellite images, as well as the limited training data. In this paper, a robust domain-adaptive vehicle detection framework is proposed to bypass both problems. Our innovation is to transfer the detector learning to the high-resolution aerial image domain, where rich supervision exists and robust detectors can be trained. To this end, we first propose a super-resolution algorithm using coupled dictionary learning to "augment" the satellite image region being tested into the aerial domain. Notably, linear detection loss is embedded into the dictionary learning, which enforces the augmented region to be sensitive to the subsequent detector training. Second, to cope with the domain changes, we propose an instance-wised detection using Exemplar Support Vector Machines (E-SVMs), which well handles the intra-class and imaging variations like scales, rotations, and occlusions. With comprehensive experiments on large-scale satellite image collections, we demonstrate that the proposed framework can significantly boost the detection accuracy over several state-of-the-arts.

[1]  Hsu-Yung Cheng,et al.  Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks , 2012, IEEE Transactions on Image Processing.

[2]  Kwang In Kim,et al.  Single-Image Super-Resolution Using Sparse Regression and Natural Image Prior , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Jae-Young Choi,et al.  Vehicle Detection from Aerial Images Using Local Shape Information , 2009, PSIVT.

[4]  Li Li,et al.  A Morphological Neural Network Approach for Vehicle Detection from High Resolution Satellite Imagery , 2006, ICONIP.

[5]  Wilfred Ng,et al.  A transfer learning based framework of crowd-selection on twitter , 2013, KDD.

[6]  William T. Freeman,et al.  Example-Based Super-Resolution , 2002, IEEE Computer Graphics and Applications.

[7]  Mais Nijim,et al.  Object identification and classification in a high resolution satellite data using data mining techniques for knowledge extraction , 2013, 2013 IEEE International Systems Conference (SysCon).

[8]  Thomas Hofmann,et al.  Large Margin Methods for Structured and Interdependent Output Variables , 2005, J. Mach. Learn. Res..

[9]  Shiming Xiang,et al.  Vehicle Detection in Satellite Images by Hybrid Deep Convolutional Neural Networks , 2014, IEEE Geoscience and Remote Sensing Letters.

[10]  Alexei A. Efros,et al.  Data-driven visual similarity for cross-domain image matching , 2011, ACM Trans. Graph..

[11]  Curt H. Davis,et al.  Vehicle detection from high-resolution satellite imagery using morphological shared-weight neural networks , 2007, Image Vis. Comput..

[12]  Rongrong Ji,et al.  Label Propagation from ImageNet to 3D Point Clouds , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[14]  S. Hinz DETECTION OF VEHICLES AND VEHICLE QUEUES IN HIGH RESOLUTION AERIAL IMAGES , 2003 .

[15]  J. Leitloff,et al.  Automatic traffic monitoring based on aerial image sequences , 2008, Pattern Recognition and Image Analysis.

[16]  Ralf Reulke,et al.  Fast Vehicle Detection and Tracking in Aerial Image Bursts , 2009 .

[17]  Thorsten Joachims,et al.  Optimizing search engines using clickthrough data , 2002, KDD.

[18]  Thomas S. Huang,et al.  Image super-resolution as sparse representation of raw image patches , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Hong Qiao,et al.  Airborne moving vehicle detection for video surveillance of urban traffic , 2009, 2009 IEEE Intelligent Vehicles Symposium.

[20]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[21]  Alexei A. Efros,et al.  Ensemble of exemplar-SVMs for object detection and beyond , 2011, 2011 International Conference on Computer Vision.

[22]  P. Gong,et al.  Object-based Detection and Classification of Vehicles from High-resolution Aerial Photography , 2009 .

[23]  Bernt Schiele,et al.  Transfer Learning in a Transductive Setting , 2013, NIPS.

[24]  Line Eikvil,et al.  Classification-based vehicle detection in high-resolution satellite images , 2009 .

[25]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[26]  Shiming Xiang,et al.  Vehicle Detection in Satellite Images by Parallel Deep Convolutional Neural Networks , 2013, 2013 2nd IAPR Asian Conference on Pattern Recognition.

[27]  Matthieu Guillaumin,et al.  Segmentation Propagation in ImageNet , 2012, ECCV.

[28]  Stefan Hinz,et al.  Vehicle Detection in Aerial Images Using Generic Features, Grouping, and Context , 2001, DAGM-Symposium.

[29]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Martino Pesaresi,et al.  VEHICLES DETECTION FROM VERY HIGH RESOLUTION SATELLITE IMAGERY , 2005 .

[31]  Larry S. Davis,et al.  Vehicle Detection Using Partial Least Squares , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Sven J. Dickinson,et al.  TurboPixels: Fast Superpixels Using Geometric Flows , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[34]  Uwe Stilla,et al.  Vehicle Detection in Very High Resolution Satellite Images of City Areas , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[35]  Takeo Kanade,et al.  Limits on super-resolution and how to break them , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).