Object detection in remote sensing imagery using a discriminatively trained mixture model

Abstract Automatically detecting objects with complex appearance and arbitrary orientations in remote sensing imagery (RSI) is a big challenge. To explore a possible solution to the problem, this paper develops an object detection framework using a discriminatively trained mixture model. It is mainly composed of two stages: model training and object detection. In the model training stage, multi-scale histogram of oriented gradients (HOG) feature pyramids of all training samples are constructed. A mixture of multi-scale deformable part-based models is then trained for each object category by training a latent Support Vector Machine (SVM), where each part-based model is composed of a coarse root filter, a set of higher resolution part filters, and a set of deformation models. In the object detection stage, given a test imagery, its multi-scale HOG feature pyramid is firstly constructed. Then, object detection is performed by computing and thresholding the response of the mixture model. The quantitative comparisons with state-of-the-art approaches on two datasets demonstrate the effectiveness of the developed framework.

[1]  Hermann Kaufmann,et al.  Detection of small objects from high-resolution panchromatic satellite imagery based on supervised image segmentation , 2001, IEEE Trans. Geosci. Remote. Sens..

[2]  Mei-Chen Yeh,et al.  Fast Human Detection Using a Cascade of Histograms of Oriented Gradients , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[3]  Laurent Najman,et al.  A complete processing chain for ship detection using optical satellite imagery , 2010 .

[4]  Deren Li,et al.  Object Classification of Aerial Images With Bag-of-Visual Words , 2010, IEEE Geoscience and Remote Sensing Letters.

[5]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[6]  Konstantinos Karantzalos,et al.  Object-based image analysis through nonlinear scale-space filtering , 2011 .

[7]  Peijun Li,et al.  Urban building damage detection from very high resolution imagery using OCSVM and spatial features , 2010 .

[8]  Brian Johnson,et al.  Object-based target search using remotely sensed data: A case study in detecting invasive exotic Australian Pine in south Florida , 2008 .

[9]  Shuicheng Yan,et al.  An HOG-LBP human detector with partial occlusion handling , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[10]  Arzu Erener,et al.  Unsupervised building detection in complex urban environments from multispectral satellite imagery , 2012 .

[11]  Cem Ünsalan,et al.  Urban-Area and Building Detection Using SIFT Keypoints and Graph Theory , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Thomas Blaschke,et al.  Object based image analysis for remote sensing , 2010 .

[13]  Jan-Peter Muller,et al.  Tree and building detection in dense urban environments using automated processing of IKONOS image and LiDAR data , 2011 .

[14]  Junwei Han,et al.  Automatic landslide detection from remote-sensing imagery using a scene classification method based on BoVW and pLSA , 2013 .

[15]  X. Tong,et al.  Building-damage detection using pre- and post-seismic high-resolution satellite stereo imagery: A case study of the May 2008 Wenchuan earthquake , 2012 .

[16]  Xiaofeng Li,et al.  Straight road edge detection from high-resolution remote sensing images based on the ridgelet transform with the revised parallel-beam Radon transform , 2010 .

[17]  Fredric C. Gey,et al.  The relationship between recall and precision , 1994 .

[18]  Line Eikvil,et al.  Classification-based vehicle detection in high-resolution satellite images , 2009 .

[19]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[20]  David A. Landgrebe,et al.  Signal Theory Methods in Multispectral Remote Sensing , 2003 .

[21]  Volker Walter,et al.  Object-based classification of remote sensing data for change detection , 2004 .

[22]  Daniel P. Huttenlocher,et al.  Distance Transforms of Sampled Functions , 2012, Theory Comput..

[23]  Nikos Koutsias,et al.  Object-based classification using Quickbird imagery for delineating forest vegetation polygons in a Mediterranean test site , 2008 .

[24]  Daphna Weinshall,et al.  Object class recognition by boosting a part-based model , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[25]  Yu Li,et al.  Automatic Target Detection in High-Resolution Remote Sensing Images Using Spatial Sparse Coding Bag-of-Words Model , 2012, IEEE Geoscience and Remote Sensing Letters.

[26]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[27]  Xin Yang,et al.  Man‐made object detection in aerial images using multi‐stage level set evolution , 2007 .

[28]  Horst Bischof,et al.  On-line boosting-based car detection from aerial images , 2008 .

[29]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Hong Huo,et al.  Rotation-Invariant Object Detection of Remotely Sensed Images Based on Texton Forest and Hough Voting , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[31]  Yihua Tan,et al.  Airport Detection From Large IKONOS Images Using Clustered SIFT Keypoints and Region Information , 2011, IEEE Geoscience and Remote Sensing Letters.

[32]  Johannes R. Sveinsson,et al.  Classification of hyperspectral data from urban areas based on extended morphological profiles , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[33]  David A. McAllester,et al.  A discriminatively trained, multiscale, deformable part model , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[34]  Carlos López-Martínez,et al.  A novel algorithm for ship detection in SAR imagery based on the wavelet transform , 2005, IEEE Geoscience and Remote Sensing Letters.

[35]  Nicolas Paparoditis,et al.  A geometric stochastic approach based on marked point processes for road mark detection from high resolution aerial images , 2009 .

[36]  Laurent Durieux,et al.  A method for monitoring building construction in urban sprawl areas using object-based analysis of Spot 5 images and existing GIS data , 2008 .

[37]  Liangpei Zhang,et al.  An SVM Ensemble Approach Combining Spectral, Structural, and Semantic Features for the Classification of High-Resolution Remotely Sensed Imagery , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[38]  Andrew Zisserman,et al.  Efficient discriminative learning of parts-based models , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[39]  B. S. Manjunath,et al.  Modeling and Detection of Geospatial Objects Using Texture Motifs , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[40]  Jordi Inglada,et al.  Automatic recognition of man-made objects in high resolution optical remote sensing images by SVM classification of geometric image features , 2007 .

[41]  Daniel P. Huttenlocher,et al.  Pictorial Structures for Object Recognition , 2004, International Journal of Computer Vision.

[42]  Daniel P. Huttenlocher,et al.  Weakly Supervised Learning of Part-Based Spatial Models for Visual Object Recognition , 2006, ECCV.

[43]  Thomas Hofmann,et al.  Support Vector Machines for Multiple-Instance Learning , 2002, NIPS.