Multi-feature probability topic scene classifier for high spatial resolution remote sensing imagery

Scene classification can obtain the high-level semantic information in high spatial resolution (HSR) imagery. Probability topic model as a typical scene semantic representation has been successfully applied to nature scene by utilizing a single feature. However, it is not completely fit for HSR images due to the complexity of land cover classes. To solve the problem, multi-feature probability topic scene classifier based on Latent Dirichlet allocation (LDA), namely MFPTSC, is proposed for HSR imagery. In MFPTSC, the spectral, texture, and SIFT features as three representative features are firstly integrated. If the traditional multi-features fusion method (VIS-LDA) is used, which each feature vector is usually stacked at the visual word level, abundant information is lost, which leads to an undesirable classification performance. In this paper, a novel feature fusion strategy at the semantic allocation level, named SAL-LDA, is proposed to avoid information loss to a large extent by mining the latent semantics in accordance with the distinctive characteristics of each feature. Experiment results using the image dataset of 21 land-use classes demonstrate that the multi-feature fusion strategies of VIS-LDA and SAL-LDA both improve the classification accuracy, but the proposed SAL-LDA strategy is better than VIS-LDA.

[1]  Dewen Hu,et al.  Scene classification using a multi-resolution bag-of-features model , 2013, Pattern Recognit..

[2]  Hanna M. Wallach,et al.  Topic modeling: beyond bag-of-words , 2006, ICML.

[3]  Mihai Datcu,et al.  Latent Dirichlet Allocation for Spatial Analysis of Satellite Images , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Thomas Blaschke,et al.  Object based image analysis for remote sensing , 2010 .

[5]  Yuliya Tarabalka,et al.  Best Merge Region-Growing Segmentation With Integrated Nonadjacent Region Object Aggregation , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Shawn D. Newsam,et al.  Bag-of-visual-words and spatial extensions for land-use classification , 2010, GIS '10.

[7]  Pietro Perona,et al.  A Bayesian hierarchical model for learning natural scene categories , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[8]  Mihai Datcu,et al.  Bridging the Semantic Gap for Satellite Image Annotation and Automatic Mapping Applications , 2011, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[9]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[10]  Mihai Datcu,et al.  Semantic Annotation of Satellite Images Using Latent Dirichlet Allocation , 2010, IEEE Geoscience and Remote Sensing Letters.

[11]  Robert Marti,et al.  Which is the best way to organize/classify images by content? , 2007, Image Vis. Comput..

[12]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[13]  Andrew Zisserman,et al.  Scene Classification Using a Hybrid Generative/Discriminative Approach , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Thomas Hofmann,et al.  Unsupervised Learning by Probabilistic Latent Semantic Analysis , 2004, Machine Learning.