Automatic Annotation of Multispectral Satellite Images Using Author–Topic Model

In this letter, we propose a new method for the annotation of multispectral satellite images. This method performs the multispectral image annotation by incorporating a graphical model. To obtain the annotated image, first, we use a set of images with defined semantic concepts to represent the training set. Second, the images are represented by several visual words based on the color and texture features. Finally, an author-topic model is exploited to estimate probabilities of semantic classes for the regions in the test images and categorize them into the semantic concepts. Experimental evaluation on the multispectral images demonstrates the good performance of the proposed method on the multispectral image annotation.

[1]  Hongliang Li,et al.  Soft-Change Detection in Optical Satellite Images , 2011, IEEE Geoscience and Remote Sensing Letters.

[2]  Peter Green,et al.  Markov chain Monte Carlo in Practice , 1996 .

[3]  David A. Forsyth,et al.  Object Recognition as Machine Translation: Learning a Lexicon for a Fixed Image Vocabulary , 2002, ECCV.

[4]  Jon Atli Benediktsson,et al.  The effect of classifier agreement on the accuracy of the combined classifier in decision level fusion , 2001, IEEE Trans. Geosci. Remote. Sens..

[5]  Mihai Datcu,et al.  Semantic Annotation of Satellite Images Using Latent Dirichlet Allocation , 2010, IEEE Geoscience and Remote Sensing Letters.

[6]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[7]  Graeme G. Wilkinson,et al.  Results and implications of a study of fifteen years of satellite image classification experiments , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Y. Mori,et al.  Image-to-word transformation based on dividing and vector quantizing images with words , 1999 .

[9]  Cordelia Schmid,et al.  Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[10]  Marco Pastori,et al.  Information mining in remote sensing image archives: system concepts , 2003, IEEE Trans. Geosci. Remote. Sens..

[11]  Pietro Perona,et al.  A Bayesian hierarchical model for learning natural scene categories , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[12]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[13]  Andrew Zisserman,et al.  Representing shape with a spatial pyramid kernel , 2007, CIVR '07.

[14]  Lorenzo Bruzzone,et al.  A neural-statistical approach to multitemporal and multisource remote-sensing image classification , 1999, IEEE Trans. Geosci. Remote. Sens..

[15]  Thomas Hofmann,et al.  Unsupervised Learning by Probabilistic Latent Semantic Analysis , 2004, Machine Learning.

[16]  Thomas L. Griffiths,et al.  Probabilistic author-topic models for information discovery , 2004, KDD.