Semantic Annotation of Satellite Images Using Author–Genre–Topic Model

In this paper, we propose a novel hierarchical generative model, named author-genre-topic model (AGTM), to perform satellite image annotation. Different from the existing author-topic model in which each author and topic are associated with the multinomial distributions over topics and words, in AGTM, each genre, author, and topic are associated with the multinomial distributions over authors, topics, and words, respectively. The bias of the distribution of the authors with respect to the topics can be rectified by incorporating the distribution of the genres with respect to the authors. Therefore, the classification accuracy of documents is improved when the information of genre is introduced. By representing the images with several visual words, the AGTM can be used for satellite image annotation. The labels of classes and scenes of the images correspond to the authors and the genres of the documents, respectively. The labels of classes and scenes of test images can be estimated, and the accuracy of satellite image annotation is improved when the information of scenes is introduced in the training images. Experimental results demonstrate the good performance of the proposed method.

[1]  Lorenzo Bruzzone,et al.  A neural-statistical approach to multitemporal and multisource remote-sensing image classification , 1999, IEEE Trans. Geosci. Remote. Sens..

[2]  Andrew M. Dai,et al.  The Grouped Author-Topic Model for Unsupervised Entity Resolution , 2011, ICANN.

[3]  David A. Forsyth,et al.  Object Recognition as Machine Translation: Learning a Lexicon for a Fixed Image Vocabulary , 2002, ECCV.

[4]  Cornelia Caragea,et al.  Context Sensitive Topic Models for Author Influence in Document Networks , 2011, IJCAI.

[5]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[6]  Andrew Zisserman,et al.  Representing shape with a spatial pyramid kernel , 2007, CIVR '07.

[7]  Jon Atli Benediktsson,et al.  The effect of classifier agreement on the accuracy of the combined classifier in decision level fusion , 2001, IEEE Trans. Geosci. Remote. Sens..

[8]  Mihai Datcu,et al.  Semantic Annotation of Satellite Images Using Latent Dirichlet Allocation , 2010, IEEE Geoscience and Remote Sensing Letters.

[9]  Hongliang Li,et al.  Automatic Annotation of Multispectral Satellite Images Using Author–Topic Model , 2012, IEEE Geoscience and Remote Sensing Letters.

[10]  Y. Mori,et al.  Image-to-word transformation based on dividing and vector quantizing images with words , 1999 .

[11]  Michael I. Jordan,et al.  An Introduction to Variational Methods for Graphical Models , 1999, Machine-mediated learning.

[12]  John D. Lafferty,et al.  Correlated Topic Models , 2005, NIPS.

[13]  Zoubin Ghahramani,et al.  Propagation Algorithms for Variational Bayesian Learning , 2000, NIPS.

[14]  Thomas L. Griffiths,et al.  Probabilistic author-topic models for information discovery , 2004, KDD.

[15]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[16]  Dan Roth,et al.  Citation Author Topic Model in Expert Search , 2010, COLING.

[17]  Michael I. Jordan,et al.  Graphical Models, Exponential Families, and Variational Inference , 2008, Found. Trends Mach. Learn..

[18]  Tom Minka,et al.  Expectation Propagation for approximate Bayesian inference , 2001, UAI.

[19]  David M. Blei,et al.  Supervised Topic Models , 2007, NIPS.

[20]  Cordelia Schmid,et al.  Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[21]  Chih-Jen Lin,et al.  Working Set Selection Using Second Order Information for Training Support Vector Machines , 2005, J. Mach. Learn. Res..

[22]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[23]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[24]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[25]  Thomas Hofmann,et al.  Unsupervised Learning by Probabilistic Latent Semantic Analysis , 2004, Machine Learning.

[26]  Michael I. Jordan,et al.  Hierarchical Dirichlet Processes , 2006 .

[27]  Pietro Perona,et al.  A Bayesian hierarchical model for learning natural scene categories , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[28]  Graeme G. Wilkinson,et al.  Results and implications of a study of fifteen years of satellite image classification experiments , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).