Deep learning in very high resolution remote sensing image information mining communication concept

This paper presents the image information mining based on a communication channel concept. The feature extraction algorithms encode the image, while an analysis of topic discovery will decode and send its content to the user in the shape of a semantic map. We consider this approach for a real meaning based semantic annotation of very high resolution remote sensing images. The scene content is described using a multi-level hierarchical information representation. Feature hierarchies are discovered considering that higher levels are formed by combining features from lower level. Such a level to level mapping defines our methodology as a deep learning process. The whole analysis can be divided in two major learning steps. The first one regards the Bayesian inference to extract objects and assign basic semantic to the image. The second step models the spatial interactions between the scene objects based on Latent Dirichlet Allocation, performing a high level semantic annotation. We used a WorldView2 image to exemplify the processing results.

[1]  Mihai Datcu,et al.  Image Information Mining System Evaluation Using Information-Theoretic Measures , 2005, EURASIP J. Adv. Signal Process..

[2]  Jen-Tzung Chien,et al.  Introduction to the Special Section on Deep Learning for Speech and Language Processing , 2012, IEEE Transactions on Audio, Speech, and Language Processing.

[3]  Derek C. Rose,et al.  Deep Machine Learning - A New Frontier in Artificial Intelligence Research [Research Frontier] , 2010, IEEE Computational Intelligence Magazine.

[4]  Mihai Datcu,et al.  Design and evaluation of human-machine communication for image information mining , 2005, IEEE Transactions on Multimedia.

[5]  Laurent Wendling,et al.  A New Way to Represent the Relative Position between Areal Objects , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Inge Gavat,et al.  Data mining and spatial reasoning for satellite image characterization , 2010, 2010 8th International Conference on Communications.

[7]  Mihai Datcu,et al.  Interactive learning and probabilistic retrieval in remote sensing image archives , 2000, IEEE Trans. Geosci. Remote. Sens..

[8]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[9]  Mihai Datcu,et al.  Latent knowledge discovery in satellite images , 2011 .

[10]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[11]  Joseph A. O'Sullivan,et al.  Information-Theoretic Image Formation , 1998, IEEE Trans. Inf. Theory.