The Generalized Gamma-DBN for High-Resolution SAR Image Classification

With the increase of resolution, effective characterization of synthetic aperture radar (SAR) image becomes one of the most critical problems in many earth observation applications. Inspired by deep learning and probability mixture models, a generalized Gamma deep belief network (g Γ-DBN) is proposed for SAR image statistical modeling and land-cover classification in this work. Specifically, a generalized Gamma-Bernoulli restricted Boltzmann machine (gΓB-RBM) is proposed to capture high-order statistical characterizes from SAR images after introducing the generalized Gamma distribution. After stacking the g Γ B-RBM and several standard binary RBMs in a hierarchical manner, a gΓ-DBN is constructed to learn high-level representation of different SAR land-covers. Finally, a discriminative neural network is constructed by adding an additional predict layer for different land-covers over the constructed deep structure. Performance of the proposed approach is evaluated via several experiments on some high-resolution SAR image patch sets and two large-scale scenes which are captured by ALOS PALSAR-2 and COSMO-SkyMed satellites respectively.

[1]  Geoffrey E. Hinton.  Learning multiple layers of representation , 2007, Trends in Cognitive Sciences.

[2]  Rishi Kumar Gangwar,et al.  Oceanic Rain Flagging Using Radar Backscatter and Noise Measurements From Oceansat-2 Scatterometer , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Christian Igel,et al.  Empirical Analysis of the Divergence of Gibbs Sampling Based Learning Algorithms for Restricted Boltzmann Machines , 2010, ICANN.

[4]  Joni-Kristian Kämäräinen,et al.  Invariance properties of Gabor filter-based features-overview and applications , 2006, IEEE Transactions on Image Processing.

[5]  Peng Zhang,et al.  Mixture WG $\Gamma$ -MRF Model for PolSAR Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[7]  Xingming Sun,et al.  Synthetic Aperture Radar Image Segmentation by Modified Student's t-Mixture Model , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[9]  Gabriele Moser,et al.  Dictionary-based stochastic expectation-maximization for SAR amplitude probability density function estimation , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Geoffrey E. Hinton.  Training Products of Experts by Minimizing Contrastive Divergence , 2002, Neural Computation.

[11]  Haipeng Wang,et al.  Target Classification Using the Deep Convolutional Networks for SAR Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Zongxu Pan,et al.  Airplane Recognition in TerraSAR-X Images via Scatter Cluster Extraction and Reweighted Sparse Representation , 2017, IEEE Geoscience and Remote Sensing Letters.

[13]  Josiane Zerubia,et al.  Unsupervised Amplitude and Texture Classification of SAR Images With Multinomial Latent Model , 2013, IEEE Transactions on Image Processing.

[14]  Fachao Qin,et al.  Object-oriented ensemble classification for polarimetric SAR Imagery using restricted Boltzmann machines , 2017 .

[15]  Nikolaos Doulamis,et al.  Deep supervised learning for hyperspectral data classification through convolutional neural networks , 2015, 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[16]  Geoffrey E. Hinton,et al.  An Efficient Learning Procedure for Deep Boltzmann Machines , 2012, Neural Computation.

[17]  Sina Montazeri,et al.  Automatic Detection and Positioning of Ground Control Points Using TerraSAR-X Multiaspect Acquisitions , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Shiyong Cui,et al.  A Comparative Study of Bag-of-Words and Bag-of-Topics Models of EO Image Patches , 2015, IEEE Geoscience and Remote Sensing Letters.

[19]  Josiane Zerubia,et al.  SAR image classification with non-stationary Multinomial Logistic mixture of amplitude and texture densities , 2011, 2011 18th IEEE International Conference on Image Processing.

[20]  Shutao Li,et al.  Learning to Diversify Deep Belief Networks for Hyperspectral Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[21]  E. Stacy.  A Generalization of the Gamma Distribution , 1962 .

[22]  P. Sastry,et al.  Learning RBM with a DC programming Approach , 2017, ACML.

[23]  Jie Geng,et al.  High-Resolution SAR Image Classification via Deep Convolutional Autoencoders , 2015, IEEE Geoscience and Remote Sensing Letters.

[24]  Gui-Song Xia,et al.  SAR-Based Terrain Classification Using Weakly Supervised Hierarchical Markov Aspect Models , 2012, IEEE Transactions on Image Processing.

[25]  Ruslan Salakhutdinov,et al.  Learning Deep Generative Models , 2009 .

[26]  Jiali Shang,et al.  Sensitivity study of Radarsat-2 polarimetric SAR to crop height and fractional vegetation cover of corn and wheat , 2018 .

[27]  Bo Du,et al.  Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the Art , 2016, IEEE Geoscience and Remote Sensing Magazine.

[28]  Gang Wang,et al.  Deep Learning-Based Classification of Hyperspectral Data , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[29]  Gabriele Moser,et al.  Supervised High-Resolution Dual-Polarization SAR Image Classification by Finite Mixtures and Copulas , 2011, IEEE Journal of Selected Topics in Signal Processing.

[30]  Heng-Chao Li,et al.  On the Empirical-Statistical Modeling of SAR Images With Generalized Gamma Distribution , 2011, IEEE Journal of Selected Topics in Signal Processing.

[31]  Hongliang Ren,et al.  Hierarchical Recognition System for Target Recognition from Sparse Representations , 2015 .

[32]  Haipeng Wang,et al.  Complex-Valued Convolutional Neural Network and Its Application in Polarimetric SAR Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Fang Liu,et al.  POL-SAR Image Classification Based on Wishart DBN and Local Spatial Information , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[34]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[35]  Xiao Xiang Zhu,et al.  Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources , 2017, IEEE Geoscience and Remote Sensing Magazine.

[36]  Luisa Verdoliva,et al.  Multitemporal SAR Image Despeckling Based on Block-Matching and Collaborative Filtering , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[37]  Long Zhao,et al.  SAR Image Filtering Based on the Cauchy–Rayleigh Mixture Model , 2014, IEEE Geoscience and Remote Sensing Letters.

[38]  Florence Tupin,et al.  Multitemporal SAR Image Decomposition into Strong Scatterers, Background, and Speckle , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[39]  Miguel Á. Carreira-Perpiñán,et al.  On Contrastive Divergence Learning , 2005, AISTATS.

[40]  William J. Emery,et al.  Unsupervised Learning of Generalized Gamma Mixture Model With Application in Statistical Modeling of High-Resolution SAR Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[41]  Mingsheng Liao,et al.  Nonlinear Compressed Sensing-Based LDA Topic Model for Polarimetric SAR Image Classification , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[42]  Nicolas Le Roux,et al.  Representational Power of Restricted Boltzmann Machines and Deep Belief Networks , 2008, Neural Computation.

[43]  Mihai Datcu,et al.  Information Content of Very High Resolution SAR Images: Study of Feature Extraction and Imaging Parameters , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[44]  Geoffrey E. Hinton,et al.  Implicit Mixtures of Restricted Boltzmann Machines , 2008, NIPS.

[45]  Nikolaos Doulamis,et al.  Tensor-Based Nonlinear Classifier for High-Order Data Analysis , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[46]  Andrew Zisserman,et al.  A Statistical Approach to Material Classification Using Image Patch Exemplars , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[47]  Yanxin Li,et al.  SAR Target Configuration Recognition Using Locality Preserving Property and Gaussian Mixture Distribution , 2013, IEEE Geoscience and Remote Sensing Letters.

[48]  Shiyong Cui,et al.  A Comparative Study of Statistical Models for Multilook SAR Images , 2014, IEEE Geoscience and Remote Sensing Letters.

[49]  Davide Modolo,et al.  Do Semantic Parts Emerge in Convolutional Neural Networks? , 2016, International Journal of Computer Vision.

[50]  Xiayuan Huang,et al.  Supervised Polarimetric SAR Image Classification Using Tensor Local Discriminant Embedding , 2018, IEEE Transactions on Image Processing.

[51]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[52]  Christian Igel,et al.  Training restricted Boltzmann machines: An introduction , 2014, Pattern Recognit..

[53]  Jean-Marie Nicolas,et al.  Mimic Capacity Of Fisher And Generalized Gamma Distributions For High-Resolution SAR Image Statistical Modeling , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[54]  Francesca Bovolo,et al.  A Novel Technique Based on Deep Learning and a Synthetic Target Database for Classification of Urban Areas in PolSAR Data , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[55]  Zongxu Pan,et al.  Transfer Learning with Deep Convolutional Neural Network for SAR Target Classification with Limited Labeled Data , 2017, Remote. Sens..

[56]  Jin Zhao,et al.  Discriminant deep belief network for high-resolution SAR image classification , 2017, Pattern Recognit..

[57]  Jurandy Almeida,et al.  Classification of Detected Changes From Multitemporal High-Res Xband SAR Images: Intensity and Texture Descriptors From SuperPixels , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[58]  Shifei Ding,et al.  An overview on Restricted Boltzmann Machines , 2018, Neurocomputing.

[59]  Yunsong Li,et al.  Structure Tensor-Based Algorithm for Hyperspectral and Panchromatic Images Fusion , 2018, Remote. Sens..

[60]  Philip Marzahn,et al.  SAR-based detection of flooded vegetation – a review of characteristics and approaches , 2018 .