A Feature Fusion-Net Using Deep Spatial Context Encoder and Nonstationary Joint Statistical Model for High Resolution SAR Image Classification

Convolutional neural networks (CNNs) have been applied to learn spatial features for high-resolution (HR) synthetic aperture radar (SAR) image classification. However, there has been little work on integrating the unique statistical distributions of SAR images which can reveal physical properties of terrain objects, into CNNs in a supervised feature learning framework. To address this problem, a novel end-to-end supervised classification method is proposed for HR SAR images by considering both spatial context and statistical features. First, to extract more effective spatial features from SAR images, a new deep spatial context encoder network (DSCEN) is proposed, which is a lightweight structure and can be effectively trained with a small number of samples. Meanwhile, to enhance the diversity of statistics, the nonstationary joint statistical model (NS-JSM) is adopted to form the global statistical features. Specifically, SAR images are transformed into the Gabor wavelet domain and the produced multi-subbands magnitudes and phases are modeled by the log-normal and uniform distribution. The covariance matrix is further utilized to capture the inter-scale and intrascale nonstationary correlation between the statistical subbands and make the joint statistical features more compact and distinguishable. Considering complementary advantages, a feature fusion network (Fusion-Net) base on group compression and smooth normalization is constructed to embed the statistical features into the spatial features and optimize the fusion feature representation. As a result, our model can learn the discriminative features and improve the final classification performance. Experiments on four HR SAR images validate the superiority of the proposed method over other related algorithms. * Corresponding author E-mail address: ywu@mail.xidian.edu.cn.

[1]  Juan Li,et al.  SAR Image Classification Using Greedy Hierarchical Learning With Unsupervised Stacked CAEs , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Xin Zhou,et al.  A Two-Component $K$–Lognormal Mixture Model and Its Parameter Estimation Method , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[3]  IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium , 2018 .

[4]  Mihai Datcu,et al.  Classification of Large-Scale High-Resolution SAR Images With Deep Transfer Learning , 2020, IEEE Geoscience and Remote Sensing Letters.

[5]  Himanshu Upadhyay,et al.  Visualizing High-Dimensional Data Using t-Distributed Stochastic Neighbor Embedding Algorithm , 2020 .

[6]  Ming Li,et al.  High-Resolution SAR Image Classification Using Multi-Scale Deep Feature Fusion and Covariance Pooling Manifold Network , 2021, Remote. Sens..

[7]  David de la Mata-Moya,et al.  Statistical Analysis of SAR Sea Clutter for Classification Purposes , 2014, Remote. Sens..

[8]  Nitish Srivastava,et al.  Improving neural networks by preventing co-adaptation of feature detectors , 2012, ArXiv.

[9]  Geoffrey E. Hinton,et al.  A Simple Framework for Contrastive Learning of Visual Representations , 2020, ICML.

[10]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  S. F. George,et al.  Detection of Targets in Non-Gaussian Sea Clutter , 1970, IEEE Transactions on Aerospace and Electronic Systems.

[12]  Tai Sing Lee,et al.  Image Representation Using 2D Gabor Wavelets , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Jin Zhao,et al.  Discriminant deep belief network for high-resolution SAR image classification , 2017, Pattern Recognit..

[14]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[15]  Abdelmalek Toumi,et al.  Multivariate copula statistical model and weighted sparse classification for radar image target recognition , 2020, Comput. Electr. Eng..

[16]  Gu Xingfa,et al.  Overview of China Earth Observation Satellite Programs [Space Agencies] , 2015, IEEE Geoscience and Remote Sensing Magazine.

[17]  Raquel Urtasun,et al.  Understanding the Effective Receptive Field in Deep Convolutional Neural Networks , 2016, NIPS.

[18]  Habibollah Danyali,et al.  Nonsubsampled contourlet transform-based conditional random field for SAR images segmentation , 2020, Signal Process..

[19]  Haipeng Wang,et al.  Target Classification Using the Deep Convolutional Networks for SAR Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Mingsheng Liao,et al.  Statistical Convolutional Neural Network for Land-Cover Classification From SAR Images , 2020, IEEE Geoscience and Remote Sensing Letters.

[21]  Amel Benazza-Benyahia,et al.  Copula-based statistical models for multicomponent image retrieval in thewavelet transform domain , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[22]  J. Jao Amplitude distribution of composite terrain radar clutter and the κ-Distribution , 1984 .

[23]  Huafu Chen,et al.  Marginal distribution covariance model in the multiple wavelet domain for texture representation , 2019, Pattern Recognit..

[24]  Luciano Alparone,et al.  A Tutorial on Speckle Reduction in Synthetic Aperture Radar Images , 2013, IEEE Geoscience and Remote Sensing Magazine.

[25]  John S. Bridle,et al.  Training Stochastic Model Recognition Algorithms as Networks can Lead to Maximum Mutual Information Estimation of Parameters , 1989, NIPS.

[26]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[27]  Bo Tang,et al.  Multi-Scale Rotation-Invariant Haar-Like Feature Integrated CNN-Based Ship Detection Algorithm of Multiple-Target Environment in SAR Imagery , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Yiyuan Xie,et al.  FEC: A Feature Fusion Framework for SAR Target Recognition Based on Electromagnetic Scattering Features and Deep CNN Features , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[29]  William J. Emery,et al.  Unsupervised Learning of Generalized Gamma Mixture Model With Application in Statistical Modeling of High-Resolution SAR Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Nicholas Ayache,et al.  Geometric Means in a Novel Vector Space Structure on Symmetric Positive-Definite Matrices , 2007, SIAM J. Matrix Anal. Appl..

[31]  Hongyi Zhang,et al.  mixup: Beyond Empirical Risk Minimization , 2017, ICLR.

[32]  Mingsheng Liao,et al.  Nonlinear Manifold Learning Integrated with Fully Convolutional Networks for PolSAR Image Classification , 2020, Remote. Sens..

[33]  Lei Yu,et al.  Gabor texture representation method for face recognition using the Gamma and generalized Gaussian models , 2010, Image Vis. Comput..

[34]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[35]  M. Sekine,et al.  Weibull radar clutter , 1990 .

[36]  Mihai Datcu,et al.  Information Content of Very High Resolution SAR Images: Study of Feature Extraction and Imaging Parameters , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[37]  Ming Li,et al.  SAR Image Multiclass Segmentation Using a Multiscale TMF Model in Wavelet Domain , 2012, IEEE Geoscience and Remote Sensing Letters.

[38]  Lionel Bombrun,et al.  Fisher Distribution for Texture Modeling of Polarimetric SAR Data , 2008, IEEE Geoscience and Remote Sensing Letters.

[39]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[40]  Jian Yang,et al.  SAR Target Recognition via Supervised Discriminative Dictionary Learning and Sparse Representation of the SAR-HOG Feature , 2016, Remote. Sens..

[41]  Seiho Uratsuka,et al.  Damage estimation of the Great East Japan Earthquake by NICT airborne SAR (PI-SAR2) , 2012, Asia-Pacific Environmental Remote Sensing.

[42]  J. Goodman Statistical Properties of Laser Speckle Patterns , 1963 .

[43]  Andreas Schenk,et al.  Characterization of Land Cover Types in TerraSAR-X Images by Combined Analysis of Speckle Statistics and Intensity Information , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[44]  I. Hajnsek,et al.  A tutorial on synthetic aperture radar , 2013, IEEE Geoscience and Remote Sensing Magazine.

[45]  In-So Kweon,et al.  CBAM: Convolutional Block Attention Module , 2018, ECCV.

[46]  Andrew L. Maas Rectifier Nonlinearities Improve Neural Network Acoustic Models , 2013 .

[47]  Abdelmalek Toumi,et al.  Target Recognition in Radar Images Using Weighted Statistical Dictionary-Based Sparse Representation , 2017, IEEE Geoscience and Remote Sensing Letters.

[48]  Dilip Sarkar,et al.  Semi-Automatic Extraction of Training Examples From Sensor Readings for Fall Detection and Posture Monitoring , 2016, IEEE Sensors Journal.

[49]  Fan Zhang,et al.  Small Sample Learning Optimization for Resnet Based Sar Target Recognition , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[50]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[51]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[52]  Jean-Marie Nicolas,et al.  Gamma mixture modeled with "second kind statistics": application to SAR image processing , 2002, IEEE International Geoscience and Remote Sensing Symposium.

[53]  Cristian Rossi,et al.  Paddy-Rice Monitoring Using TanDEM-X , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[54]  Kilian Q. Weinberger,et al.  CondenseNet: An Efficient DenseNet Using Learned Group Convolutions , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[55]  Helko Breit,et al.  TerraSAR-X SAR Processing and Products , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[56]  Xiaoan Tang,et al.  Covariance of Textural Features: A New Feature Descriptor for SAR Image Classification , 2019, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[57]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[58]  Andreas Uhl,et al.  Lightweight Probabilistic Texture Retrieval , 2010, IEEE Transactions on Image Processing.

[59]  Jie Geng,et al.  SAR Image Classification via Deep Recurrent Encoding Neural Networks , 2018, IEEE Transactions on Geoscience and Remote Sensing.