Complex Contourlet-CNN for polarimetric SAR image classification

Abstract A complex multiscale network named complex Contourlet convolutional neural network (complex Contourlet-CNN) is proposed for polarimetric synthetic aperture radar (PolSAR) image classification in this paper. In order to make full use of the phase information of PolSAR image, we redefine the conventional operations of CNN in complex field, and the data sets and parameters are always expressed through the complex matrixes in complex CNN. Moreover, the multiscale deep Contourlet filter banks are constructed to extract more robust discriminative features with multidirection, multiscale, and multiresolution properties, which can improve the performance of complex CNN by replacing filters of the first complex convolutional layer with the multiscale deep Contourlet filter banks. The Contourlet transform is used for helping the complex CNN network to capture abstract features in a certain direction and frequency band. Furthermore, the proposed network based on the multiscale geometric properties of Contourlet transform can retrieve the information in the region and direction corresponding to the extracted features. Experiments on different spatial resolutions and land coverings of Flevoland, San Francisco Bay, and Germany PolSAR images show that less training data is required and the performance of the proposed explainable deep learning method is comparable to that of the existing state-of-the-art methods.

[1]  Haibo He,et al.  Learning from Imbalanced Data , 2009, IEEE Transactions on Knowledge and Data Engineering.

[2]  Alexandre Boulch,et al.  Benchmarking classification of earth-observation data: From learning explicit features to convolutional networks , 2015, 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[3]  Fang Liu,et al.  SAR Image segmentation based on convolutional-wavelet neural network and markov random field , 2017, Pattern Recognit..

[4]  Fang Liu,et al.  A new patch based change detector for polarimetric SAR data , 2015, Pattern Recognit..

[5]  Farid Melgani,et al.  An explicit fuzzy supervised classification method for multispectral remote sensing images , 2000, IEEE Trans. Geosci. Remote. Sens..

[6]  C. Torrence,et al.  A Practical Guide to Wavelet Analysis. , 1998 .

[7]  D. D.-Y. Po,et al.  Directional multiscale modeling of images using the contourlet transform , 2006, IEEE Transactions on Image Processing.

[8]  Yu Zhou,et al.  Polarimetric SAR Image Classification Using Deep Convolutional Neural Networks , 2016, IEEE Geoscience and Remote Sensing Letters.

[9]  Jun Li,et al.  Improved hyperspectral image classification by active learning using pre-designed mixed pixels , 2016, Pattern Recognit..

[10]  Licheng Jiao,et al.  Fast Sparse Approximation for Least Squares Support Vector Machine , 2007, IEEE Transactions on Neural Networks.

[11]  Shuyuan Yang,et al.  Radar target recognition using contourlet packet transform and neural network approach , 2009, Signal Process..

[12]  Minh N. Do,et al.  The Nonsubsampled Contourlet Transform: Theory, Design, and Applications , 2006, IEEE Transactions on Image Processing.

[13]  Jocelyn Chanussot,et al.  A novel approach to polarimetric SAR data processing based on Nonlinear PCA , 2014, Pattern Recognit..

[14]  Minh N. Do,et al.  Framing pyramids , 2003, IEEE Trans. Signal Process..

[15]  Licheng Jiao,et al.  Multiwavelet neural network and its approximation properties , 2001, IEEE Trans. Neural Networks.

[16]  Jin Zhao,et al.  Discriminant deep belief network for high-resolution SAR image classification , 2017, Pattern Recognit..

[17]  I. Vanhamel,et al.  A hierarchical Markovian model for multiscale region-based classification of multispectral images , 2003, IEEE Workshop on Advances in Techniques for Analysis of Remotely Sensed Data, 2003.

[18]  Minh N. Do,et al.  Ieee Transactions on Image Processing the Contourlet Transform: an Efficient Directional Multiresolution Image Representation , 2022 .

[19]  Shuyuan Yang,et al.  A linear ridgelet network , 2009, Neurocomputing.

[20]  Xu Jin,et al.  Improving the Performance of Distributed MXNet with RDMA , 2019, International Journal of Parallel Programming.

[21]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[22]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[23]  Uzay Kaymak,et al.  Cohen's kappa coefficient as a performance measure for feature selection , 2010, International Conference on Fuzzy Systems.

[24]  N. Kingsbury Image processing with complex wavelets , 1999, Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[25]  Sebastiano B. Serpico,et al.  Partially supervised classification of remote sensing images using SVM-based probability density estimation , 2003, IEEE Workshop on Advances in Techniques for Analysis of Remotely Sensed Data, 2003.

[26]  Xu Liu,et al.  Polarimetric Convolutional Network for PolSAR Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Talaat S. El-Sheikh,et al.  Average classification accuracy over collections of gaussian problems - common covariance matrix case , 1984, Pattern Recognit..

[28]  Fang Liu,et al.  Hierarchical semantic model and scattering mechanism based PolSAR image classification , 2015, Pattern Recognit..

[29]  B. Pradhan,et al.  Detecting coral bleaching, using QuickBird multi-temporal data: A feasibility study at Kish Island, , 2013 .

[30]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[31]  Mark J. Shensa,et al.  The discrete wavelet transform: wedding the a trous and Mallat algorithms , 1992, IEEE Trans. Signal Process..

[32]  Haipeng Wang,et al.  Complex-Valued Convolutional Neural Network and Its Application in Polarimetric SAR Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Corina da Costa Freitas,et al.  Speckle reduction in polarimetric SAR imagery with stochastic distances and nonlocal means , 2013, Pattern Recognit..

[34]  Fang Liu,et al.  POL-SAR Image Classification Based on Wishart DBN and Local Spatial Information , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[35]  Shuyan Zhao,et al.  Two-stage segmentation of unconstrained handwritten Chinese character , 2003, Pattern Recognit..

[36]  Qinghua Zhang,et al.  Wavelet networks , 1992, IEEE Trans. Neural Networks.

[37]  Si-Wei Chen,et al.  PolSAR Image Classification Using Polarimetric-Feature-Driven Deep Convolutional Neural Network , 2018, IEEE Geoscience and Remote Sensing Letters.