Inversion of Deep Networks for Modelling Variations in Spatial Distributions of Land Cover Classes Across Scales

In this paper, we propose the use of network inversion for modeling the variation of class distributions with scale. Unlike the state of the art methods that predict the mapping between coarser and finer scale patches without considering the distributions at coarser scale, our approach uses coarser scale features for effective reconstruction. This is the pioneer work of using network inversion for the purpose. Analysis over the proposed framework reveals that both the computational performance and accuracy varies with the depth of the network as well as the size and number of filters in each layer. Also the performance of the approach has been found to improve with the increase in the number of input feature maps. Investigations over standard datasets indicate that the proposed approach performs much better than the recent sub-pixel classification as well as super resolution techniques.

[1]  Rob Fergus,et al.  Restoring an Image Taken through a Window Covered with Dirt or Rain , 2013, 2013 IEEE International Conference on Computer Vision.

[2]  Bernhard Schölkopf,et al.  A Machine Learning Approach for Non-blind Image Deconvolution , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Liang Lin,et al.  Local- and holistic-structure preserving image super resolution via deep joint component learning , 2016, 2016 IEEE International Conference on Multimedia and Expo (ICME).

[4]  P. V. Arun,et al.  A deep learning based spatial dependency modelling approach towards super-resolution , 2016, 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[5]  M. Körner,et al.  SINGLE-IMAGE SUPER RESOLUTION FOR MULTISPECTRAL REMOTE SENSING DATA USING CONVOLUTIONAL NEURAL NETWORKS , 2016 .

[6]  Ce Liu,et al.  Deep Convolutional Neural Network for Image Deconvolution , 2014, NIPS.

[7]  P. V. Arun,et al.  Integration of contextual knowledge in unsupervised sub-pixel classification , 2016, 2016 8th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[8]  Alexander Binder,et al.  Evaluating the Visualization of What a Deep Neural Network Has Learned , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[9]  Andrea Vedaldi,et al.  Understanding deep image representations by inverting them , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Xiaoou Tang,et al.  Image Super-Resolution Using Deep Convolutional Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Thomas Brox,et al.  Inverting Visual Representations with Convolutional Networks , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Wenzhong Shi,et al.  Indicator Cokriging-Based Subpixel Mapping Without Prior Spatial Structure Information , 2015, IEEE Transactions on Geoscience and Remote Sensing.