Collaborative Classification of Hyperspectral and LIDAR Data Using Unsupervised Image-to-Image CNN

Currently, how to efficiently exploit useful information from multi-source remote sensing data for better Earth observation becomes an interesting but challenging problem. In this paper, we propose an collaborative classification framework for hyperspectral image (HSI) and Light Detection and Ranging (LIDAR) data via image-to-image convolutional neural network (CNN). There is an image-to-image mapping, learning a representation from input source (i.e., HSI) to output source (i.e., LIDAR). Then, the extracted features are expected to own characteristics of both HSI and LIDAR data, and the collaborative classification is implemented by integrating hidden layers of the deep CNN. Experimental results on two real remote sensing data sets demonstrate the effectiveness of the proposed framework.

[1]  Qian Du,et al.  Local Binary Patterns and Extreme Learning Machine for Hyperspectral Imagery Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Benjamin Koetz,et al.  Multi-source land cover classification for forest fire management based on imaging spectrometry and LiDAR data , 2008 .

[3]  A. Pižurica,et al.  GRAPH-BASED FEATURE FUSION OF HYPERSPECTRAL AND LIDAR REMOTE SENSING DATA USING MORPHOLOGICAL FEATURES , 2013 .

[4]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[5]  Jon Atli Benediktsson,et al.  Recent Advances in Techniques for Hyperspectral Image Processing , 2009 .

[6]  Aleksandra Pizurica,et al.  Combining feature fusion and decision fusion for classification of hyperspectral and LiDAR data , 2014, 2014 IEEE Geoscience and Remote Sensing Symposium.

[7]  Jon Atli Benediktsson,et al.  Extinction Profiles for the Classification of Remote Sensing Data , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Antonio J. Plaza,et al.  Fusion of Hyperspectral and LiDAR Remote Sensing Data Using Multiple Feature Learning , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[9]  Jocelyn Chanussot,et al.  Decision Fusion for the Classification of Hyperspectral Data: Outcome of the 2008 GRS-S Data Fusion Contest , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Lorenzo Bruzzone,et al.  Fusion of Hyperspectral and LIDAR Remote Sensing Data for Classification of Complex Forest Areas , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Fan Zhang,et al.  Deep Convolutional Neural Networks for Hyperspectral Image Classification , 2015, J. Sensors.

[13]  Edoardo Pasolli,et al.  A Framework for Land Cover Classification Using Discrete Return LiDAR Data: Adopting Pseudo-Waveform and Hierarchical Segmentation , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[14]  Jan Kautz,et al.  Unsupervised Image-to-Image Translation Networks , 2017, NIPS.

[15]  Qian Du,et al.  Hyperspectral Image Classification Using Deep Pixel-Pair Features , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).