Airborne Object Detection Using Hyperspectral Imaging: Deep Learning Review

Hyperspectral images have been increasingly important in object detection applications especially in remote sensing scenarios. Machine learning algorithms have become emerging tools for hyperspectral image analysis. The high dimensionality of hyperspectral images and the availability of simulated spectral sample libraries make deep learning an appealing approach. This report reviews recent data processing and object detection methods in the area including hand-crafted and automated feature extraction based on deep learning neural networks. The accuracy performances were compared according to existing reports as well as our own experiments (i.e., re-implementing and testing on new datasets). CNN models provided reliable performance of over 97% detection accuracy across a large set of HSI collections. A wide range of data were used: a rural area (Indian Pines data), an urban area (Pavia University), a wetland region (Botswana), an industrial field (Kennedy Space Center), to a farm site (Salinas). Note that, the Botswana set was not reviewed in recent works, thus high accuracy selected methods were newly compared in this work. A plain CNN model was also found to be able to perform comparably to its more complex variants in target detection applications.

[1]  Paul Scheunders,et al.  A band selection technique for spectral classification , 2005, IEEE Geoscience and Remote Sensing Letters.

[2]  Joydeep Ghosh,et al.  Random forests of binary hierarchical classifiers for analysis of hyperspectral data , 2003, IEEE Workshop on Advances in Techniques for Analysis of Remotely Sensed Data, 2003.

[3]  David A. Landgrebe,et al.  Signal Theory Methods in Multispectral Remote Sensing , 2003 .

[4]  Sen Jia,et al.  Convolutional neural networks for hyperspectral image classification , 2017, Neurocomputing.

[5]  Steven M. Adler-Golden,et al.  Atmospheric compensation of extreme off-nadir hyperspectral imagery from Hyperion , 2007, SPIE Defense + Commercial Sensing.

[6]  Wenju Wang,et al.  A Fast Dense Spectral-Spatial Convolution Network Framework for Hyperspectral Images Classification , 2018, Remote. Sens..

[7]  Jefersson Alex dos Santos,et al.  Towards better exploiting convolutional neural networks for remote sensing scene classification , 2016, Pattern Recognit..

[8]  Li Ma,et al.  Local Manifold Learning-Based $k$ -Nearest-Neighbor for Hyperspectral Image Classification , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Haokui Zhang,et al.  Spectral-spatial classification of hyperspectral imagery using a dual-channel convolutional neural network , 2017 .

[10]  Sildomar T. Monteiro,et al.  Machine learning based hyperspectral image analysis: A survey , 2018, ArXiv.

[11]  Jiang Xinhua,et al.  HYPERSPECTRAL DATA FEATURE EXTRACTION USING DEEP BELIEF NETWORK , 2016 .

[12]  Jon Atli Benediktsson,et al.  SVM- and MRF-Based Method for Accurate Classification of Hyperspectral Images , 2010, IEEE Geoscience and Remote Sensing Letters.

[13]  Shutao Li,et al.  Hyperspectral Image Classification With Deep Feature Fusion Network , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Xuelong Li,et al.  Spectral-Spatial Constraint Hyperspectral Image Classification , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Rick Archibald,et al.  Feature Selection and Classification of Hyperspectral Images With Support Vector Machines , 2007, IEEE Geoscience and Remote Sensing Letters.

[16]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[17]  J. Chanussot,et al.  Hyperspectral Remote Sensing Data Analysis and Future Challenges , 2013, IEEE Geoscience and Remote Sensing Magazine.

[18]  Trac D. Tran,et al.  Hyperspectral Image Classification via Kernel Sparse Representation , 2013, IEEE Trans. Geosci. Remote. Sens..

[19]  Nikolaos Doulamis,et al.  Deep supervised learning for hyperspectral data classification through convolutional neural networks , 2015, 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[20]  Allan Aasbjerg Nielsen,et al.  Kernel Maximum Autocorrelation Factor and Minimum Noise Fraction Transformations , 2011, IEEE Transactions on Image Processing.

[21]  Thomas L. Ainsworth,et al.  Exploiting manifold geometry in hyperspectral imagery , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Thomas L. Ainsworth,et al.  Bathymetric Retrieval From Hyperspectral Imagery Using Manifold Coordinate Representations , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Lorenzo Bruzzone,et al.  Classification of hyperspectral remote sensing images with support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Raymond Y. K. Lau,et al.  Hyperspectral Image Classification With Deep Learning Models , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Bernhard Schölkopf,et al.  Remote Sensing Feature Selection by Kernel Dependence Measures , 2010, IEEE Geoscience and Remote Sensing Letters.

[26]  Gang Wang,et al.  Deep Learning-Based Classification of Hyperspectral Data , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[27]  Lin Na,et al.  Hyperspectral Remote Sensing Image Feature Extraction based on Kernel Minimum Noise Fraction Transformation , 2013 .

[28]  Lorenzo Bruzzone,et al.  A technique for feature selection in multiclass problems , 2000 .

[29]  Antonio Plaza,et al.  A new deep convolutional neural network for fast hyperspectral image classification , 2017, ISPRS Journal of Photogrammetry and Remote Sensing.

[30]  G. F. Hughes,et al.  On the mean accuracy of statistical pattern recognizers , 1968, IEEE Trans. Inf. Theory.

[31]  Robert F. Cromp,et al.  Analyzing hyperspectral data with independent component analysis , 1998, Other Conferences.

[32]  Robert I. Damper,et al.  Band Selection for Hyperspectral Image Classification Using Mutual Information , 2006, IEEE Geoscience and Remote Sensing Letters.

[33]  Carola-Bibiane Schönlieb,et al.  A DIVERSIFIED DEEP BELIEF NETWORK FOR HYPERSPECTRAL IMAGE CLASSIFICATION , 2016 .

[34]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[35]  Yasemin Yardimci,et al.  Hyperspectral classification using stacked autoencoders with deep learning , 2014, 2014 6th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[36]  Naoto Yokoya,et al.  Advances in Hyperspectral Image and Signal Processing: A Comprehensive Overview of the State of the Art , 2017, IEEE Geoscience and Remote Sensing Magazine.

[37]  Paolo Gamba,et al.  A Novel Approach for Efficient $p$-Linear Hyperspectral Unmixing , 2015, IEEE Journal of Selected Topics in Signal Processing.

[38]  Trac D. Tran,et al.  Hyperspectral Image Classification Using Dictionary-Based Sparse Representation , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[39]  M. F. Baumgardner,et al.  220 Band AVIRIS Hyperspectral Image Data Set: June 12, 1992 Indian Pine Test Site 3 , 2015 .

[40]  Jon Atli Benediktsson,et al.  Classification of Hyperspectral Images by Using Extended Morphological Attribute Profiles and Independent Component Analysis , 2011, IEEE Geoscience and Remote Sensing Letters.

[41]  Xiuping Jia,et al.  Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[42]  Johannes R. Sveinsson,et al.  Classification of hyperspectral data from urban areas based on extended morphological profiles , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[43]  Qian Du,et al.  Hyperspectral Image Classification Using Deep Pixel-Pair Features , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[44]  Antonio J. Plaza,et al.  Dimensionality reduction and classification of hyperspectral image data using sequences of extended morphological transformations , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[45]  Thomas L. Ainsworth,et al.  Manifold coordinate representations of hyperspectral imagery: Improvements in algorithm performance and computational efficiency , 2010, 2010 IEEE International Geoscience and Remote Sensing Symposium.

[46]  Panagiotis Tsakalides,et al.  Spectral Super-Resolution for Hyperspectral Images via Sparse Representations , 2016 .

[47]  Panagiotis Tsakalides,et al.  Spectral Resolution Enhancement of Hyperspectral Images via Sparse Representations , 2016, Computational Imaging.

[48]  Lorenzo Bruzzone,et al.  Classification of Hyperspectral Images With Regularized Linear Discriminant Analysis , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[49]  Qingshan Liu,et al.  Cascaded Recurrent Neural Networks for Hyperspectral Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[50]  H. Ghassemian,et al.  Improving hyperspectral image classification by combining spectral, texture, and shape features , 2015 .

[51]  Glenn Healey,et al.  The impact of viewing geometry on material discriminability in hyperspectral images , 2001, IEEE Trans. Geosci. Remote. Sens..

[52]  Lorenzo Bruzzone,et al.  Kernel-based methods for hyperspectral image classification , 2005, IEEE Transactions on Geoscience and Remote Sensing.