GeoAI: A Model-Agnostic Meta-Ensemble Zero-Shot Learning Method for Hyperspectral Image Analysis and Classification

Deep learning architectures are the most effective methods for analyzing and classifying Ultra-Spectral Images (USI). However, effective training of a Deep Learning (DL) gradient classifier aiming to achieve high classification accuracy, is extremely costly and time-consuming. It requires huge datasets with hundreds or thousands of labeled specimens from expert scientists. This research exploits the MAML++ algorithm in order to introduce the Model-Agnostic Meta-Ensemble Zero-shot Learning (MAME-ZsL) approach. The MAME-ZsL overcomes the above difficulties, and it can be used as a powerful model to perform Hyperspectral Image Analysis (HIA). It is a novel optimization-based Meta-Ensemble Learning architecture, following a Zero-shot Learning (ZsL) prototype. To the best of our knowledge it is introduced to the literature for the first time. It facilitates learning of specialized techniques for the extraction of user-mediated representations, in complex Deep Learning architectures. Moreover, it leverages the use of first and second-order derivatives as pre-training methods. It enhances learning of features which do not cause issues of exploding or diminishing gradients; thus, it avoids potential overfitting. Moreover, it significantly reduces computational cost and training time, and it offers an improved training stability, high generalization performance and remarkable classification accuracy.

[1]  Wenwen Li,et al.  Automated terrain feature identification from remote sensing imagery: a deep learning approach , 2018, Int. J. Geogr. Inf. Sci..

[2]  Xiuping Jia,et al.  Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Shaogang Gong,et al.  Transductive Multi-View Zero-Shot Learning , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Shashi Shekhar,et al.  A locally-constrained YOLO framework for detecting small and densely-distributed building footprints , 2019, Int. J. Geogr. Inf. Sci..

[5]  Fan Zhang,et al.  Deep Convolutional Neural Networks for Hyperspectral Image Classification , 2015, J. Sensors.

[6]  Yu Liu,et al.  Spatial interpolation using conditional generative adversarial neural networks , 2019, Int. J. Geogr. Inf. Sci..

[7]  Nicholas G. Polson,et al.  Deep learning for short-term traffic flow prediction , 2016, 1604.04527.

[8]  Zhou Guo,et al.  Using multi-scale and hierarchical deep convolutional features for 3D semantic classification of TLS point clouds , 2018, Int. J. Geogr. Inf. Sci..

[9]  Xiao Xiang Zhu,et al.  Unsupervised Spectral–Spatial Feature Learning via Deep Residual Conv–Deconv Network for Hyperspectral Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Philip H. S. Torr,et al.  An embarrassingly simple approach to zero-shot learning , 2015, ICML.

[11]  Selim Aksoy,et al.  Fine-Grained Object Recognition and Zero-Shot Learning in Remote Sensing Imagery , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Rani Astya,et al.  An overview of deep learning architectures, libraries and its applications areas , 2018, 2018 International Conference on Advances in Computing, Communication Control and Networking (ICACCCN).

[13]  Konstantinos Demertzis,et al.  Commentary: Aedes albopictus and Aedes japonicas—two invasive mosquito species with different temperature niches in Europe , 2017, Front. Environ. Sci..

[14]  Thomas Brox,et al.  Learning to Generate Chairs, Tables and Cars with Convolutional Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Shaogang Gong,et al.  Recent Advances in Zero-Shot Recognition: Toward Data-Efficient Understanding of Visual Content , 2018, IEEE Signal Processing Magazine.

[16]  Bogdan Gabrys,et al.  Metalearning: a survey of trends and technologies , 2013, Artificial Intelligence Review.

[17]  Xin Xu,et al.  A Generalized Zero-Shot Learning Framework for PolSAR Land Cover Classification , 2018, Remote. Sens..

[18]  Thomas Brox,et al.  Discriminative Unsupervised Feature Learning with Exemplar Convolutional Neural Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Craig A. Knoblock,et al.  Automatic alignment of contemporary vector data and georeferenced historical maps using reinforcement learning , 2019, Int. J. Geogr. Inf. Sci..

[20]  Tao Xiang,et al.  Learning a Deep Embedding Model for Zero-Shot Learning , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  J. Sim,et al.  The kappa statistic in reliability studies: use, interpretation, and sample size requirements. , 2005, Physical therapy.

[22]  David Bergström,et al.  Hyperspectral image analysis using deep learning — A review , 2016, 2016 Sixth International Conference on Image Processing Theory, Tools and Applications (IPTA).