Extreme learning machines for soybean classification in remote sensing hyperspectral images

This paper focuses on the application of Extreme Learning Machines (ELM) to the classification of remote sensing hyperspectral data. The specific aim of the work is to obtain accurate thematic maps of soybean crops, which have proven to be difficult to identify by automated procedures. The classification process carried out is as follows: First, spectral data is transformed into a hyper-spherical representation. Second, a robust image gradient is computed over the hyper-spherical representation allowing an image segmentation that identifies major crop plots. Third, feature selection is achieved by a greedy wrapper approach. Finally, a classifier is trained and tested on the selected image pixel features. The classifiers used for feature selection and final classification are Single Layer Feedforward Networks (SLFN) trained with either the ELM or the incremental OP-ELM. Original image pixel features are computed following a Functional Data Analysis (FDA) characterization of the spectral data. Conventional ELM training of the SLFN improves over the classification performance of state of the art algorithms reported in the literature dealing with the data treated in this paper. Moreover, SLFN-ELM uses less features than the referred algorithms. OP-ELM is able to find competitive results using the FDA features from a single spectral band.

[1]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[2]  Gareth M. James,et al.  Functional linear discriminant analysis for irregularly sampled curves , 2001 .

[3]  James O. Ramsay,et al.  Applied Functional Data Analysis: Methods and Case Studies , 2002 .

[4]  Jiguo Cao,et al.  Parameter estimation for differential equations: a generalized smoothing approach , 2007 .

[5]  Michael G. Lipsett,et al.  Infrared reflectance hyperspectral features of Athabasca oil sand ore and froth , 2011, 2011 3rd Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[6]  Lênio Soares Galvão,et al.  Classification of soybean varieties using different techniques: case study with Hyperion and sensor spectral resolution simulations , 2011 .

[7]  Ted R. Hedman,et al.  Performance characterization of the Hyperion Imaging Spectrometer instrument , 2000, SPIE Optics + Photonics.

[8]  Zexuan Zhu,et al.  A fast pruned-extreme learning machine for classification problem , 2008, Neurocomputing.

[9]  Hervé Carfantan,et al.  Extraction of stellar spectra from dense fields in hyperspectral muse data cubes using non-negative matrix factorization , 2011, 2011 3rd Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[10]  Y. Kosugi,et al.  Prediction of sweetness and amino acid content in soybean crops from hyperspectral imagery , 2007 .

[11]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[12]  Niu Shuwen,et al.  Soybean LAI Estimation with In-situ Collected Hyperspectral Data Based on BP-neural Networks , 2007, 2007 3rd International Conference on Recent Advances in Space Technologies.

[13]  Dianhui Wang,et al.  Advances in extreme learning machines (ELM2014) , 2011, Neurocomputing.

[14]  Wang Xi-zhao,et al.  Architecture selection for networks trained with extreme learning machine using localized generalization error model , 2013 .

[15]  Frédéric Ferraty,et al.  Nonparametric Functional Data Analysis: Theory and Practice (Springer Series in Statistics) , 2006 .

[16]  Fabrice Rossi,et al.  Functional multi-layer perceptron: a non-linear tool for functional data analysis , 2007, Neural Networks.

[17]  Amaury Lendasse,et al.  OP-ELM: Optimally Pruned Extreme Learning Machine , 2010, IEEE Transactions on Neural Networks.

[18]  Hao Chen,et al.  Processing Hyperion and ALI for forest classification , 2003, IEEE Trans. Geosci. Remote. Sens..

[19]  Kenshi Sakai,et al.  Application of airborne hyperspectral imagery to estimating fruit yield in citrus , 2011, 2011 3rd Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[20]  Guang-Bin Huang,et al.  Convex incremental extreme learning machine , 2007, Neurocomputing.

[21]  Xizhao Wang,et al.  Architecture selection for networks trained with extreme learning machine using localized generalization error model , 2013, Neurocomputing.

[22]  Hung Keng Pung,et al.  Systemical convergence rate analysis of convex incremental feedforward neural networks , 2009, Neurocomputing.

[23]  Guangjian Yan,et al.  Improved Methods for Spectral Calibration of On-Orbit Imaging Spectrometers , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[24]  W. Saeys,et al.  Potential applications of functional data analysis in chemometrics , 2008 .

[25]  Zhiyan Zhou,et al.  Detection of cowpea weevil (Callosobruchus maculatus (F.)) in soybean with hyperspectral spectrometry and a backpropagation neural network , 2010, 2010 Sixth International Conference on Natural Computation.

[26]  Michel Verleysen,et al.  Representation of functional data in neural networks , 2005, Neurocomputing.

[27]  M. Goulard,et al.  Functional approaches for predicting land use with the temporal evolution of coarse resolution remote sensing data , 2003 .

[28]  C. Abraham,et al.  Unsupervised Curve Clustering using B‐Splines , 2003 .

[29]  David C Christiani,et al.  Biomarker discovery for arsenic exposure using functional data. Analysis and feature learning of mass spectrometry proteomic data. , 2008, Journal of proteome research.

[30]  Fabrice Rossi,et al.  Support Vector Machine For Functional Data Classification , 2006, ESANN.

[31]  Gregory Asner,et al.  Regularization of discriminant analysis for the study of biodiversity in humid tropical forests , 2011, 2011 3rd Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[32]  Guy Martial Nkiet,et al.  Measures of Association for Hilbertian Subspaces and Some Applications , 2002 .

[33]  Lei Chen,et al.  Enhanced random search based incremental extreme learning machine , 2008, Neurocomputing.

[34]  Christiaan Perneel,et al.  Detection of vehicles in shadow areas , 2011, 2011 3rd Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[35]  Jan G. P. W. Clevers,et al.  Using hyperspectral remote sensing data for retrieving total canopy chlorophyll and nitrogen content , 2011, 2011 3rd Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[36]  Qinyu. Zhu Extreme Learning Machine , 2013 .

[37]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[38]  Christian Ritz,et al.  Functional regression analysis of fluorescence curves. , 2009, Biometrics.

[39]  Jane-Ling Wang,et al.  Functional canonical analysis for square integrable stochastic processes , 2003 .

[40]  Jeffrey S. Morris,et al.  Bayesian Analysis of Mass Spectrometry Proteomic Data Using Wavelet‐Based Functional Mixed Models , 2008, Biometrics.

[41]  D. Krezhova,et al.  Hyperspectral remote sensing of the impact of environmental stresses on nitrogen fixing soybean plants (Glycine max L.) , 2011, Proceedings of 5th International Conference on Recent Advances in Space Technologies - RAST2011.

[42]  Ramón Moreno,et al.  About Gradient Operators on Hyperspectral Images , 2012, ICPRAM.

[43]  J. Ramsay,et al.  Principal components analysis of sampled functions , 1986 .

[44]  James O. Ramsay,et al.  Functional Data Analysis , 2005 .