Using Kernel Methods in a Learning Machine Approach for Multispectral Data Classification. An Application in Agriculture

Most pattern recognition applications within the Geoscience field involve the clustering and classification of remote sensed multispectral data, which basically aims to allocate the right class of ground category to a reflectance or radiance signal. Generally, the complexity of this problem is related to the incorporation of spatial characteristics that are complementary to the nonlinearities of land surface heterogeneity, remote sensing effects and multispectral features. The present chapter describes recent developments in the performance of a kernel method applied to the representation and classification of agricultural land use systems described by multispectral responses. In particular, we focus on the practical applicability of learning machine methods to the task of inducting a relationship between the spectral response of farms land cover to their informational typology from a representative set of instances. Such methodologies are not traditionally used in agricultural studies. Nevertheless, the list of references reviewed here show that its applications have emerged very fast and are leading to simple and theoretically robust classification models. This chapter will cover the following phases: a)learning from instances in agriculture; b)feature extraction of both multispectral and attributive data and; c) kernel supervised classification. The first provides the conceptual foundations and a historical perspective of the field. The second belongs to the unsupervised learning field, which mainly involves the appropriate description of input data in a lower dimensional space. The last is a method based on statistical learning theory, which has been successfully applied to supervised classification problems and to generate models described by implicit functions.

[1]  N. Goel Models of vegetation canopy reflectance and their use in estimation of biophysical parameters from reflectance data , 1988 .

[2]  Alexander Siegmund,et al.  Automatic land cover analysis for Tenerife by supervised classification using remotely sensed data , 2003 .

[3]  B. Wylie,et al.  Satellite mapping of surface biophysical parameters at the biome scale over the North American grasslands a case study , 2002 .

[4]  S. C. Johnson Hierarchical clustering schemes , 1967, Psychometrika.

[5]  Robert P. W. Duin,et al.  Support vector domain description , 1999, Pattern Recognit. Lett..

[6]  Lorenzo Bruzzone,et al.  A Support Vector Domain Description Approach to Supervised Classification of Remote Sensing Images , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[7]  R. Myneni,et al.  A Three-Dimensional Radiative Transfer Method for Optical Remote Sensing of Vegetated Land Surfaces , 1991, [Proceedings] IGARSS'91 Remote Sensing: Global Monitoring for Earth Management.

[8]  David G. Stork,et al.  Pattern Classification (2nd ed.) , 1999 .

[9]  Marvin Minsky,et al.  Perceptrons: An Introduction to Computational Geometry , 1969 .

[10]  H. Hotelling Analysis of a complex of statistical variables into principal components. , 1933 .

[11]  R. Palmer,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[12]  R. Fisher THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[13]  Lorenzo Bruzzone,et al.  Classification of hyperspectral remote sensing images with support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Claude B. Courbois,et al.  Livestock to 2020: The Next Food Revolution , 2001 .

[15]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[16]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[17]  Julia A. Barsi,et al.  Landsat TM and ETM+ thermal band calibration , 2003, SPIE Optics + Photonics.

[18]  J. H. Ward Hierarchical Grouping to Optimize an Objective Function , 1963 .

[19]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[20]  José Alí Moreno,et al.  The Kernel Hopfield Memory Network , 2004, ACRI.

[21]  Shun-ichi Amari,et al.  A Theory of Pattern Recognition , 1968 .

[22]  Holger Wendland,et al.  Kernel techniques: From machine learning to meshless methods , 2006, Acta Numerica.

[23]  J. Campbell Introduction to remote sensing , 1987 .

[24]  Saburou Saitoh,et al.  Theory of Reproducing Kernels and Its Applications , 1988 .

[25]  A-Xing Zhu,et al.  Developing a continental-scale measure of gross primary production by combining MODIS and AmeriFlux data through Support Vector Machine approach , 2007 .

[26]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[27]  C. Woodcock,et al.  Classification and Change Detection Using Landsat TM Data: When and How to Correct Atmospheric Effects? , 2001 .

[28]  Anthony Widjaja,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2003, IEEE Transactions on Neural Networks.

[29]  Andy Field,et al.  Discovering statistics using SPSS, 2nd ed. , 2005 .

[30]  C. Sere,et al.  World livestock production systems. Current status, issues and trends , 1995 .

[31]  Bernhard E. Boser,et al.  A training algorithm for optimal margin classifiers , 1992, COLT '92.

[32]  S. Hay,et al.  The potential of Pathfinder AVHRR data for providing surrogate climatic variables across Africa and Europe for epidemiological applications. , 2002, Remote sensing of environment.

[33]  David G. Stork,et al.  Pattern Classification , 1973 .

[34]  M. J. Milán,et al.  STRUCTURAL CHARACTERISATION AND TYPOLOGY OF BEEF CATTLE FARMS OF SPANISH WOODED RANGELANDS (DEHESAS) , 2006 .

[35]  Scott J. Goetz,et al.  Effects of orbital drift on land surface temperature measured by AVHRR thermal sensors , 2002 .

[36]  Joachim M. Buhmann,et al.  Support vector machines for land usage classification in Landsat TM imagery , 1999, IEEE 1999 International Geoscience and Remote Sensing Symposium. IGARSS'99 (Cat. No.99CH36293).

[37]  J. A. López del Val,et al.  Principal Components Analysis , 2018, Applied Univariate, Bivariate, and Multivariate Statistics Using Python.

[38]  John A. Dixon,et al.  Farming Systems and Poverty IMPROVING FARMERS' LIVELIHOODS IN A CHANGING WORLD , 2001 .

[39]  Guobin Zhu,et al.  Classification using ASTER data and SVM algorithms;: The case study of Beer Sheva, Israel , 2002 .

[40]  J. Díez,et al.  Identifying market segments in beef: Breed, slaughter weight and ageing time implications. , 2006, Meat science.

[41]  Cristina Garc,et al.  The Hopfield Associative Memory Network: Improving Performance with the Kernel "Trick" , 2004 .

[42]  Andy P. Field,et al.  Discovering Statistics Using SPSS , 2000 .

[43]  M. Aizerman,et al.  Theoretical Foundations of the Potential Function Method in Pattern Recognition Learning , 1964 .

[44]  N. L. Johnson,et al.  Multivariate Analysis , 1958, Nature.

[45]  J. Mercer Functions of Positive and Negative Type, and their Connection with the Theory of Integral Equations , 1909 .

[46]  Marcos Dipinto,et al.  Discriminant analysis , 2020, Predictive Analytics.

[47]  Tahir Rehman,et al.  Typification of farming systems for constructing representative farm models: two illustrations of the application of multi-variate analyses in Chile and Pakistan , 2003 .

[48]  Koby Crammer,et al.  Pranking with Ranking , 2001, NIPS.

[49]  W. Rees Physical Principles of Remote Sensing , 1990 .

[50]  John A. Richards,et al.  Remote Sensing Digital Image Analysis , 1986 .

[51]  Nello Cristianini,et al.  Kernel Methods for Pattern Analysis , 2004 .

[52]  S. Drury Image interpretation in geology , 1987 .

[53]  L. S. Davis,et al.  An assessment of support vector machines for land cover classi(cid:142) cation , 2002 .

[54]  Farid Melgani,et al.  Toward an Optimal SVM Classification System for Hyperspectral Remote Sensing Images , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[55]  Alexander J. Smola,et al.  Learning with kernels , 1998 .

[56]  G. Dunteman Principal Components Analysis , 1989 .

[57]  John A. Dixon,et al.  Farming systems and poverty , 2001 .

[58]  Vladimir Cherkassky,et al.  The Nature Of Statistical Learning Theory , 1997, IEEE Trans. Neural Networks.

[59]  Pedro M. Domingos,et al.  On the Optimality of the Simple Bayesian Classifier under Zero-One Loss , 1997, Machine Learning.

[60]  Nello Cristianini,et al.  The Kernel-Adatron : A fast and simple learning procedure for support vector machines , 1998, ICML 1998.

[61]  Jerzy Kostrowicki,et al.  Agricultural typology concept and method , 1977 .

[62]  R. Dubayah Estimating net solar radiation using Landsat Thematic Mapper and digital elevation data , 1992 .

[63]  Jeff Dozier,et al.  EOS : science strategy for the Earth Observing System , 1994 .

[64]  José Alí Moreno,et al.  Kernel Based Method for Segmentation and Modeling of Magnetic Resonance Images , 2004, IBERAMIA.

[65]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[66]  F ROSENBLATT,et al.  The perceptron: a probabilistic model for information storage and organization in the brain. , 1958, Psychological review.

[67]  Giles M. Foody,et al.  Toward intelligent training of supervised image classifications: directing training data acquisition for SVM classification , 2004 .

[68]  Bas Eickhout,et al.  Exploring changes in world ruminant production systems , 2005 .

[69]  D. Jupp,et al.  Using covariates to spatially interpolate moisture availability in the Murray–Darling Basin: A novel use of remotely sensed data , 2002 .

[70]  Debra P. C. Peters,et al.  Support vector machines for recognition of semi-arid vegetation types using MISR multi-angle imagery , 2007 .

[71]  I. Duvernoy Use of a land cover model to identify farm types in the Misiones agrarian frontier (Argentina) , 2000 .

[72]  S. Drury Image interpretation in Geology. 3rd edition , 2001 .

[73]  齋藤 三郎,et al.  Theory of reproducing kernels and its applications , 1988 .

[74]  José Alí Moreno,et al.  Supervised farm classification from remote sensing images based on kernel adatron algorithm , 2007, 2007 IEEE International Geoscience and Remote Sensing Symposium.

[75]  Lotfi A. Zadeh,et al.  Fuzzy Logic , 2009, Encyclopedia of Complexity and Systems Science.

[76]  C. Berg,et al.  Harmonic Analysis on Semigroups , 1984 .

[77]  Jean-Philippe Gastellu-Etchegorry,et al.  Recovery of forest canopy characteristics through inversion of a complex 3D model , 2002 .

[78]  Shigeo Abe DrEng Pattern Classification , 2001, Springer London.

[79]  Edit J. Kaminsky,et al.  Neural network classification of remote-sensing data , 1995 .

[80]  David W. Hosmer,et al.  Applied Logistic Regression , 1991 .

[81]  J. Hair Multivariate data analysis , 1972 .

[82]  N. Aronszajn Theory of Reproducing Kernels. , 1950 .

[83]  Michael Biehl,et al.  The AdaTron: An Adaptive Perceptron Algorithm , 1989 .

[84]  Christopher K. I. Williams Prediction with Gaussian Processes: From Linear Regression to Linear Prediction and Beyond , 1999, Learning in Graphical Models.

[85]  Alan H. Strahler,et al.  The Use of Prior Probabilities in Maximum Likelihood Classification , 1980 .

[86]  José Alí Moreno,et al.  The Hopfield Associative Memory Network: Improving Performance with the Kernel "Trick" , 2004, IBERAMIA.

[87]  Bernhard Schölkopf,et al.  Nonlinear Component Analysis as a Kernel Eigenvalue Problem , 1998, Neural Computation.