Automatic Parameter Optimization for Support Vector Regression for Land and Sea Surface Temperature Estimation From Remote Sensing Data

Land surface temperature (LST) and sea surface temperature (SST) are important quantities for many environmental models. Remote sensing is a source of information for their estimation on both regional and global scales. Many algorithms have been devised to estimate LST and SST from satellite data, most of which require a priori information about the surface and the atmosphere. A recently proposed approach involves the use of support vector machines (SVMs). Based on satellite data and corresponding in situ measurements, they generate an approximation of the relation between them, which can subsequently be used to estimate unknown surface temperatures from additional satellite data. Such a strategy requires the user to set several internal parameters. In this paper, a method is proposed for automatically setting these parameters to quasi-optimal values in the sense of minimum estimation errors. This is achieved by minimizing a functional correlated to regression errors (i.e., the ldquospan-boundrdquo upper bound on the leave-one-out (LOO) error) which can be computed by using only the training set, without need for a further validation set. In order to minimize this functional, Powell's algorithm is adopted, since it is applicable also to nondifferentiable functions. Experimental results yielded by the proposed method are similar in accuracy to those achieved by cross-validation and by a grid search for the parameter configuration which yields the best test-set accuracy. However, the proposed method gives a dramatic reduction in the computational time required, particularly when many training samples are available.

[1]  D. Anderson,et al.  Algorithms for minimization without derivatives , 1974 .

[2]  Sayan Mukherjee,et al.  Choosing Multiple Parameters for Support Vector Machines , 2002, Machine Learning.

[3]  Bruno O. Shubert,et al.  Random variables and stochastic processes , 1979 .

[4]  Chih-Jen Lin,et al.  Working Set Selection Using Second Order Information for Training Support Vector Machines , 2005, J. Mach. Learn. Res..

[5]  Chih-Jen Lin,et al.  Radius Margin Bounds for Support Vector Machines with the RBF Kernel , 2002, Neural Computation.

[6]  Farid Melgani,et al.  Semisupervised PSO-SVM Regression for Biophysical Parameter Estimation , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[7]  S. Sathiya Keerthi,et al.  Evaluation of simple performance measures for tuning SVM hyperparameters , 2003, Neurocomputing.

[8]  M. J. D. Powell,et al.  An efficient method for finding the minimum of a function of several variables without calculating derivatives , 1964, Comput. J..

[9]  Fabio Castelli,et al.  Mapping of Land-Atmosphere Heat Fluxes and Surface Parameters with Remote Sensing Data , 2003 .

[10]  José A. Sobrino,et al.  Toward remote sensing methods for land cover dynamic monitoring: Application to Morocco , 2000 .

[11]  William H. Press,et al.  Numerical recipes in C , 2002 .

[12]  Nello Cristianini,et al.  Kernel Methods for Pattern Analysis , 2003, ICTAI.

[13]  Carlo Ulivieri,et al.  A split window algorithm for estimating land surface temperature from satellites , 1994 .

[14]  Leonardo F. Peres,et al.  Inverse problems theory and application: analysis of the two-temperature method for land-surface temperature and emissivity estimation , 2004, IEEE Geoscience and Remote Sensing Letters.

[15]  Giorgio Boni,et al.  Sampling strategies and assimilation of ground temperature for the estimation of surface energy balance components , 2001, IEEE Trans. Geosci. Remote. Sens..

[16]  H. Fischer,et al.  Land surface temperature and emissivity estimation from passive sensor data: Theory and practice-current trends , 2002 .

[17]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[18]  Gabriele Moser,et al.  Partially Supervised classification of remote sensing images through SVM-based probability density estimation , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[19]  J.T. Kwok,et al.  Linear Dependency betweenand the Input Noise in -Support Vector Regression , 2001 .

[20]  V. Vapnik,et al.  Bounds on Error Expectation for Support Vector Machines , 2000, Neural Computation.

[21]  Junbin Gao,et al.  A Probabilistic Framework for SVM Regression and Error Bar Estimation , 2002, Machine Learning.

[22]  Ming-Wei Chang,et al.  Leave-One-Out Bounds for Support Vector Regression Model Selection , 2005, Neural Computation.

[23]  Athanasios Papoulis,et al.  Probability, Random Variables and Stochastic Processes , 1965 .

[24]  Yunqian Ma,et al.  Practical selection of SVM parameters and noise estimation for SVM regression , 2004, Neural Networks.

[25]  S. Durbha,et al.  Support vector machines regression for retrieval of leaf area index from multiangle imaging spectroradiometer , 2007 .

[26]  Thorsten Joachims,et al.  Estimating the Generalization Performance of an SVM Efficiently , 2000, ICML.

[27]  Ian J. Barton,et al.  Satellite-derived Sea Surface Temperatures-A Comparison between Operational, Theoretical, and Experimental Algorithms , 1992 .

[28]  L. Arboledas,et al.  A comparative study of algorithms for estimating land surface temperature from AVHRR Data , 1997 .

[29]  José A. Sobrino,et al.  Land surface temperature estimation from AVHRR thermal infrared measurements: An assessment for the AVHRR Land Pathfinder II data set , 2002 .

[30]  J. Vazquez,et al.  NOAA/NASA AVHRR Oceans Pathfinder Sea Surface Temperature Data Set User''s Reference Manual , 1998 .

[31]  Leonardo F. Peres,et al.  Emissivity maps to retrieve land-surface temperature from MSG/SEVIRI , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Gabriele Moser,et al.  Land Surface Temperature Estimation from Passive Satellite Images using Support Vector Machines , 2006, 2006 IEEE International Symposium on Geoscience and Remote Sensing.

[33]  Juan C. Jiménez-Muñoz,et al.  Feasibility of Retrieving Land-Surface Temperature From ASTER TIR Bands Using Two-Channel Algorithms: A Case Study of Agricultural Areas , 2007, IEEE Geoscience and Remote Sensing Letters.

[34]  Steven Lazarus,et al.  A MODIS Sea Surface Temperature Composite for Regional Applications , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[35]  W. Pichel,et al.  Deriving the operational nonlinear multichannel sea surface temperature algorithm coefficients for NOAA-15 AVHRR/3 , 2001 .

[36]  Leonardo F. Peres,et al.  Improving two-temperature method retrievals based on a nonlinear optimization approach , 2006, IEEE Geoscience and Remote Sensing Letters.

[37]  José Luis Rojo-Álvarez,et al.  Robust support vector regression for biophysical variable estimation from remotely sensed images , 2006, IEEE Geoscience and Remote Sensing Letters.

[38]  Gustavo Camps-Valls,et al.  Retrieval of oceanic chlorophyll concentration with relevance vector machines , 2006 .

[39]  A-Xing Zhu,et al.  Prediction of Continental-Scale Evapotranspiration by Combining MODIS and AmeriFlux Data Through Support Vector Machine , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[40]  Jeffrey L. Privette,et al.  Evaluation of Split-Window Land Surface Temperature Algorithms for Generating Climate Data Records , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[41]  Aarnout Brombacher,et al.  Probability... , 2009, Qual. Reliab. Eng. Int..

[42]  Wenjian Wang An Incremental Learning Strategy for Support Vector Regression , 2004, Neural Processing Letters.

[43]  Nello Cristianini,et al.  On the eigenspectrum of the gram matrix and the generalization error of kernel-PCA , 2005, IEEE Transactions on Information Theory.

[44]  J. El-Kharraz,et al.  Single-channel and two-channel methods for land surface temperature retrieval from DAIS data and its application to the Barrax site , 2004 .

[45]  William B. Clodius,et al.  The performance of the multispectral thermal imager (MTI) surface temperature retrieval algorithm at three sites , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[46]  Christopher J. Merchant,et al.  Retrieval of Sea Surface Temperature from Space, Based on Modeling of Infrared Radiative Transfer: Capabilities and Limitations , 2004 .

[47]  Peter L. Bartlett,et al.  Rademacher and Gaussian Complexities: Risk Bounds and Structural Results , 2003, J. Mach. Learn. Res..

[48]  James T. Kwok Linear Dependency between epsilon and the Input Noise in epsilon-Support Vector Regression , 2001, ICANN.

[49]  Jeffrey L. Privette,et al.  Directional effects in a daily AVHRR land surface temperature dataset over Africa , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[50]  Hansong Zhang,et al.  Gacv for support vector machines , 2000 .

[51]  Wei Chu,et al.  Bayesian support vector regression using a unified loss function , 2004, IEEE Transactions on Neural Networks.

[52]  Rachel T. Pinker,et al.  Case study of soil moisture effect on land surface temperature retrieval , 2004, IEEE Geoscience and Remote Sensing Letters.

[53]  R. Brent Table errata: Algorithms for minimization without derivatives (Prentice-Hall, Englewood Cliffs, N. J., 1973) , 1975 .

[54]  Elie Bienenstock,et al.  Neural Networks and the Bias/Variance Dilemma , 1992, Neural Computation.

[55]  Bo-Cai Gao,et al.  A comparison of MODIS, NCEP, and TMI sea surface temperature datasets , 2005, IEEE Geosci. Remote. Sens. Lett..

[56]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1996, Springer Berlin Heidelberg.

[57]  Bernhard Schölkopf,et al.  GACV for Support Vector Machines , 2000 .

[58]  Lorenzo Bruzzone,et al.  Robust multiple estimator systems for the analysis of biophysical parameters from remotely sensed data , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[59]  Thorsten Joachims,et al.  Making large scale SVM learning practical , 1998 .

[60]  Jiancheng Shi,et al.  A Neural Network Technique for Separating Land Surface Emissivity and Temperature From ASTER Imagery , 2008, IEEE Transactions on Geoscience and Remote Sensing.