Relevance vector machines for multivariate calibration purposes

The introduction of support vector regression (SVR) and least square support vector machines (LS‐SVM) methods for regression purposes in the field of chemometrics has provided advantageous alternatives to the existing linear and nonlinear multivariate calibration (MVC) approaches. Relevance vector machines (RVMs) claim the advantages attributed to all the SVM‐based methods over many other regression methods. Additionally, it also exhibits advantages over the standard SVM‐based ones since: it is not necessary to estimate the error/margin trade‐off parameter C and the insensitivity parameter ε in regression tasks, it is applicable to arbitrary basis functions, the algorithm gives probability estimates seamlessly and offer, additionally, excellent sparseness capabilities, which can result in a simple and robust model for the estimation of different properties. This paper presents the use of RVMs as a nonlinear MVC method capable of dealing with ill‐posed problems. To study its behavior, three different chemometric benchmark datasets are considered, including both linear and non‐linear solutions. RVM was compared with other calibration approaches reported in the literature. Although RVM performance is comparable with the best results obtained by LS‐SVM, the final model achieved is sparser, so the prediction process is faster. Taking into account the other advantages attributed to RVMs, it can be concluded that this technique can be seen as a very promising option to solve nonlinear problems in MVC. Copyright © 2008 John Wiley & Sons, Ltd.

[1]  A. Belousov,et al.  Applicational aspects of support vector machines , 2002 .

[2]  Michael E. Tipping,et al.  Analysis of Sparse Bayesian Learning , 2001, NIPS.

[3]  Michel Verleysen,et al.  Mutual information for the selection of relevant variables in spectrometric nonlinear modelling , 2006, ArXiv.

[4]  H. Swierenga.  Robust multivariate calibration models in vibrational spectroscopic applications , 2000 .

[5]  Lutgarde M. C. Buydens,et al.  Using support vector machines for time series prediction , 2003 .

[6]  M. Dyrby,et al.  Chemometric Quantitation of the Active Substance (Containing C≡N) in a Pharmaceutical Tablet Using Near-Infrared (NIR) Transmittance and NIR FT-Raman Spectra , 2002 .

[7]  D. Massart,et al.  Mutlivariate calibration with Raman data using fast principal component regression and partial least squares methods , 2001 .

[8]  Michael E. Tipping.  The Relevance Vector Machine , 1999, NIPS.

[9]  L. Buydens,et al.  Comparing support vector machines to PLS for spectral regression applications , 2004 .

[10]  L. Buydens,et al.  Multivariate calibration with least-squares support vector machines. , 2004, Analytical chemistry.

[11]  E. Martin,et al.  Gaussian process regression for multivariate spectroscopic calibration , 2007 .

[12]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[13]  A K Smilde,et al.  Influence of temperature on vibrational spectra and consequences for the predictive ability of multivariate models. , 1998, Analytical chemistry.

[14]  David J. C. MacKay,et al.  Bayesian Interpolation , 1992, Neural Computation.

[15]  J. Berger.  Statistical Decision Theory and Bayesian Analysis , 1988 .

[16]  Ron Wehrens,et al.  Wavelength selection with Tabu Search , 2003 .

[17]  George Eastman House,et al.  Sparse Bayesian Learning and the Relevance Vector Machine , 2001 .

[18]  Michael E. Tipping,et al.  Fast Marginal Likelihood Maximisation for Sparse Bayesian Models , 2003 .

[19]  A. Belousov,et al.  A flexible classification approach with optimal generalisation performance: support vector machines , 2002 .