How to build a robust model against perturbation factors with only a few reference values: A chemometric challenge at 'Chimiométrie 2007'

Abstract Following up on the success of previous chemometric challenges arranged during the annual congress organised by the French Chemometrics Society, the organisation committee decided to repeat the idea for the Chimiometrie 2007 event ( http://www.chimiometrie.org/ ) held in Lyon, France (29–30 November) by featuring another dataset on its website. As for the first contest in 2004, this dataset was selected to test the ability of participants to apply regression methods to NIR data. The aim of Challenge 2007 was to perform a calibration model as robust and precise as possible using a data set with only a few reference values available and submitted to different perturbation factors. The committee received nine answers; this paper summarizes the best three approaches, as well as the approach proposed by the organisers.

[1]  Jean-Michel Roger,et al.  Robust calibration using orthogonal projection and experimental design. Application to the correction of the light scattering effect on turbid NIR spectra , 2008 .

[2]  Desire L. Massart,et al.  Comparison of semirobust and robust partial least squares procedures , 1995 .

[3]  Pierre Dardenne,et al.  A NIR data set is the object of a chemometric contest at ‘Chimiométrie 2004’ , 2006 .

[4]  J. Roger,et al.  Robustness of models developed by multivariate calibration. Part II: The influence of pre-processing methods , 2005 .

[5]  J. Pierna,et al.  Soil parameter quantification by NIRS as a Chemometric challenge at ‘Chimiométrie 2006’ , 2008 .

[6]  H. J. H. Macfie,et al.  A robust PLS procedure , 1992 .

[7]  Pierre Dardenne,et al.  Chemometric contest at ‘Chimiométrie 2005’: A discrimination study , 2007 .

[8]  Véronique Bellon-Maurel,et al.  Robustness of models developed by multivariate calibration. Part I: The assessment of robustness , 2004 .

[9]  Peter Filzmoser,et al.  Partial robust M-regression , 2005 .

[10]  Daniel Peña,et al.  A robust partial least squares regression method with applications , 2009 .

[11]  J. Roger,et al.  EPO–PLS external parameter orthogonalisation of PLS application to temperature-independent measurement of sugar content of intact fruits , 2003 .

[12]  Da-W Gu,et al.  Robust Control Design with MATLAB® (Advanced Textbooks in Control and Signal Processing) , 2005 .

[13]  Petko H. Petkov,et al.  Robust control design with MATLAB , 2005 .

[14]  P. A. Gorry.  General least-squares smoothing and differentiation by the convolution (Savitzky-Golay) method , 1990 .

[15]  Peter Filzmoser,et al.  Robust and classical PLS regression compared , 2010 .

[16]  Robert P. Cogdill,et al.  Least-Squares Support Vector Machines for Chemometrics: An Introduction and Evaluation , 2004 .

[17]  R. Barnes,et al.  Standard Normal Variate Transformation and De-Trending of Near-Infrared Diffuse Reflectance Spectra , 1989 .

[18]  T. Næs,et al.  The Effect of Multiplicative Scatter Correction (MSC) and Linearity Improvement in NIR Spectroscopy , 1988 .

[19]  S. Wold,et al.  Orthogonal signal correction of near-infrared spectra , 1998 .

[20]  Rasmus Bro,et al.  Jack-knife technique for outlier detection and estimation of standard errors in PARAFAC models , 2003 .

[21]  Tom Fearn,et al.  Transfer by orthogonal projection: making near-infrared calibrations robust to between-instrument variation , 2004 .

[22]  Y. Heyden,et al.  Robust statistics in data analysis — A review: Basic concepts , 2007 .