Pretreatments by means of orthogonal projections

Abstract This article describes several linear pretreatments based on orthogonal projections. The main differences of these pretreatments lie in the way the information to be removed are identified, using calibration dataset, pure spectra, experimental designs or mathematical models. Removing all the undesired spectral information yields spectra proportional to the net analyte signal, so it is important to collect the most complete information possible, using the complementarities of different approaches. The correction should then be processed with a single Euclidian orthogonal projection that gathers all the information, rather than with successive operations. By embedding Euclidian orthogonal projections into the calibration, it is not necessary to reapply them to new datasets.

[1]  Tom Fearn,et al.  Error removal by orthogonal subtraction (EROS): a customised pre‐treatment for spectroscopic data , 2008 .

[2]  J. Roger,et al.  EPO–PLS external parameter orthogonalisation of PLS application to temperature-independent measurement of sugar content of intact fruits , 2003 .

[3]  Frans van den Berg,et al.  Review of the most common pre-processing techniques for near-infrared spectra , 2009 .

[4]  Tom Fearn,et al.  Transfer by orthogonal projection: making near-infrared calibrations robust to between-instrument variation , 2004 .

[5]  Age K. Smilde,et al.  Direct orthogonal signal correction , 2001 .

[6]  Jean-Michel Roger,et al.  Dynamic orthogonal projection. A new method to maintain the on-line robustness of multivariate calibrations. Application to NIR-based monitoring of wine fermentations , 2006 .

[7]  D. Kell,et al.  An introduction to wavelet transforms for chemometricians: A time-frequency approach , 1997 .

[8]  Avraham Lorber,et al.  Net analyte signal calculation in multivariate calibration , 1997 .

[9]  D. Massart,et al.  The Mahalanobis distance , 2000 .

[10]  Desire L. Massart,et al.  Optimization of signal denoising in discrete wavelet transform , 1999 .

[11]  Desire L. Massart,et al.  Noise suppression and signal compression using the wavelet packet transform , 1997 .

[12]  Roberto Kawakami Harrop Galvão,et al.  Optimal wavelet filter construction using X and Y data , 2004 .

[13]  Martin Andersson,et al.  A comparison of nine PLS1 algorithms , 2009 .

[14]  P. Geladi,et al.  Linearization and Scatter-Correction for Near-Infrared Reflectance Spectra of Meat , 1985 .

[15]  S. Wold,et al.  Orthogonal signal correction of near-infrared spectra , 1998 .

[16]  Tom Fearn,et al.  On orthogonal signal correction , 2000 .

[17]  Jean-Michel Roger,et al.  Improvement of calibration models using two successive orthogonal projection methods. Application to quantification of wine mannoproteins , 2007 .

[18]  Rasmus Bro,et al.  Orthogonal signal correction, wavelet analysis, and multivariate calibration of complicated process fluorescence data , 2000 .

[19]  Alejandro C. Olivieri,et al.  A comparison of orthogonal signal correction and net analyte preprocessing methods. Theoretical and experimental study , 2001 .

[20]  Vincent Mazet,et al.  Background removal from spectra by designing and minimising a non-quadratic cost function , 2005 .

[21]  Kristian Hovde Liland,et al.  Optimal Choice of Baseline Correction for Multivariate Calibration of Spectra , 2010, Applied spectroscopy.

[22]  Rasmus Bro,et al.  Theory of net analyte signal vectors in inverse regression , 2003 .

[23]  R. Barnes,et al.  Standard Normal Variate Transformation and De-Trending of Near-Infrared Diffuse Reflectance Spectra , 1989 .

[24]  J. Macgregor,et al.  An investigation of orthogonal signal correction algorithms and their characteristics , 2002 .

[25]  S. Wold,et al.  PLS regression on wavelet compressed NIR spectra , 1998 .

[26]  P. L. Odell,et al.  Constructing projections on sums and intersections , 1999 .

[27]  Henri S. Tapp,et al.  OPLS filtered data can be obtained directly from non‐orthogonalized PLS1 , 2009 .

[28]  Chein-I Chang,et al.  Hyperspectral image classification and dimensionality reduction: an orthogonal subspace projection approach , 1994, IEEE Trans. Geosci. Remote. Sens..

[29]  R. J. Barnes,et al.  Correction to the Description of Standard Normal Variate (SNV) and De-Trend (DT) Transformations in Practical Spectroscopy with Applications in Food and Beverage Analysis—2nd Edition , 1993 .

[30]  Chein-I Chang,et al.  Unsupervised interference rejection approach to target detection and classification for hyperspectral imagery , 1998 .

[31]  Tom Fearn,et al.  Orthogonal Signal Correction , 1999 .

[32]  Per Waaben Hansen.  Pre‐processing method minimizing the need for reference analyses , 2001 .

[33]  Olof Svensson,et al.  An evaluation of orthogonal signal correction applied to calibration transfer of near infrared spectra , 1998 .

[34]  S. Wold,et al.  Orthogonal projections to latent structures (O‐PLS) , 2002 .

[35]  J. Mo,et al.  Baseline correction by improved iterative polynomial fitting with automatic threshold , 2006 .

[36]  Jean-Michel Roger,et al.  Robust calibration using orthogonal projection and experimental design. Application to the correction of the light scattering effect on turbid NIR spectra , 2008 .

[37]  S. Wold,et al.  The Collinearity Problem in Linear Regression. The Partial Least Squares (PLS) Approach to Generalized Inverses , 1984 .

[38]  R. Bonner,et al.  Application of wavelet transforms to experimental spectra : Smoothing, denoising, and data set compression , 1997 .

[39]  H. Martens,et al.  Extended multiplicative signal correction and spectral interference subtraction: new preprocessing methods for near infrared spectroscopy. , 1991, Journal of pharmaceutical and biomedical analysis.

[40]  Nicolaas M. Faber,et al.  Net analyte signal calculation for multivariate calibration , 2003 .

[41]  Wei Li,et al.  A background elimination method based on wavelet transform for Raman spectra , 2007 .