Framework for explicit drift correction in multivariate calibration models

Latent‐variable calibrations using principal component regression and partial least‐squares regression are often compromised by drift such as systematic disturbances and offsets. This paper presents a two‐step framework that facilitates the evaluation and comparison of explicit drift‐correction methods. In the first step, the drift subspace is estimated using different types of correction data in a master/slave setting. The correction data are measured for the slave with drift and computed for the master with no drift. In the second step, the original calibration data are corrected for the estimated drift subspace using shrinkage or orthogonal projection. The two cases of no correction and drift correction by orthogonal projection can be seen as special cases of shrinkage. The two‐step framework is illustrated with four different experimental data sets. The first three examples study drift correction on one instrument (temperature effects, spectral differences between samples obtained from different plants, instrumental drift), while the fourth example studies calibration transfer between two instruments. Copyright © 2010 John Wiley & Sons, Ltd.

[1]  Rasmus Bro,et al.  Pre‐whitening of data by covariance‐weighted pre‐processing , 2003 .

[2]  Avraham Lorber,et al.  Net analyte signal calculation in multivariate calibration , 1997 .

[3]  J. Roger,et al.  EPO–PLS external parameter orthogonalisation of PLS application to temperature-independent measurement of sugar content of intact fruits , 2003 .

[4]  Jianguo Sun,et al.  Statistical analysis of NIR data: data pretreatment , 1997 .

[5]  Gerrit Kateman,et al.  A Kalman filter for calibration, evaluation of unknown samples and quality control in drifting systems : Part 1. Theory and Simulations , 1984 .

[6]  Furong Gao,et al.  Process similarity and developing new process models through migration , 2009 .

[7]  David M. Haaland,et al.  New Classical Least-Squares/Partial Least-Squares Hybrid Algorithm for Spectral Analyses , 2001 .

[8]  A K Smilde,et al.  Influence of temperature on vibrational spectra and consequences for the predictive ability of multivariate models. , 1998, Analytical chemistry.

[9]  Dominique Bonvin,et al.  Drift correction in multivariate calibration models using on-line reference measurements. , 2009, Analytica chimica acta.

[10]  Barry M. Wise,et al.  Development and Benchmarking of Multivariate Statistical Process Control Tools for a Semiconductor Etch Process: Improving Robustness through Model Updating , 1997 .

[11]  Per Waaben Hansen Pre‐processing method minimizing the need for reference analyses , 2001 .

[12]  Tormod Næs,et al.  Low-Cost Approaches to Robust Temperature Compensation in Near-Infrared Calibration and Prediction Situations , 2005, Applied spectroscopy.

[13]  Tom Fearn,et al.  Transfer by orthogonal projection: making near-infrared calibrations robust to between-instrument variation , 2004 .

[14]  Michal Dabros,et al.  On-Line Recalibration of Spectral Measurements Using Metabolite Injections and Dynamic Orthogonal Projection , 2007, Applied spectroscopy.

[15]  Fuli Wang,et al.  A Robust Calibration Modeling Strategy for Analysis of Interference-Subject Spectral Data , 2009 .

[16]  Desire L. Massart,et al.  A comparison of multivariate calibration techniques applied to experimental NIR data sets. Part III: Robustness against instrumental perturbation conditions , 2004 .

[17]  M. Sjöström,et al.  Drift correction for gas sensors using multivariate methods , 2000 .

[18]  Steven D. Brown The Kalman filter in analytical chemistry , 1986 .

[19]  E. Martin,et al.  Gaussian process regression for multivariate spectroscopic calibration , 2007 .

[20]  T. Næs,et al.  Ensemble methods and data augmentation by noise addition applied to the analysis of spectroscopic data , 2005 .

[21]  Bogdan Gabrys,et al.  Data-driven Soft Sensors in the process industry , 2009, Comput. Chem. Eng..

[22]  Tom Fearn,et al.  Error removal by orthogonal subtraction (EROS): a customised pre‐treatment for spectroscopic data , 2008 .

[23]  Jean-Michel Roger,et al.  Dynamic orthogonal projection. A new method to maintain the on-line robustness of multivariate calibrations. Application to NIR-based monitoring of wine fermentations , 2006 .

[24]  L. Buydens,et al.  Comparing support vector machines to PLS for spectral regression applications , 2004 .

[25]  M. P. Callao,et al.  Strategy for introducing NIR spectroscopy and multivariate calibration techniques in industry , 2003 .

[26]  Tormod Næs,et al.  A user-friendly guide to multivariate calibration and classification , 2002 .

[27]  Peter D. Wentzell,et al.  Estimation of hydrocarbon types in light gas oils and diesel fuels by ultraviolet absorption spectroscopy and multivariate calibration , 1999 .

[28]  David M. Haaland,et al.  New Prediction-Augmented Classical Least-Squares (PACLS) Methods: Application to Unmodeled Interferents , 2000 .