Calibration transfer based on the weight matrix (CTWM) of PLS for near infrared (NIR) spectral analysis

Calibration transfer is of great necessity for practical applications of near infrared (NIR) spectroscopy, since the original calibration model would become invalid when spectra are measured on different instruments or under different detection conditions. In the calibration transfer method of spectral space transformation (SST) that has shown excellent performance in practice, loadings of PCA have been proven to contain important information about differences between different instruments. Just like the loadings of PCA, the weight matrix of PLS contains much information, including the weights of absorbance at different wavelengths for each PLS factor. In this study, two new calibration transfer methods based on the weight matrix (CTWM) of partial least squares (PLS) were proposed. CTWM1 uses PLS to build a linear regression model between the secondary spectra of standardization samples and the low-dimensional information extracted from the primary spectra of standardization samples using the weight matrix of the original calibration model. CTWM2 retains the weight matrix but uses ordinary least squares (OLS) to update the y-weight vector using the secondary spectra and property values of standardization samples. CTWM1 can be applied to the occasion when both the primary and secondary spectra of standardization samples can be obtained, while CTWM2 can be applied to the occasion when the primary spectra of standardization samples cannot be obtained but the observed property values can be. The only parameter in CTWM1 and CTWM2 is the number of latent variables selected in the weight matrix and it can be set to a reasonable value according to the number of standardization samples and the number of latent variables selected in the original primary calibration model, which means that CTWM1 and CTWM2 have the advantage of easy implementation and are practical for calibration transfer. The performance of CTWM1 and CTWM2 has been tested on two NIR datasets. Compared with slope and bias correction (SBC), spectral space transformation (SST) and piecewise direct standardization (PDS), CTWM1 shows good performance and can give reliable and accurate results. Compared with recalibration using standardization samples, CTWM2 shows good performance when the difference in instrument responses is relatively small.

[1]  Xueguang Shao,et al.  Rapid and nondestructive analysis of pharmaceutical products using near-infrared diffuse reflectance spectroscopy. , 2012, Journal of pharmaceutical and biomedical analysis.

[2]  John H. Kalivas,et al.  Overview of two‐norm (L2) and one‐norm (L1) Tikhonov regularization variants for full wavelength or sparse spectral multivariate calibration models or maintenance , 2012 .

[3]  Ji Haibo,et al.  Near-infrared calibration transfer via support vector machine and transfer learning , 2015 .

[4]  R. Yu,et al.  Systematic prediction error correction: a novel strategy for maintaining the predictive abilities of multivariate calibration models. , 2011, The Analyst.

[5]  Bruce R. Kowalski,et al.  Weighting schemes for updating regression models—a theoretical approach , 1999 .

[6]  R. Yu,et al.  Maintaining the predictive abilities of multivariate calibration models by spectral space transformation. , 2011, Analytica chimica acta.

[7]  A. Ferrer,et al.  Dealing with missing data in MSPC: several methods, different interpretations, some examples , 2002 .

[8]  Erik Andries,et al.  Calibration Maintenance and Transfer Using Tikhonov Regularization Approaches , 2009, Applied spectroscopy.

[9]  Qin Xiong,et al.  Sampling error profile analysis (SEPA) for model optimization and model evaluation in multivariate calibration , 2018 .

[10]  Abel Folch-Fortuny,et al.  Missing Data Imputation Toolbox for MATLAB , 2016 .

[11]  Yan Liu,et al.  Linear model correction: A method for transferring a near-infrared multivariate calibration model without standard samples. , 2016, Spectrochimica acta. Part A, Molecular and biomolecular spectroscopy.

[12]  Desire L. Massart,et al.  Improvement of the piecewise direct standardisation procedure for the transfer of NIR spectra for multivariate calibration , 1996 .

[13]  Susan L. Rose-Pehrsson,et al.  Rapid Fuel Quality Surveillance Through Chemometric Modeling of Near-Infrared Spectra , 2009 .

[14]  W. Cai,et al.  Outlier detection in near-infrared spectroscopic analysis by using Monte Carlo cross-validation , 2008 .

[15]  Y. Roggo,et al.  A review of near infrared spectroscopy and chemometrics in pharmaceutical technologies. , 2007, Journal of pharmaceutical and biomedical analysis.

[16]  S. Wold,et al.  The Collinearity Problem in Linear Regression. The Partial Least Squares (PLS) Approach to Generalized Inverses , 1984 .

[17]  B. Kowalski,et al.  Improvement of multivariate calibration through instrument standardization , 1992 .

[18]  Xueguang Shao,et al.  Correcting Multivariate Calibration Model for near Infrared Spectral Analysis without Using Standard Samples , 2015 .

[19]  Alberto Ferrer,et al.  Calibration transfer between NIR spectrometers: New proposals and a comparative study , 2017 .

[20]  Yi-Zeng Liang,et al.  Calibration transfer via an extreme learning machine auto-encoder. , 2016, The Analyst.

[21]  Biao Huang,et al.  Recursive Wavelength-Selection Strategy to Update Near-Infrared Spectroscopy Model with an Industrial Application , 2013 .

[22]  Ainara López,et al.  A review of the application of near-infrared spectroscopy for the analysis of potatoes. , 2013, Journal of agricultural and food chemistry.

[23]  Gerard Downey,et al.  Feasibility study on the use of visible-near-infrared spectroscopy for the screening of individual and total glucosinolate contents in broccoli. , 2012, Journal of agricultural and food chemistry.

[24]  Marcelo Blanco,et al.  NIR spectroscopy: a rapid-response analytical tool , 2002 .

[25]  Abel Folch-Fortuny,et al.  PLS model building with missing data: New algorithms and a comparative study , 2017 .

[26]  Erik Andries,et al.  Impact of standardization sample design on Tikhonov regularization variants for spectroscopic calibration maintenance and transfer , 2010 .

[27]  S. Wold,et al.  PLS-regression: a basic tool of chemometrics , 2001 .

[28]  Ruoqiu Zhang,et al.  Sampling Error Profile Analysis for calibration transfer in multivariate calibration , 2017 .

[29]  Xueguang Shao,et al.  Standardization of near infrared spectra measured on multi-instrument. , 2014, Analytica chimica acta.

[30]  M. Räsänen,et al.  Development and validation of a near-infrared method for the quantitation of caffeine in intact single tablets. , 2003, Analytical chemistry.

[31]  B. Kowalski,et al.  Multivariate instrument standardization , 1991 .

[32]  Ting Wu,et al.  A new strategy of least absolute shrinkage and selection operator coupled with sampling error profile analysis for wavelength selection , 2018 .

[33]  Yizeng Liang,et al.  Calibration model transfer for near-infrared spectra based on canonical correlation analysis. , 2008, Analytica chimica acta.

[34]  Beata Walczak,et al.  Selection and weighting of samples in multivariate regression model updating , 2005 .

[35]  Alberto Ferrer,et al.  Framework for regression‐based missing data imputation methods in on‐line MSPC , 2005 .

[36]  Dong-Sheng Cao,et al.  A new strategy of outlier detection for QSAR/QSPR , 2009, J. Comput. Chem..

[37]  Zhenqi Shi,et al.  Scattering orthogonalization of near-infrared spectra for analysis of pharmaceutical tablets. , 2009, Analytical chemistry.

[38]  A. Ferrer,et al.  PCA model building with missing data: New proposals and a comparative study , 2015 .

[39]  P. Gemperline,et al.  Appearance of discontinuities in spectra transformed by the piecewise direct instrument standardization procedure. , 1996, Analytical chemistry.

[40]  D. Massart,et al.  Standardization of near-infrared spectrometric instruments , 1996 .

[41]  Parviz Shahbazikhah,et al.  A consensus modeling approach to update a spectroscopic calibration , 2013 .

[42]  Yi Wang,et al.  A dual model strategy to transfer multivariate calibration models for near-infrared spectral analysis , 2016 .

[43]  Yi-Zeng Liang,et al.  Calibration transfer of near‐infrared spectra for extraction of informative components from spectra with canonical correlation analysis , 2014 .

[44]  A. Höskuldsson PLS regression methods , 1988 .

[45]  Yi-Zeng Liang,et al.  Monte Carlo cross validation , 2001 .