Partial least squares regression and projection on latent structure regression (PLS Regression)

Partial least squares (PLS) regression (a.k.a. projection on latent structures) is a recent technique that combines features from and generalizes principal component analysis (PCA) and multiple linear regression. Its goal is to predict a set of dependent variables from a set of independent variables or predictors. This prediction is achieved by extracting from the predictors a set of orthogonal factors called latent variables which have the best predictive power. These latent variables can be used to create displays akin to PCA displays. The quality of the prediction obtained from a PLS regression model is evaluated with cross‐validation techniques such as the bootstrap and jackknife. There are two main variants of PLS regression: The most common one separates the roles of dependent and independent variables; the second one—used mostly to analyze brain imaging data—gives the same roles to dependent and independent variables. Copyright © 2010 John Wiley & Sons, Inc.

[1]  J. Tukey,et al.  Multiple-Factor Analysis , 1947 .

[2]  M. H. Quenouille NOTES ON BIAS IN ESTIMATION , 1956 .

[3]  N. L. Johnson,et al.  Multivariate Analysis , 1958, Nature.

[4]  Ledyard R Tucker,et al.  Determination of parameters of a functional relation by factor analysis , 1958 .

[5]  R. C. Durfee,et al.  MULTIPLE FACTOR ANALYSIS. , 1967 .

[6]  Jean-Pierre Antoine,et al.  Functional Integration , 1980, Springer US.

[7]  W. Hays Applied Regression Analysis. 2nd ed. , 1981 .

[8]  G. Grisetti,et al.  Further Reading , 1984, IEEE Spectrum.

[9]  B. Efron,et al.  The Jackknife: The Bootstrap and Other Resampling Plans. , 1983 .

[10]  R. Gittins,et al.  Canonical Analysis: A Review with Applications in Ecology , 1985 .

[11]  B. Efron The jackknife, the bootstrap, and other resampling plans , 1987 .

[12]  A. Höskuldsson PLS regression methods , 1988 .

[13]  C. Fornell,et al.  The cooperative venture formation process: a latent variable structural modeling approach , 1990 .

[14]  J. Graham,et al.  An Empirical Comparison of Soviet and American Business Negotiations , 1992 .

[15]  I. Wakeling,et al.  A test of significance for partial least squares regression , 1993 .

[16]  S. Wold,et al.  A PLS kernel algorithm for data sets with many variables and fewer objects. Part 1: Theory and algorithm , 1994 .

[17]  P. Garthwaite An Interpretation of Partial Least Squares , 1994 .

[18]  D. Signorini,et al.  Neural networks , 1995, The Lancet.

[19]  Alison J. Burnham,et al.  Frameworks for latent variable multivariate regression , 1996 .

[20]  J. V. Haxby,et al.  Spatial Pattern Analysis of Functional Brain Images Using Partial Least Squares , 1996, NeuroImage.

[21]  A. Phatak,et al.  The geometry of partial least squares , 1997 .

[22]  K J Worsley,et al.  An overview and some new developments in the statistical analysis of PET and fMRI data , 1997, Human brain mapping.

[23]  Karl J. Friston,et al.  Human Brain Function , 1997 .

[24]  N. Draper,et al.  Applied Regression Analysis: Draper/Applied Regression Analysis , 1998 .

[25]  Sijmen de Jong,et al.  The objective function of partial least squares regression , 1998 .

[26]  John Hulland,et al.  Use of partial least squares (PLS) in strategic management research: a review of four recent studies , 1999 .

[27]  Richard F. Gunst,et al.  Applied Regression Analysis , 1999, Technometrics.

[28]  Arthur E. Hoerl,et al.  Ridge Regression: Biased Estimation for Nonorthogonal Problems , 2000, Technometrics.

[29]  A. E. Hoerl,et al.  Ridge regression: biased estimation for nonorthogonal problems , 2000 .

[30]  N. Smelser,et al.  International Encyclopedia of the Social and Behavioral Sciences , 2001 .

[31]  Svante Wold,et al.  Personal memories of the early PLS development , 2001 .

[32]  Hervé Abdi,et al.  Linear Algebra for Neural Networks , 2001 .

[33]  Michel Tenenhaus,et al.  Multiple factor analysis combined with PLS path modelling. Application to the analysis of relationships between physicochemical variables, sensory profiles and hedonic judgements , 2001 .

[34]  Agnar Höskuldsson,et al.  Weighing schemes in multivariate data analysis , 2001 .

[35]  Fred L. Bookstein,et al.  Corpus Callosum Shape and Neuropsychological Deficits in Adult Males with Heavy Fetal Alcohol Exposure , 2002, NeuroImage.

[36]  I. Jolliffe Principal Component Analysis , 2002 .

[37]  Charles K. Bayne,et al.  Multivariate Analysis of Quality: An Introduction , 2002, Technometrics.

[38]  Jean-Baptiste Poline,et al.  Multivariate Model Specification for fMRI Data , 2002, NeuroImage.

[39]  Anthony Randal McIntosh,et al.  Partial least squares analysis of neuroimaging data: applications and advances , 2004, NeuroImage.

[40]  Roman Rosipal,et al.  Overview and Recent Advances in Partial Least Squares , 2005, SLSFS.

[41]  H. Abdi Discriminant Correspondence Analysis , 2006 .

[42]  Hervé Abdi,et al.  Singular Value Decomposition ( SVD ) and Generalized Singular Value Decomposition ( GSVD ) , 2006 .

[43]  Neil Salkind Encyclopedia of Measurement and Statistics , 2006 .

[44]  M. Forina,et al.  Multivariate calibration. , 2007, Journal of chromatography. A.

[45]  H. Abdi The RV coefficient and the congruence coefficient , 2007 .

[46]  M. Kenward,et al.  An Introduction to the Bootstrap , 2007 .

[47]  Natasa Kovacevic,et al.  Groupwise independent component decomposition of EEG data and partial least square analysis , 2007, NeuroImage.

[48]  Gereon R. Fink,et al.  fMRI Data Predict Individual Differences of Behavioral Effects of Nicotine: A Partial Least Square Analysis , 2007, Journal of Cognitive Neuroscience.

[49]  Sophie Achard The Statistical Analysis of Functional MRI Data , 2008 .

[50]  Hervé Abdi,et al.  Diffusion tensor tractography of traumatic diffuse axonal injury. , 2008, Archives of neurology.

[51]  Theo K. Dijkstra,et al.  Handbook of partial least squares. Concepts, methods and applications in marketing and related fields , 2008 .

[52]  Agnar Höskuldsson,et al.  Modelling procedures for directed network of data blocks , 2009 .

[53]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[54]  Trevor S. Smart,et al.  The Statistical Analysis of Functional MRI Data , 2010 .