Partial least squares algorithms and methods

Partial least squares (PLS) refers to a set of iterative algorithms based on least squares that implement a broad spectrum of both explanatory and exploratory multivariate techniques, from regression to path modeling, and from principal component to multi-block data analysis. This article focuses on PLS regression and PLS path modeling, which are PLS approaches to regularized regression and to predictive path modeling. The computational flows and the optimization criteria of these methods are reviewed in detail, as well as the tools for the assessment and interpretation of PLS models. The most recent developments and some of the most promising on going researches are enhanced. WIREs Comput Stat 2013, 5:1–19. doi: 10.1002/wics.1239

[1]  J. Friedman,et al.  A Statistical View of Some Chemometrics Regression Tools , 1993 .

[2]  K. Jöreskog.  A general method for analysis of covariance structures , 1970 .

[3]  A. Tenenhaus,et al.  Regularized Generalized Canonical Correlation Analysis , 2011, Eur. J. Oper. Res..

[4]  H. Hotelling.  Relations Between Two Sets of Variates , 1936 .

[5]  Jérôme Pagès,et al.  Multiple factor analysis (AFMULT package) , 1994 .

[6]  I. Jolliffe.  A Note on the Use of Principal Components in Regression , 1982 .

[7]  Nicole Krämer,et al.  Analysis of High Dimensional Data with Partial Least Squares and Boosting , 2007 .

[8]  A. L. V. D. Wollenberg.  Redundancy analysis an alternative for canonical correlation analysis , 1977 .

[9]  Stan Lipovetsky,et al.  Identifying critical success factors in defense development projects: A multivariate analysis , 1996 .

[10]  S. Geisser.  A predictive approach to the random effect model , 1974 .

[11]  Wynne W. Chin,et al.  Handbook of Partial Least Squares , 2010 .

[12]  Mohamed Hanafi,et al.  PLS Path modelling: computation of latent variables with the estimation mode B , 2007, Comput. Stat..

[13]  Paul Horst,et al.  Relations amongm sets of measures , 1961 .

[14]  Jörg Henseler,et al.  On the convergence of the partial least squares path modeling algorithm , 2010, Comput. Stat..

[15]  J. Kettenring,et al.  Canonical Analysis of Several Sets of Variables , 2022 .

[16]  Giorgio Russolillo,et al.  Non-Metric Partial Least Squares , 2012 .

[17]  S. Wold,et al.  PLS-regression: a basic tool of chemometrics , 2001 .

[18]  Roman Rosipal,et al.  Overview and Recent Advances in Partial Least Squares , 2005, SLSFS.

[19]  F. Bookstein,et al.  Two Structural Equation Models: LISREL and PLS Applied to Consumer Exit-Voice Theory: , 1982 .

[20]  H. Wold.  Path Models with Latent Variables: The NIPALS Approach , 1975 .

[21]  Masashi Sugiyama,et al.  The Degrees of Freedom of Partial Least Squares Regression , 2010, 1002.4112.

[22]  F. Bookstein,et al.  Neurobehavioral effects of prenatal alcohol: Part II. Partial least squares analysis. , 1989, Neurotoxicology and teratology.

[23]  H. Wold.  Causal flows with latent variables: Partings of the ways in the light of NIPALS modelling , 1974 .

[24]  Gastón Sánchez Trujillo.  Pathmox approach: segmentation trees in partial least squares path modeling , 2009 .

[25]  C. Fornell,et al.  Evaluating structural equation models with unobservable variables and measurement error. , 1981 .

[26]  A. Höskuldsson.  PLS regression methods , 1988 .

[27]  R. J. Ball,et al.  The Significance of Simultaneous Methods of Parameter Estimation in Econometric Models , 1963 .

[28]  S. Keleş,et al.  Sparse partial least squares regression for simultaneous dimension reduction and variable selection , 2010, Journal of the Royal Statistical Society. Series B, Statistical methodology.

[29]  P. Garthwaite.  An Interpretation of Partial Least Squares , 1994 .

[30]  Frazer.  Elementary Matrices: Frontmatter , 1938 .

[31]  S. Wold,et al.  The Collinearity Problem in Linear Regression. The Partial Least Squares (PLS) Approach to Generalized Inverses , 1984 .

[32]  Michel Tenenhaus,et al.  PLS path modeling , 2005, Comput. Stat. Data Anal..

[33]  L. Tucker.  An inter-battery method of factor analysis , 1958 .