Latent Variables and Indices: Herman Wold’s Basic Design and Partial Least Squares

In this chapter it is shown that the PLS-algorithms typically converge if the covariance matrix of the indicators satisfies (approximately) the “basic design”, a factor analysis type of model. The algorithms produce solutions to fixed point equations; the solutions are smooth functions of the sample covariance matrix of the indicators. If the latter matrix is asymptotically normal, the PLS-estimators will share this property. The probability limits, under the basic design, of the PLS-estimators for loadings, correlations, multiple R’s, coefficients of structural equations et cetera will differ from the true values. But the difference is decreasing, tending to zero, in the “quality” of the PLS estimators for the latent variables. It is indicated how to correct for the discrepancy between true values and the probability limits. We deemphasize the “normality”-issue in discussions about PLS versus ML: in employing either method one is not required to subscribe to normality; they are “just” different ways of extracting information from second-order moments.

[1]  Abraham Kaplan,et al.  Definition and Specification of Meaning , 1946 .

[2]  T. W. Anderson An Introduction to Multivariate Statistical Analysis , 1959 .

[3]  Ma. de la Natividad Jiménez Salas,et al.  The Conduct of Inquiry , 1967 .

[4]  J. Neyman,et al.  Research Papers in Statistics. Festschrift for J. Neyman F.N. David editor, assisted by E. Fix. London, New York, Sydney, J. Wiley & Sons, 1966, VIII p. 468 p., 105/–. , 1968, Recherches économiques de Louvain.

[5]  E. Copson Metric Spaces: Index , 1968 .

[6]  James M. Ortega,et al.  Iterative solution of nonlinear equations in several variables , 2014, Computer science and applied mathematics.

[7]  J. Kettenring,et al.  Canonical Analysis of Several Sets of Variables , 2022 .

[8]  J. Ord,et al.  Characterization Problems in Mathematical Statistics , 1975 .

[9]  H. Wold Path Models with Latent Variables: The NIPALS Approach , 1975 .

[10]  Calyampudi R. Rao,et al.  Characterization Problems in Mathematical Statistics , 1976 .

[11]  Taeke Klaas Dijkstra Latent variables in linear stochastic models , 1981 .

[12]  Herman Wold,et al.  Soft modelling: The Basic Design and Some Extensions , 1982 .

[13]  T. Dijkstra Some comments on maximum likelihood and partial least squares methods , 1983 .

[14]  F. R. Gantmakher The Theory of Matrices , 1984 .

[15]  J. Schmee An Introduction to Multivariate Statistical Analysis , 1986 .

[16]  Theo K. Dijkstra,et al.  On Model Uncertainty and its Statistical Implications , 1988 .

[17]  Theo K. Dijkstra,et al.  REDUCED FORM ESTIMATION, HEDGING AGAINST POSSIBLE MISSPECIFICATION , 1989 .

[18]  Eric R. Ziegel,et al.  On Model Uncertainty and Its Statistical Implications , 1990 .

[19]  M. Stone Continuum regression: Cross-validated sequentially constructed prediction embracing ordinary least s , 1990 .

[20]  Theo K. Dijkstra,et al.  Some properties of estimated scale invariant covariance structures , 1990 .

[21]  Theo K. Dijkstra,et al.  ON THE NATURE AND NUMBER OF THE CONSTRAINTS ON THE REDUCED FORM AS IMPLIED BY THE STRUCTURAL FORM , 1990 .

[22]  T. Dijkstra,et al.  On statistical inference with parameter estimates on the boundary of the parameter space , 1992 .

[23]  J. Friedman,et al.  A Statistical View of Some Chemometrics Regression Tools , 1993 .

[24]  J. Friedman,et al.  [A Statistical View of Some Chemometrics Regression Tools]: Response , 1993 .

[25]  Tom Wansbeek,et al.  Identification, Equivalent Models, and Computer Algebra , 1994 .

[26]  Seymour Geisser,et al.  8. Predictive Inference: An Introduction , 1995 .

[27]  H. Schneeweiß,et al.  Factor Analysis and Principal Components , 1995 .

[28]  Nanny Wermuth,et al.  Multivariate Dependencies: Models, Analysis and Interpretation , 1996 .

[29]  R. P. McDonald,et al.  Path Analysis with Composite Variables. , 1996, Multivariate behavioral research.

[30]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[31]  Michel Tenenhaus,et al.  PLS path modeling , 2005, Comput. Stat. Data Anal..