International Conference on Information Systems ( ICIS ) 2010 CONSTRUCT VALIDITY IN PARTIAL LEAST SQUARES PATH MODELING

Partial least squares path modeling (PLS) has seen increased use in the information systems research community. One of the stated key advantages of PLS is that it weights the indicator variables based on the strength of the relationship between the indicators and the underlying constructs, which presumably decreases the effect of measurement error in the analysis results. In this paper we argue that this assumption is not valid. While PLS indeed does weight the indicators to maximize the explained variance, it does this by including error variance in the model thus reducing construct validity. We use a simulation study of a simple PLS model to show that when compared to traditional sum scale approach, PLS estimates are actually often less valid. Although our study has its limitations, it hints that the use of PLS as a theory testing tool should be reevaluated and that more research testing the effectiveness of the PLS approach is in order.

[1]  T. Dijkstra.  Some comments on maximum likelihood and partial least squares methods , 1983 .

[2]  Herman Wold,et al.  Soft modelling: The Basic Design and Some Extensions , 1982 .

[3]  Rex B. Kline,et al.  Principles and Practice of Structural Equation Modeling , 1998 .

[4]  Wynne W. Chin,et al.  A Partial Least Squares Latent Variable Modeling Approach for Measuring Interaction Effects: Results from a Monte Carlo Simulation Study and an Electronic - Mail Emotion/Adoption Study , 2003, Inf. Syst. Res..

[5]  Jane M. Howell,et al.  Personal Computing: Toward a Conceptual Model of Utilization , 1991, MIS Q..

[6]  Detmar W. Straub,et al.  Structural Equation Modeling and Regression: Guidelines for Research Practice , 2000, Commun. Assoc. Inf. Syst..

[7]  Scott B. MacKenzie,et al.  Common method biases in behavioral research: a critical review of the literature and recommended remedies. , 2003, The Journal of applied psychology.

[8]  Wynne W. Chin.  How to Write Up and Report PLS Analyses , 2010 .

[9]  F. Bookstein,et al.  Two Structural Equation Models: LISREL and PLS Applied to Consumer Exit-Voice Theory , 1982 .

[10]  Herman Wold,et al.  Systems under indirect observation : causality, structure, prediction , 1982 .

[11]  A. Kaplan,et al.  A Beginner's Guide to Partial Least Squares Analysis , 2004 .

[12]  Wynne W. Chin.  The partial least squares approach for structural equation modeling. , 1998 .

[13]  Deborah Compeau,et al.  Assessing Between-Group Differences in Information Systems Research: A Comparison of Covariance-and Component-Based SEM , 2009, MIS Q..

[14]  Joseph O. Rentz.  Generalizability Theory: A Comprehensive Method for Assessing and Improving the Dependability of Marketing Measures , 1987 .

[15]  Ronald T. Cenfetelli,et al.  Interpretation of Formative Measurement in Information Systems Research , 2009, MIS Q..

[16]  C. Fornell.  A Second generation of multivariate analysis : classification of methods and implications for marketing research , 1985 .

[17]  Donald B. Rubin,et al.  The Dependability of Behavioral Measurements: Theory of Generalizability for Scores and Profiles. , 1974 .

[18]  Carol Saunders,et al.  PLS: A Silver Bullet? , 2006 .

[19]  Herman Wold,et al.  Model Construction and Evaluation When Theoretical Knowledge Is Scarce , 1980 .

[20]  Paul A. Pavlou,et al.  Institution-Based Trust in Interorganizational Exchange Relationships: The Role of Online B2B Marketplaces on Trust Formation , 2002, J. Strateg. Inf. Syst..

[21]  D. Borsboom,et al.  The Theoretical Status of Latent Variables , 2003 .

[22]  Wynne W. Chin.  Issues and Opinion on Structural Equation Modeling by , 2009 .

[23]  Wynne W. Chin.  Bootstrap Cross-Validation Indices for PLS Path Model Assessment , 2010 .

[24]  Pamela Paxton.  TEACHER ’ S CORNER Monte Carlo Experiments : Design and Implementation , 2001 .

[25]  David Gefen,et al.  Structural Equation Modeling Techniques and Regression: Guidelines for Research Practice , 2000 .

[26]  R. P. McDonald,et al.  Path Analysis with Composite Variables. , 1996, Multivariate behavioral research.

[27]  Eva Nick,et al.  The dependability of behavioral measurements: theory of generalizability for scores and profiles , 1973 .

[28]  F. Bookstein,et al.  Two Structural Equation Models: LISREL and PLS Applied to Consumer Exit-Voice Theory: , 1982 .

[29]  Wynne W. Chin,et al.  A critical look at partial least squares modeling , 2009 .

[30]  Rudolf R. Sinkovics,et al.  The Use of Partial Least Squares Path Modeling in International Marketing , 2009 .

[31]  Kenneth A. Bollen,et al.  Monte Carlo Experiments: Design and Implementation , 2001 .

[32]  Bryan Dawson,et al.  Method Effects, Measurement Error, and Substantive Conclusions , 2010 .

[33]  J. Wilcox,et al.  Reconsidering formative measurement. , 2007, Psychological methods.