Research Note - Partial Least Squares and Models with Formatively Specified Endogenous Constructs: A Cautionary Note

Information systems researchers have recently begun to propose models that include formatively specified constructs, and largely rely on partial least squares PLS to estimate the parameters of interest in those models. In this research, we focus on those cases where the formatively specified constructs are endogenous to other constructs in the research model in addition to their own manifest indicators, which are quite common in published research in the discipline, and analyze whether PLS is a valid statistical technique for estimating those models. Although there is evidence that covariance-based approaches can accurately estimate them, this is the first research that examines whether PLS can indeed do so. Through a theoretical analysis based on the inner workings of the PLS algorithm, which is later validated and extended through a series of Monte Carlo simulations, we conclude that is not the case. Specifically, estimates obtained from PLS are capturing something other than the relationship of interest when the formatively specified constructs are endogenous to others in the model. We show how our results apply more generally to a class of models, and discuss implications for future research practice.

[1]  InduShobha N. Chengalur-Smith,et al.  An Empirical Analysis of the Business Value of Open Source Infrastructure Technologies , 2010, J. Assoc. Inf. Syst..

[2]  Fred D. Davis,et al.  Developing and Validating an Observational Learning Model of Computer Software Training and Skill Acquisition , 2003, Inf. Syst. Res..

[3]  Paul Brown,et al.  Organizational Assimilation of Electronic Procurement Innovations , 2009, J. Manag. Inf. Syst..

[4]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[5]  Mayuram S. Krishnan,et al.  From Association to Causation via a Potential Outcomes Approach , 2009, Inf. Syst. Res..

[6]  Jacob Cohen,et al.  Problems in the Measurement of Latent Variables in Structural Equations Causal Models , 1990 .

[7]  Jeffrey R. Edwards,et al.  The Fallacy of Formative Measurement , 2011 .

[8]  Kenneth A. Bollen,et al.  Evaluating Effect, Composite, and Causal Indicators in Structural Equation Models , 2011, MIS Q..

[9]  J. Elashoff,et al.  Multiple Regression in Behavioral Research. , 1975 .

[10]  Qing Hu,et al.  Assimilation of Enterprise Systems: The Effect of Institutional Pressures and the Mediating Role of Top Management , 2007, MIS Q..

[11]  Richard D. Johnson,et al.  The Evolving Nature of the Computer Self-Efficacy Construct: An Empirical Investigation of Measurement Construction, Validity, Reliability and Stability Over Time , 2007, J. Assoc. Inf. Syst..

[12]  Arun Rai,et al.  Interfirm Strategic Information Flows in Logistics Supply Chain Relationships , 2009, MIS Q..

[13]  Kenneth L. Kraemer,et al.  Migration to Open-Standard Interorganizational Systems: Network Effects, Switching Costs, and Path Dependency , 2005, MIS Q..

[14]  R. Lennox,et al.  Conventional wisdom on measurement: A structural equation perspective. , 1991 .

[15]  Todd D. Little,et al.  A Non-arbitrary Method of Identifying and Scaling Latent Variables in SEM and MACS Models , 2006 .

[16]  Jonathan Whitaker,et al.  Organizational Learning and Capabilities for Onshore and Offshore Business Process Outsourcing , 2010, J. Manag. Inf. Syst..

[17]  C. Schriesheim Causal Analysis: Assumptions, Models, and Data , 1982 .

[18]  Jukka Ylitalo,et al.  International Conference on Information Systems ( ICIS ) 2010 CONSTRUCT VALIDITY IN PARTIAL LEAST SQUARES PATH MODELING , 2017 .

[19]  Paul Benjamin Lowry,et al.  The CMC Interactivity Model: How Interactivity Enhances Communication Quality and Process Satisfaction in Lean-Media Groups , 2009, J. Manag. Inf. Syst..

[20]  Xitao Fan,et al.  TEACHER'S CORNER: Using SAS for Monte Carlo Simulation Research in SEM , 2005 .

[21]  Omar El Sawy,et al.  Absorptive Capacity Configurations in Supply Chains: Gearing for Partner-Enabled Market Knowledge Creation , 2005, MIS Q..

[22]  Jan-Bernd Lohmöller,et al.  Latent Variable Path Modeling with Partial Least Squares , 1989 .

[23]  Jörg Henseler,et al.  On the convergence of the partial least squares path modeling algorithm , 2010, Comput. Stat..

[24]  Wynne W. Chin Issues and Opinion on Structural Equation Modeling by , 2009 .

[25]  Heeseok Lee,et al.  The Impact of Information Technology and Transactive Memory Systems on Knowledge Sharing, Application, and Team Performance: A Field Study , 2010, MIS Q..

[26]  Cheryl Burke Jarvis,et al.  The problem of measurement model misspecification in behavioral and organizational research and some recommended solutions. , 2005, The Journal of applied psychology.

[27]  George M. Marakas,et al.  Revisiting Bias Due to Construct Misspecification: Different Results from Considering Coefficients in Standardized Form , 2012, MIS Q..

[28]  Venkataraman Ramesh,et al.  Web and Wireless Site Usability: Understanding Differences and Modeling Use , 2006, MIS Q..

[29]  Izak Benbasat,et al.  Trust-Assuring Arguments in B2C E-commerce: Impact of Content, Source, and Price on Trust , 2009, J. Manag. Inf. Syst..

[30]  L. G. Pee,et al.  Knowledge Sharing in Information Systems Development: A Social Interdependence Perspective , 2010, J. Assoc. Inf. Syst..

[31]  Herman Wold,et al.  Soft modelling: The Basic Design and Some Extensions , 1982 .

[32]  Richard D. Johnson,et al.  Formative vs. Reflective Measurement: A Reply to Hardin, Chang, and Fuller , 2008, J. Assoc. Inf. Syst..

[33]  Charalambos L. Iacovou,et al.  Selective Status Reporting in Information Systems Projects: A Dyadic-Level Investigation , 2009, MIS Q..

[34]  Cheryl Burke Jarvis,et al.  A Critical Review of Construct Indicators and Measurement Model Misspecification in Marketing and Consumer Research , 2003 .

[35]  R. MacCallum,et al.  The use of causal indicators in covariance structure models: some practical issues. , 1993, Psychological bulletin.

[36]  K. Bollen Multiple indicators: Internal consistency or no necessary relationship? , 1984 .

[37]  Weidong Xia,et al.  Toward Agile: An Integrated Analysis of Quantitative and Qualitative Field Data , 2010, MIS Q..

[38]  H. Winklhofer,et al.  Index Construction with Formative Indicators: An Alternative to Scale Development , 2001 .

[39]  Moez Limayem,et al.  How Habit Limits the Predictive Power of Intention: The Case of Information Systems Continuance , 2007, MIS Q..

[40]  Ronald T. Cenfetelli,et al.  Interpretation of Formative Measurement in Information Systems Research , 2009, MIS Q..

[41]  E. F. Jackson,et al.  Multiple Indicators in Survey Research , 1962, American Journal of Sociology.

[42]  J. Elashoff,et al.  Multiple Regression in Behavioral Research. , 1974 .

[43]  Kai H. Lim,et al.  Web strategies to promote internet shopping: is cultural-customization needed? , 2009 .

[44]  Detmar W. Straub,et al.  Specifying Formative Constructs in Information Systems Research , 2007, MIS Q..

[45]  Brian Fitzgerald,et al.  From Peer Production to Productization: A Study of Socially Enabled Business Exchanges in Open Source Service Networks , 2008, Inf. Syst. Res..

[46]  Varun Grover,et al.  Investigating Two Contradictory Views of Formative Measurement in Information Systems Research , 2010, MIS Q..