Editor's comments: a critical look at the use of PLS-SEM in MIS quarterly

Wold’s (1974; 1982) partial least squares structural equation modeling (PLS-SEM) ap-proach and the advanced PLS-SEM algorithms by Lohmoller (Lohmoller 1989) have enjoyed steady popularity as a key multivariate analysis methods in management infor-mation systems (MIS) research (Gefen et al. 2011). Chin’s (1998b) scholarly work and technology acceptance model (TAM) applications (e.g., Gefen and Straub 1997) are milestones that helped to reify PLS-SEM in MIS research. In light of the proliferation of SEM techniques, Gefen et al. (2011), updating Gefen et al. (2000), presented a compre-hensive, organized, and contemporary summary of the minimum reporting requirements for SEM applications. Such guidelines are of crucial importance for advancing research for several reasons. First, researchers wishing to apply findings from prior studies or wanting to contribute to original research must comprehend other researchers’ decisions in order to under-stand the robustness of their findings. Likewise, when studies arrive at significantly different results, the natural course is to attempt explaining the differences in terms of the theory or concept employed, the empirical data used, and how the research method was applied. A lack of clarity on these issues, including the methodological applications, contradicts the goals of such studies (Jackson et al. 2009). Even worse, the misapplication of a technique may result in misinterpretations of empirical outcomes and, hence, false conclusions. Against this background, rigorous research has a long-standing tradition of critically reviewing prior practices of reporting standards and research method use (e.g., Boudreau et al. 2001). While the use of covariance-based SEM (CB-SEM) techniques has been well documented across disciplines (e.g., Medsker et al. 1994; Shook et al. 2004; Steenkamp and Baumgartner 2000), few reviews to date have investigated usage practices specific to PLS-SEM (see, however, Gefen et al. 2000). Previous reviews of such research practices were restricted to strategic management (Hulland 1999) and, more recently, marketing (Hair et al. 2012; Henseler et al. 2009), and accounting (Lee et al. 2011). The question arises as to how authors publishing in top IS journals such as MIS Quarterly have used PLS-SEM thus far, given the SEM recommendations of Gefen et al. (2011). By relating Gefen et al.’s (2011) reporting guidelines to actual practice, we attempt to identify potential problematic areas in PLS-SEM use, problems which may explain some of the criticism of how it has been applied (e.g., Marcoulides et al. 2009; Marcoulides and Saunders 2006). By reviewing previous PLS-SEM research in MIS Quarterly, we can hopefully increase awareness of established reporting standards. The results allow researchers to further improve the already good reporting practices that have been established in MIS Quarterly and other top journals and thus could become blueprints for conducting PLS-SEM analysis in other disciplines such as strategic management and marketing.

[1]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[2]  S. Geisser A predictive approach to the random effect model , 1974 .

[3]  H. Wold Causal flows with latent variables: Partings of the ways in the light of NIPALS modelling , 1974 .

[4]  M. Stone Cross‐Validatory Choice and Assessment of Statistical Predictions , 1976 .

[5]  T. Cook,et al.  Quasi-experimentation: Design & analysis issues for field settings , 1979 .

[6]  P. Shrout Quasi-experimentation: Design and analysis issues for field settings: by Thomas D. Cook and Donald T. Campbell. Chicago: Rand McNally, 1979 , 1980 .

[7]  Herman Wold,et al.  Soft modelling: The Basic Design and Some Extensions , 1982 .

[8]  T. Dijkstra Some comments on maximum likelihood and partial least squares methods , 1983 .

[9]  Robert Tibshirani,et al.  Bootstrap Methods for Standard Errors, Confidence Intervals, and Other Measures of Statistical Accuracy , 1986 .

[10]  Jan-Bernd Lohmöller,et al.  Latent Variable Path Modeling with Partial Least Squares , 1989 .

[11]  Detmar W. Straub,et al.  Validating Instruments in MIS Research , 1989, MIS Q..

[12]  Jacob Cohen,et al.  A power primer. , 1992, Psychological bulletin.

[13]  Gina J. Medsker,et al.  A Review of Current Practices for Evaluating Causal Models in Organizational Behavior and Human Resources Management Research , 1994 .

[14]  Magid Igbaria,et al.  Work Experiences, Job Involvement, and Quality of Work Life Among Information Systems Personnel , 1994, MIS Q..

[15]  Deborah Compeau,et al.  Computer Self-Efficacy: Development of a Measure and Initial Test , 1995, MIS Q..

[16]  Christian Homburg,et al.  Applications of structural equation modeling in marketing and consumer research: A review , 1996 .

[17]  J. P. Wanous,et al.  Overall job satisfaction: how good are single-item measures? , 1997, The Journal of applied psychology.

[18]  Detmar W. Straub,et al.  Gender Differences in the Perception and Use of E-Mail: An Extension to the Technology Acceptance Model , 1997, MIS Q..

[19]  Magid Igbaria,et al.  Personal Computing Acceptance Factors in Small Firms: A Structural Equation Model , 1997, MIS Q..

[20]  Wynne W. Chin Issues and Opinion on Structural Equation Modeling by , 2009 .

[21]  Wynne W. Chin The partial least squares approach for structural equation modeling. , 1998 .

[22]  Detmar W. Straub,et al.  Production and Transaction Economies and IS Outsourcing: A Study of the U.S. Banking Industry , 1998, MIS Q..

[23]  P. Hackl,et al.  Robustness of partial least-squares method for estimating latent variable quality structures , 1999 .

[24]  Detmar W. Straub,et al.  Information Technology Adoption Across Time: A Cross-Sectional Comparison of Pre-Adoption and Post-Adoption Beliefs , 1999, MIS Q..

[25]  John Hulland,et al.  Use of partial least squares (PLS) in strategic management research: a review of four recent studies , 1999 .

[26]  Deborah Compeau,et al.  Social Cognitive Theory and Individual Reactions to Computing Technology: A Longitudinal Study , 1999, MIS Q..

[27]  Hans Baumgartner,et al.  On the use of structural equation models for marketing modeling , 2000 .

[28]  Viswanath Venkatesh,et al.  Why Don't Men Ever Stop to Ask for Directions? Gender, Social Influence, and Their Role in Technology Acceptance and Usage Behavior , 2000, MIS Q..

[29]  Thiagarajan Ravichandran,et al.  Quality Management in Systems Development: An Organizational System Perspective , 2000, MIS Q..

[30]  A Pingsmann,et al.  Sample size and statistical power. , 2000, The Journal of bone and joint surgery. American volume.

[31]  Elena Karahanna,et al.  Time Flies When You're Having Fun: Cognitive Absorption and Beliefs About Information Technology Usage , 2000, MIS Q..

[32]  Sid L. Huff,et al.  CIO lateral influence behaviors: gaining peers' commitment to strategic information systems , 2000, ICIS.

[33]  David Gefen,et al.  Structural Equation Modeling Techniques and Regression: Guidelines for Research Practice , 2000 .

[34]  Barbara Wixom,et al.  An Empirical Investigation of the Factors Affecting Data Warehousing Success , 2001, MIS Q..

[35]  Youngjin Yoo,et al.  Media and Group Cohesion: Relative Influences on Social Presence, Task Participation, and Group Consensus , 2001, MIS Q..

[36]  D. G. Morrison,et al.  Do We Really Need Multiple-Item Measures in Service Research? , 2001 .

[37]  H. Winklhofer,et al.  Index Construction with Formative Indicators: An Alternative to Scale Development , 2001 .

[38]  Detmar W. Straub,et al.  Validation in Information Systems Research: A State-of-the-Art Assessment , 2001, MIS Q..

[39]  Robert W. Zmud,et al.  Inducing Sensitivity to Deception in Order to Improve Decision Making Performance: A Field Study , 2002, MIS Q..

[40]  Vallabh Sambamurthy,et al.  Shaping UP for E-Commerce: Institutional Enablers of the Organizational Assimliation of Web Technologies , 2002, MIS Q..

[41]  Jason Bennett Thatcher,et al.  An Empirical Examination of Individual Traits as Antecedents to Computer Anxiety and Computer Self-Efficacy , 2002, MIS Q..

[42]  Vallabh Sambamurthy,et al.  Sources of Influence on Beliefs about Information Technolgoy Use: An Empirical Study of Knowledge Workers , 2003, MIS Q..

[43]  Izak Benbasat,et al.  Predicting Intention to Adopt Interorganizational Linkages: An Institutional Perspective , 2003, MIS Q..

[44]  Gordon B. Davis,et al.  User Acceptance of Information Technology: Toward a Unified View , 2003, MIS Q..

[45]  David J. Ketchen,et al.  AN ASSESSMENT OF THE USE OF STRUCTURAL EQUATION MODELING IN STRATEGIC MANAGEMENT RESEARCH , 2004 .

[46]  Y. Takane,et al.  Generalized structured component analysis , 2004 .

[47]  Izak Benbasat,et al.  Business Competence of Information Technology Professionals: Conceptual Development and Influence on IT-Business Partnerships , 2004, MIS Q..

[48]  Anol Bhattacherjee,et al.  Understanding Changes in Belief and Attitude Toward Information Technology Usage: A Theoretical Model and Longitudinal Test , 2004, MIS Q..

[49]  Detmar W. Straub,et al.  Validation Guidelines for IS Positivist Research , 2004, Commun. Assoc. Inf. Syst..

[50]  Samer Faraj,et al.  Why Should I Share? Examining Social Capital and Knowledge Contribution in Electronic Networks of Practice , 2005, MIS Q..

[51]  Detmar W. Straub,et al.  A Practical Guide To Factorial Validity Using PLS-Graph: Tutorial And Annotated Example , 2005, Commun. Assoc. Inf. Syst..

[52]  Wynne W. Chin,et al.  Managing Client Dialogues During Information Systems Design to Facilitate Client Learning , 2005, MIS Q..

[53]  Jason Bennett Thatcher,et al.  Moving Beyond Intentions and Toward the Theory of Trying: Effects of Work Environment and Gender on Post-Adoption Information Technology Use , 2005, MIS Q..

[54]  William R. King,et al.  Antecedents of Knowledge Transfer from Consultants to Clients in Enterprise System Implementations , 2005, MIS Q..

[55]  Robert W. Zmud,et al.  Behavioral Intention Formation in Knowledge Sharing: Examining the Roles of Extrinsic Motivators, Social-Psychological Factors, and Organizational Climate , 2005, MIS Q..

[56]  Arun Rai,et al.  Firm performance impacts of digitally enabled supply chain integration capabilities , 2006 .

[57]  Arnold Kamis,et al.  Using an Attribute-Based Decision Support System for User-Customized Products Online: An Experimental Investigation , 2008, MIS Q..

[58]  C. Saunders,et al.  Editor's comments: PLS: a silver bullet? , 2006 .

[59]  Trevor T. Moores,et al.  Ethical Decision Making in Software Piracy: Initial Development and a Test of a Four-Component Model , 2006, MIS Q..

[60]  Carol Saunders,et al.  PLS: A Silver Bullet? , 2006 .

[61]  T. C. Edwin Cheng,et al.  Extending the Understanding of End User Information Systems Satisfaction Formation: An Equitable Needs Fulfillment Model Approach , 2008, MIS Q..

[62]  J. J. Po-An Hsieh,et al.  ScholarWorks @ Georgia State University , 2016 .

[63]  Elena Karahanna,et al.  The Relative Advantage of Electronic Channels: A Multidimensional View , 2008, MIS Q..

[64]  Anol Bhattacherjee,et al.  Influence Processes for Information Technology Acceptance: An Elaboration Likelihood Model , 2006, MIS Q..

[65]  Katherine J. Stewart,et al.  The Impact of Ideology on Effectiveness in Open Source Software Development Teams , 2006, MIS Q..

[66]  Rachna Shah,et al.  Use of structural equation modeling in operations management research: Looking back and forward ☆ , 2006 .

[67]  William Lewis,et al.  PLS, Small Sample Size, and Statistical Power in MIS Research , 2006, Proceedings of the 39th Annual Hawaii International Conference on System Sciences (HICSS'06).

[68]  Adamantios Diamantopoulos,et al.  The error term in formative measurement models: interpretation and modeling implications , 2006 .

[69]  Viswanath Venkatesh,et al.  Predicting Different Conceptualizations of System Use: The Competing Roles of Behavioral Intention, Facilitating Conditions, and Behavioral Expectation , 2008, MIS Q..

[70]  Kenneth L. Kraemer,et al.  Migration to Open-Standard Interorganizational Systems: Network Effects, Switching Costs, and Path Dependency , 2005, MIS Q..

[71]  Izak Benbasat,et al.  The Effects of Personalizaion and Familiarity on Trust and Adoption of Recommendation Agents , 2006, MIS Q..

[72]  Mark Srite,et al.  The Role of Espoused National Cultural Values in Technology Acceptance , 2006, MIS Q..

[73]  Paul A. Pavlou,et al.  Understanding and Predicting Electronic Commerce Adoption: An Extension of the Theory of Planned Behavior , 2006, MIS Q..

[74]  Elena Karahanna,et al.  Reconceptualizing Compatability Beliefs in Technology Acceptance Research , 2006, MIS Q..

[75]  Joey F. George,et al.  IT Road Warriors: Balancing Work--Family Conflict, Job Autonomy, and Work Overload to Mitigate Turnover Intentions , 2007, MIS Q..

[76]  Moez Limayem,et al.  How Habit Limits the Predictive Power of Intention: The Case of Information Systems Continuance , 2007, MIS Q..

[77]  Youngjin Yoo,et al.  The Impact of Knowledge Coordination on Virtual Team Performance Over Time , 2007, MIS Q..

[78]  Izak Benbasat,et al.  The Effects of Presentation Formats and Task Complexity on Online Consumers' Product Understanding , 2007, MIS Q..

[79]  Paul A. Pavlou,et al.  Understanding and Mitigating Uncertainty in Online Exchange Relationships: A Principal-Agent Perspective , 2007, MIS Q..

[80]  Qing Hu,et al.  Assimilation of Enterprise Systems: The Effect of Institutional Pressures and the Mediating Role of Top Management , 2007, MIS Q..

[81]  Sucheta Nadkarni,et al.  A Task-Based Model of Perceived Website Complexity , 2007, MIS Q..

[82]  Detmar W. Straub,et al.  Specifying Formative Constructs in Information Systems Research , 2007, MIS Q..

[83]  J. Rossiter,et al.  The Predictive Validity of Multiple-Item versus Single-Item Measures of the Same Constructs , 2007 .

[84]  Siegfried P. Gudergan,et al.  Confirmatory Tetrad Analysis in PLS Path Modeling , 2008 .

[85]  Adamantios Diamantopoulos,et al.  Advancing formative measurement models , 2008 .

[86]  Rajiv Kishore,et al.  The Role of Service Level Agreements in Relational Management of Information Technology Outsourcing: An Empirical Study , 2009, MIS Q..

[87]  Rudolf R. Sinkovics,et al.  The Use of Partial Least Squares Path Modeling in International Marketing , 2009 .

[88]  Arun Rai,et al.  Interfirm Strategic Information Flows in Logistics Supply Chain Relationships , 2009, MIS Q..

[89]  Deborah Compeau,et al.  Assessing Between-Group Differences in Information Systems Research: A Comparison of Covariance-and Component-Based SEM , 2009, MIS Q..

[90]  Charalambos L. Iacovou,et al.  Selective Status Reporting in Information Systems Projects: A Dyadic-Level Investigation , 2009, MIS Q..

[91]  Milena M. Head,et al.  Exploring human images in website design: a multi-method approach , 2009 .

[92]  Kai H. Lim,et al.  Web strategies to promote internet shopping: is cultural-customization needed? , 2009 .

[93]  Norman A. Johnson,et al.  Power and Concession in Computer-Mediated Negotiations: An Examination of First Offers , 2009, MIS Q..

[94]  Viswanath Venkatesh,et al.  Model of Acceptance with Peer Support: A Social Network Perspective to Understand Employees' System Use , 2009, MIS Q..

[95]  Adamantios Diamantopoulos,et al.  Using single-item measures for construct measurement in management research Conceptual issues and application guidelines , 2009 .

[96]  Donald Voet,et al.  Time flies when you're having fun , 2009, Biochemistry and molecular biology education : a bimonthly publication of the International Union of Biochemistry and Molecular Biology.

[97]  R. Purc-Stephenson,et al.  Reporting practices in confirmatory factor analysis: an overview and some recommendations. , 2009, Psychological methods.

[98]  Wynne W. Chin,et al.  A critical look at partial least squares modeling , 2009 .

[99]  Izak Benbasat,et al.  Interactive Decision Aids for Consumer Decision Making in E-Commerce: The Influence of Perceived Strategy Restrictiveness , 2009, MIS Q..

[100]  Gaby Odekerken-Schröder,et al.  Using PLS path modeling for assessing hierarchial construct models: guidelines and impirical illustration , 2009 .

[101]  Wynne W. Chin How to Write Up and Report PLS Analyses , 2010 .

[102]  Merrill Warkentin,et al.  Fear Appeals and Information Security Behaviors: An Empirical Study , 2010, MIS Q..

[103]  Henri Barki,et al.  User Participation in Information Systems Security Risk Management , 2010, MIS Q..

[104]  Izak Benbasat,et al.  Information Security Policy Compliance: An Empirical Study of Rationality-Based Beliefs and Information Security Awareness , 2010, MIS Q..

[105]  Weidong Xia,et al.  Toward Agile: An Integrated Analysis of Quantitative and Qualitative Field Data , 2010, MIS Q..

[106]  Wynne W. Chin,et al.  A Comparison of Approaches for the Analysis of Interaction Effects Between Latent Variables Using Partial Least Squares Path Modeling , 2010 .

[107]  Joseph S. Valacich,et al.  An Alternative to Methodological Individualism: A Non-Reductionist Approach to Studying Technology Adoption by Groups , 2010, MIS Q..

[108]  Heeseok Lee,et al.  The Impact of Information Technology and Transactive Memory Systems on Knowledge Sharing, Application, and Team Performance: A Field Study , 2010, MIS Q..

[109]  M. Sarstedt,et al.  Treating unobserved heterogeneity in PLS path modeling: a comparison of FIMIX-PLS with different data analysis strategies , 2010 .

[110]  Marko Sarstedt,et al.  Response-Based Segmentation Using Finite Mixture Partial Least Squares - Theoretical Foundations and an Application to American Customer Satisfaction Index Data , 2010, Data Mining.

[111]  Marc A. Tomiuk,et al.  A Comparative Study on Parameter Recovery of Three Approaches to Structural Equation Modeling , 2010 .

[112]  Marko Sarstedt,et al.  Structural modeling of heterogeneous data with partial least squares , 2010 .

[113]  Mikko T. Siponen,et al.  Neutralization: New Insights into the Problem of Employee Systems Security Policy Violations , 2010, MIS Q..

[114]  Marko Sarstedt,et al.  Assessing Heterogeneity in Customer Satisfaction Studies: Across Industry Similarities and within Industry Differences , 2011 .

[115]  Nick Lee,et al.  Avoiding measurement dogma : a response to Rossiter , 2011 .

[116]  M. Sarstedt,et al.  Uncovering and Treating Unobserved Heterogeneity with FIMIX-PLS: Which Model Selection Criterion Provides an Appropriate Number of Segments? , 2011 .

[117]  Stacie Petter,et al.  On the use of partial least squares path modeling in accounting research , 2011, Int. J. Account. Inf. Syst..

[118]  Scott B. MacKenzie,et al.  Construct Measurement and Validation Procedures in MIS and Behavioral Research: Integrating New and Existing Techniques , 2011, MIS Q..

[119]  Alexander Serenko,et al.  Integrating Technology Addiction and Use: An Empirical Investigation of Online Auction Users , 2011, MIS Q..

[120]  Joseph S. Valacich,et al.  What Signals Are You Sending? How Website Quality Influences Perceptions of Product Quality and Purchase Intentions , 2011, MIS Q..

[121]  Irene R. R. Lu,et al.  Two new methods for estimating structural equation models: An illustration and a comparison with two established methods , 2011 .

[122]  Straub,et al.  Editor's Comments: An Update and Extension to SEM Guidelines for Administrative and Social Science Research , 2011 .

[123]  Marko Sarstedt,et al.  Multigroup Analysis in Partial Least Squares (PLS) Path Modeling: Alternative Methods and Empirical Results , 2011 .

[124]  Marko Sarstedt,et al.  PLS-SEM: Indeed a Silver Bullet , 2011 .

[125]  Michael R. Wade,et al.  An Exploration of Organizational Level Information Systems Discontinuance Intentions , 2011, MIS Q..

[126]  Adamantios Diamantopoulos,et al.  Incorporating Formative Measures into Covariance-Based Structural Equation Models , 2011, MIS Q..

[127]  Richard P. Bagozzi,et al.  Measurement and Meaning in Information Systems and Organizational Research: Methodological and Philosophical Foundations , 2011, MIS Q..

[128]  Henry C. Lucas,et al.  The Value of IT-Enabled Retailer Learning: Personalized Product Recommendations and Customer Store Loyalty in Electronic Markets , 2011, MIS Q..

[129]  Joerg Henseler Why generalized structured component analysis is not universally preferable to structural equation modeling , 2012 .

[130]  Jörg Henseler,et al.  Analysing quadratic effects of formative constructs by means of variance-based structural equation modelling , 2012, Eur. J. Inf. Syst..

[131]  A. Diamantopoulos,et al.  Guidelines for choosing between multi-item and single-item scales for construct measurement: a predictive validity perspective , 2012 .

[132]  Marko Sarstedt,et al.  An assessment of the use of partial least squares structural equation modeling in marketing research , 2012 .