Testing measurement invariance of composites using partial least squares

Purpose – Research on international marketing usually involves comparing different groups of respondents. When using structural equation modeling (SEM), group comparisons can be misleading unless researchers establish the invariance of their measures. While methods have been proposed to analyze measurement invariance in common factor models, research lacks an approach in respect of composite models. The purpose of this paper is to present a novel three-step procedure to analyze the measurement invariance of composite models (MICOM) when using variance-based SEM, such as partial least squares (PLS) path modeling. Design/methodology/approach – A simulation study allows us to assess the suitability of the MICOM procedure to analyze the measurement invariance in PLS applications. Findings – The MICOM procedure appropriately identifies no, partial, and full measurement invariance. Research limitations/implications – The statistical power of the proposed tests requires further research, and researchers using the MICOM procedure should take potential type-II errors into account. Originality/value – The research presents a novel procedure to assess the measurement invariance in the context of composite models. Researchers in international marketing and other disciplines need to conduct this kind of assessment before undertaking multigroup analyses. They can use MICOM procedure as a standard means to assess the measurement invariance.

[1]  D. Straub,et al.  Editor's comments: a critical look at the use of PLS-SEM in MIS quarterly , 2012 .

[2]  Arun Rai,et al.  Discovering Unobserved Heterogeneity in Structural Equation Models to Avert Validity Threats , 2013, MIS Q..

[3]  Y. Takane,et al.  Generalized structured component analysis , 2004 .

[4]  Edward E. Rigdon,et al.  Rethinking Partial Least Squares Path Modeling: Breaking Chains and Forging Ahead , 2014 .

[5]  William Lewis,et al.  Does PLS Have Advantages for Small Sample Size or Non-Normal Data? , 2012, MIS Q..

[6]  Nitish Singh,et al.  Understanding international web site usage , 2006 .

[7]  Kenneth A. Bollen,et al.  Evaluating Effect, Composite, and Causal Indicators in Structural Equation Models , 2011, MIS Q..

[8]  Shawn Bauldry,et al.  Three Cs in measurement models: causal indicators, composite indicators, and covariates. , 2011, Psychological methods.

[9]  H. Winklhofer,et al.  Index Construction with Formative Indicators: An Alternative to Scale Development , 2001 .

[10]  J. Horn,et al.  A practical and theoretical guide to measurement invariance in aging research. , 1992, Experimental aging research.

[11]  Marko Sarstedt,et al.  Assessing Heterogeneity in Customer Satisfaction Studies: Across Industry Similarities and within Industry Differences , 2011 .

[12]  Joseph F. Hair,et al.  On the Emancipation of PLS-SEM: A Commentary on Rigdon (2012) , 2014 .

[13]  Jörg Henseler,et al.  Consistent and asymptotically normal PLS estimators for linear structural equations , 2014 .

[14]  Ryan T. Wright,et al.  Assessing Common Method Bias: Problems with the ULMC Technique , 2012, MIS Q..

[15]  Detmar W. Straub,et al.  Common Beliefs and Reality About PLS , 2014 .

[16]  Marko Sarstedt,et al.  Multigroup Analysis in Partial Least Squares (PLS) Path Modeling: Alternative Methods and Empirical Results , 2011 .

[17]  M. Sarstedt,et al.  A new criterion for assessing discriminant validity in variance-based structural equation modeling , 2015 .

[18]  Adamantios Diamantopoulos,et al.  Advancing formative measurement models , 2008 .

[19]  Jean-Paul Fox,et al.  Relaxing Measurement Invariance in Cross-National Consumer Research Using a Hierarchical IRT Model , 2007 .

[20]  R. P. McDonald,et al.  Path Analysis with Composite Variables. , 1996, Multivariate behavioral research.

[21]  Detmar W. Straub,et al.  Common Beliefs and Reality About Partial Least Squares: Comments on Rönkkö & Evermann (2013) , 2014 .

[22]  Jan-Bernd Lohmöller,et al.  Latent Variable Path Modeling with Partial Least Squares , 1989 .

[23]  Marko Sarstedt,et al.  Goodness-of-fit indices for partial least squares path modeling , 2013, Comput. Stat..

[24]  Wynne W. Chin,et al.  An Introduction to a Permutation Based Procedure for Multi-Group PLS Analysis: Results of Tests of Differences on Simulated Data and a Cross Cultural Analysis of the Sourcing of Information System Services Between Germany and the USA , 2010 .

[25]  T. Dijkstra.  PLS' Janus Face – Response to Professor Rigdon's ‘Rethinking Partial Least Squares Modeling: In Praise of Simple Methods’ , 2014 .

[26]  Barbara M Byrne,et al.  Measurement equivalence: a comparison of methods based on confirmatory factor analysis and item response theory. , 2002, The Journal of applied psychology.

[27]  Christian M. Ringle,et al.  Capturing and Treating Unobserved Heterogeneity by Response Based Segmentation in PLS Path Modeling. A Comparison of Alternative Methods by Computational Experiments , 2007 .

[28]  Irene R. R. Lu,et al.  Two new methods for estimating structural equation models: An illustration and a comparison with two established methods , 2011 .

[29]  M. Wedel,et al.  Market Segmentation: Conceptual and Methodological Foundations , 1997 .

[30]  A. Goldberger,et al.  Estimation of a Model with Multiple Indicators and Multiple Causes of a Single Latent Variable , 1975 .

[31]  Herman Wold,et al.  Soft modelling: The Basic Design and Some Extensions , 1982 .

[32]  V. E. Vinzi,et al.  REBUS-PLS: A response-based procedure for detecting unit segments in PLS path modelling , 2008 .

[33]  Cynthia M. Pavett,et al.  Management Style and Productivity in Two Cultures , 1992 .

[34]  Rudolf R. Sinkovics,et al.  Reconsidering the problem of data equivalence in international marketing research: Contrasting approaches based on CFA and the Rasch model for measurement , 2006 .

[35]  R. Vandenberg,et al.  A Review and Synthesis of the Measurement Invariance Literature: Suggestions, Practices, and Recommendations for Organizational Research , 2000 .

[36]  Rudolf R. Sinkovics,et al.  The Use of Partial Least Squares Path Modeling in International Marketing , 2009 .

[37]  H. Blalock.  Causal Inferences in Nonexperimental Research , 1966 .

[38]  F. Bookstein,et al.  Two Structural Equation Models: LISREL and PLS Applied to Consumer Exit-Voice Theory: , 1982 .

[39]  Joerg Henseler.  Why generalized structured component analysis is not universally preferable to structural equation modeling , 2012 .

[40]  Marko Sarstedt,et al.  Response-Based Segmentation Using Finite Mixture Partial Least Squares - Theoretical Foundations and an Application to American Customer Satisfaction Index Data , 2010, Data Mining.

[41]  Adamantios Diamantopoulos,et al.  The error term in formative measurement models: interpretation and modeling implications , 2006 .

[42]  J. Hair.  Multivariate data analysis , 1972 .

[43]  Marko Sarstedt,et al.  A Concise Guide to Market Research: The Process, Data, and Methods Using IBM SPSS Statistics , 2011 .

[44]  Jörg Henseler,et al.  On the convergence of the partial least squares path modeling algorithm , 2010, Comput. Stat..

[45]  J. Steenkamp,et al.  International market segmentation: issues and perspectives , 2002 .

[46]  Anthony C. Davison,et al.  Bootstrap Methods and Their Application , 1998 .

[47]  Marko Sarstedt,et al.  The Use of Partial Least Squares Structural Equation Modeling in Strategic Management Research: A Review of Past Practices and Recommendations for Future Applications , 2012 .

[48]  Cheryl Burke Jarvis,et al.  A Critical Review of Construct Indicators and Measurement Model Misspecification in Marketing and Consumer Research , 2003 .

[49]  Young Ik Cho,et al.  The Relation Between Culture and Response Styles , 2005 .

[50]  Marko Sarstedt,et al.  Partial least squares structural equation modeling (PLS-SEM): A useful tool for family business researchers , 2014 .

[51]  Manfred Schwaiger.  Components and Parameters of Corporate Reputation — An Empirical Study , 2004 .

[52]  Marko Sarstedt,et al.  PLS path modeling and evolutionary segmentation , 2013 .

[53]  Holger Steinmetz,et al.  Testing measurement invariance using multigroup CFA: differences between educational groups in human values measurement , 2009 .

[54]  Eugene S. Edgington,et al.  Randomization Tests , 2011, International Encyclopedia of Statistical Science.

[55]  J. Henseler,et al.  Linear indices in nonlinear structural equation models: best fitting proper indices and other composites , 2011 .

[56]  M. Sarstedt.  A review of recent approaches for capturing heterogeneity in partial least squares path modelling , 2008 .

[57]  Kenneth A. Bollen,et al.  Structural Equations with Latent Variables , 1989 .

[58]  Jörg Henseler,et al.  Consistent Partial Least Squares Path Modeling , 2015, MIS Q..

[59]  Adamantios Diamantopoulos,et al.  Assessing the cross-national invariance of formative measures: Guidelines for international business researchers , 2010 .

[60]  Marko Sarstedt,et al.  Customer Satisfaction with Commercial Airlines: The Role of Perceived Safety and Purpose of Travel , 2011 .

[61]  Frank Huber,et al.  Capturing Customer Heterogeneity using a Finite Mixture PLS Approach , 2002 .

[62]  Edward E. Rigdon,et al.  Rethinking Partial Least Squares Path Modeling: In Praise of Simple Methods , 2012 .

[63]  Adam W. Meade,et al.  A Comparison of Item Response Theory and Confirmatory Factor Analytic Methodologies for Establishing Measurement Equivalence/Invariance , 2004 .

[64]  W. Reinartz,et al.  An Empirical Comparison of the Efficacy of Covariance-Based and Variance-Based SEM , 2009 .

[65]  M. Sarstedt,et al.  Treating unobserved heterogeneity in PLS path modeling: a comparison of FIMIX-PLS with different data analysis strategies , 2010 .

[66]  Shintaro Okazaki,et al.  Cross‐cultural advertising research: where we have been and where we need to go , 2007 .

[67]  Nukhet Harmancioglu,et al.  Data equivalence in cross-cultural international business research: assessment and guidelines , 2008 .

[68]  Roger J. Calantone,et al.  The utility of item response modeling in marketing research , 2014 .

[69]  Jörg Henseler,et al.  Handbook of Partial Least Squares: Concepts, Methods and Applications , 2010 .

[70]  Florian Heinemann,et al.  Antecedents of Market Orientation: A Cross-Cultural Comparison , 2008 .

[71]  Marko Sarstedt,et al.  Using partial least squares path modeling in international advertising research: basic concepts and recent issues , 2012 .

[72]  Jörg Henseler,et al.  Testing Moderating Effects in PLS Path Models. An Illustration of Available Procedures , 2005 .

[73]  A. Gelman,et al.  The Difference Between “Significant” and “Not Significant” is not Itself Statistically Significant , 2006 .

[74]  Marko Sarstedt,et al.  An assessment of the use of partial least squares structural equation modeling in marketing research , 2012 .

[75]  Friedrich Leisch,et al.  semPLS: Structural Equation Modeling Using Partial Least Squares , 2012 .

[76]  Marko Sarstedt,et al.  Genetic algorithm segmentation in partial least squares structural equation modeling , 2013, OR Spectrum.

[77]  J. Steenkamp,et al.  Assessing Measurement Invariance in Cross-National Consumer Research , 1998 .

[78]  M. Sarstedt,et al.  Uncovering and Treating Unobserved Heterogeneity with FIMIX-PLS: Which Model Selection Criterion Provides an Appropriate Number of Segments? , 2011 .

[79]  W. DeSarbo,et al.  Finite-Mixture Structural Equation Models for Response-Based Segmentation and Unobserved Heterogeneity , 1997 .

[80]  Jörg Henseler,et al.  Exploring Unanticipated Consequences of Strategy Amongst Stakeholder Segments: The Case of a European Revenue Service , 2012 .

[81]  Silvia Squillacciotti,et al.  Prediction Oriented Classification in PLS Path Modeling , 2010 .

[82]  W. Meredith.  Measurement invariance, factor analysis and factorial invariance , 1993 .

[83]  Peter M Bentler,et al.  On Components, Latent Variables, PLS and Simple Methods: Reactions to Rigdon's Rethinking of PLS. , 2014, Long range planning.

[84]  Marko Sarstedt,et al.  Partial least squares structural equation modeling (PLS-SEM): An emerging tool in business research , 2014 .

[85]  J. J. Po-An Hsieh,et al.  ScholarWorks @ Georgia State University , 2016 .

[86]  Siegfried P. Gudergan,et al.  Confirmatory Tetrad Analysis in PLS Path Modeling , 2008 .

[87]  Wynne W. Chin,et al.  A Comparison of Approaches for the Analysis of Interaction Effects Between Latent Variables Using Partial Least Squares Path Modeling , 2010 .