A test for multigroup comparison using partial least squares path modeling

Purpose People seem to function according to different models, which implies that in business and social sciences, heterogeneity is a rule rather than an exception. Researchers can investigate such heterogeneity through multigroup analysis (MGA). In the context of partial least squares path modeling (PLS-PM), MGA is currently applied to perform multiple comparisons of parameters across groups. However, this approach has significant drawbacks: first, the whole model is not considered when comparing groups, and second, the family-wise error rate is higher than the predefined significance level when the groups are indeed homogenous, leading to incorrect conclusions. Against this background, the purpose of this paper is to present and validate new MGA tests, which are applicable in the context of PLS-PM, and to compare their efficacy to existing approaches. Design/methodology/approach The authors propose two tests that adopt the squared Euclidean distance and the geodesic distance to compare the model-implied indicator correlation matrix across groups. The authors employ permutation to obtain the corresponding reference distribution to draw statistical inference about group differences. A Monte Carlo simulation provides insights into the sensitivity and specificity of both permutation tests and their performance, in comparison to existing approaches. Findings Both proposed tests provide a considerable degree of statistical power. However, the test based on the geodesic distance outperforms the test based on the squared Euclidean distance in this regard. Moreover, both proposed tests lead to rejection rates close to the predefined significance level in the case of no group differences. Hence, our proposed tests are more reliable than an uncontrolled repeated comparison approach. Research limitations/implications Current guidelines on MGA in the context of PLS-PM should be extended by applying the proposed tests in an early phase of the analysis. Beyond our initial insights, more research is required to assess the performance of the proposed tests in different situations. Originality/value This paper contributes to the existing PLS-PM literature by proposing two new tests to assess multigroup differences. For the first time, this allows researchers to statistically compare a whole model across groups by applying a single statistical test.

[1]  Kenneth J. Berry,et al.  A Chronicle of Permutation Statistical Methods , 2014 .

[2]  Sandrine Dudoit,et al.  Multiple Testing. Part I. Single-Step Procedures for Control of General Type I Error Rates , 2004, Statistical applications in genetics and molecular biology.

[3]  Taeke Klaas Dijkstra Latent variables in linear stochastic models , 1981 .

[4]  Kai H. Lim,et al.  Web strategies to promote internet shopping: is cultural-customization needed? , 2009 .

[5]  Mark Srite,et al.  The Role of Espoused National Cultural Values in Technology Acceptance , 2006, MIS Q..

[6]  Jason Bennett Thatcher,et al.  Moving Beyond Intentions and Toward the Theory of Trying: Effects of Work Environment and Gender on Post-Adoption Information Technology Use , 2005, MIS Q..

[7]  Douglas R. Vogel,et al.  Toward a theory of perceived benefits, affective commitment, and continuance intention in social virtual worlds: cultural values (indulgence and individualism) matter , 2015, Eur. J. Inf. Syst..

[8]  Frank Huber,et al.  Capturing Customer Heterogeneity using a Finite Mixture PLS Approach , 2002 .

[9]  Wynne W. Chin,et al.  An Introduction to a Permutation Based Procedure for Multi-Group PLS Analysis: Results of Tests of Differences on Simulated Data and a Cross Cultural Analysis of the Sourcing of Information System Services Between Germany and the USA , 2010 .

[10]  Hsi-Peng Lu,et al.  The role of Internet addiction in online game loyalty: an exploratory study , 2008, Internet Res..

[11]  S. Keleş,et al.  Statistical Applications in Genetics and Molecular Biology Asymptotic Optimality of Likelihood-Based Cross-Validation , 2011 .

[12]  H. Wold Path Models with Latent Variables: The NIPALS Approach , 1975 .

[13]  J. Ludbrook,et al.  Issues in biomedical statistics: statistical inference. , 1994, The Australian and New Zealand journal of surgery.

[14]  John Hulland,et al.  Use of partial least squares (PLS) in strategic management research: a review of four recent studies , 1999 .

[15]  Thurasamy Ramayah,et al.  Determinants of cyberloafing: a comparative study of a public and private sector organization , 2017, Internet Res..

[16]  Kenneth L. Kraemer,et al.  Migration to Open-Standard Interorganizational Systems: Network Effects, Switching Costs, and Path Dependency , 2005, MIS Q..

[17]  Marko Sarstedt,et al.  Testing measurement invariance of composites using partial least squares , 2016 .

[18]  Jörg Henseler,et al.  PLS-MGA: A Non-Parametric Approach to Partial Least Squares-based Multi-Group Analysis , 2010, GfKl.

[19]  Marko Sarstedt,et al.  Identifying and treating unobserved heterogeneity with FIMIX-PLS: part I – method , 2016 .

[20]  Marko Sarstedt,et al.  Genetic algorithm segmentation in partial least squares structural equation modeling , 2013, OR Spectrum.

[21]  M. Sarstedt,et al.  Uncovering and Treating Unobserved Heterogeneity with FIMIX-PLS: Which Model Selection Criterion Provides an Appropriate Number of Segments? , 2011 .

[22]  W. DeSarbo,et al.  Finite-Mixture Structural Equation Models for Response-Based Segmentation and Unobserved Heterogeneity , 1997 .

[23]  D. Straub,et al.  Editor's comments: a critical look at the use of PLS-SEM in MIS quarterly , 2012 .

[24]  Arun Rai,et al.  Discovering Unobserved Heterogeneity in Structural Equation Models to Avert Validity Threats , 2013, MIS Q..

[25]  P. Lachenbruch Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[26]  Florian Schuberth,et al.  PLS path modeling – a confirmatory approach to study tourism technology and tourist behavior , 2018, Journal of Hospitality and Tourism Technology.

[27]  J. J. Po-An Hsieh,et al.  ScholarWorks @ Georgia State University , 2016 .

[28]  Siegfried P. Gudergan,et al.  Confirmatory Tetrad Analysis in PLS Path Modeling , 2008 .

[29]  A. Mathai,et al.  Understanding and using sensitivity, specificity and predictive values , 2008, Indian journal of ophthalmology.

[30]  A. J. Swain A class of factor analysis estimation procedures with common asymptotic sampling properties , 1975 .

[31]  Marko Sarstedt,et al.  Segmentation of PLS path models by iterative reweighted regressions , 2015 .

[32]  Jörg Henseler,et al.  Consistent and asymptotically normal PLS estimators for linear structural equations , 2014 .

[33]  Wynne W. Chin,et al.  Systemic Determinants of the Information Systems Outsourcing Decision: A Comparative Study of German and United States Firms , 2012, J. Assoc. Inf. Syst..

[34]  Jörg Henseler,et al.  Consistent Partial Least Squares Path Modeling , 2015, MIS Q..

[35]  Eugene S. Edgington,et al.  Randomization Tests , 2011, International Encyclopedia of Statistical Science.

[36]  Gang Kou,et al.  The impact of perceived online service quality on swift guanxi: Implications for customer repurchase intention , 2018, Internet Res..

[37]  Marko Sarstedt,et al.  A Concise Guide to Market Research: The Process, Data, and Methods Using IBM SPSS Statistics , 2011 .

[38]  Tiago Oliveira,et al.  Understanding mobile banking individual performance: The DeLone & McLean model and the moderating effects of individual culture , 2017, Internet Res..

[39]  Deborah Compeau,et al.  Assessing Between-Group Differences in Information Systems Research: A Comparison of Covariance-and Component-Based SEM , 2009, MIS Q..

[40]  Bernard C. Y. Tan,et al.  A Cross-Cultural Study on Escalation of Commitment Behavior in Software Projects , 2000, MIS Q..

[41]  Matthew K. O. Lee,et al.  Gender differences in intentional social action: we-intention to engage in social network-facilitated team collaboration , 2010, J. Inf. Technol..

[42]  Wei-Ning Yang,et al.  A study of purchasing behavior in Taiwan's online auction websites: Effects of uncertainty and gender differences , 2012, Internet Res..

[43]  Zach W. Y. Lee,et al.  Self-disclosure in social networking sites: The role of perceived cost, perceived benefits and social influence , 2015, Internet Res..

[44]  Marko Sarstedt,et al.  Multigroup Analysis in Partial Least Squares (PLS) Path Modeling: Alternative Methods and Empirical Results , 2011 .

[45]  M. Sarstedt,et al.  A new criterion for assessing discriminant validity in variance-based structural equation modeling , 2015 .