A Partial Least Squares Latent Variable Modeling Approach for Measuring Interaction Effects: Results from a Monte Carlo Simulation Study and an Electronic - Mail Emotion/Adoption Study

The ability to detect and accurately estimate the strength of interaction effects are critical issues that are fundamental to social science research in general and IS research in particular. Within the IS discipline, a significant percentage of research has been devoted to examining the conditions and contexts under which relationships may vary, often under the general umbrella of contingency theory (cf. McKeen et al. 1994, Weill and Olson 1989). In our survey of such studies, the majority failed to either detect or provide an estimate of the effect size. In cases where effect sizes are estimated, the numbers are generally small. These results have led some researchers to question both the usefulness of contingency theory and the need to detect interaction effects (e.g., Weill and Olson 1989). This paper addresses this issue by providing a new latent variable modeling approach that can give more accurate estimates of interaction effects by accounting for the measurement error that attenuates the estimated relationships. The capacity of this approach at recovering true effects in comparison to summated regression is demonstrated in a Monte Carlo study that creates a simulated data set in which the underlying true effects are known. Analysis of a second, empirical data set is included to demonstrate the technique's use within IS theory. In this second analysis, substantial direct and interaction effects of enjoyment on electronic-mail adoption are shown to exist.

[1]  M. Treacy,et al.  Utilization as a dependent variable in MIS research , 2015, DATB.

[2]  Freda Kemp Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences , 2003 .

[3]  Wynne W. Chin,et al.  Generating Non-normal Data for Simulation of Structural Equation Models Using Mattson's Method , 2002 .

[4]  L. Raymond,et al.  FIT IN STRATEGIC INFORMATION TECHNOLOGY MANAGEMENT RESEARCH: AN EMPIRICAL COMPARISON OF PERSPECTIVES , 2001 .

[5]  Robert W. Zmud,et al.  Arrangements for Information Technology Governance: A Theory of Multiple Contingencies , 1999, MIS Q..

[6]  R. Hoyle Statistical Strategies for Small Sample Research , 1999 .

[7]  Kenneth A. Bollen,et al.  Interactions of latent variables in structural equation models , 1998 .

[8]  Maarten Gelderman,et al.  The relation between user satisfaction, usage of information systems and performance , 1998, Inf. Manag..

[9]  Wynne W. Chin Issues and Opinion on Structural Equation Modeling , 1998, MIS Q..

[10]  Yolande E. Chan,et al.  Business Strategic Orientation, Information Systems Strategic Orientation, and Strategic Alignment , 1997, Inf. Syst. Res..

[11]  Suzanne Rivard,et al.  Development of Measures to Assess Dimensions of IS Operation Transactions , 1996, ICIS.

[12]  Vijay S. Mookerjee,et al.  Improving the Performance Stability of Inductive Expert Systems Under Input Noise , 1995, Inf. Syst. Res..

[13]  R. Ping A Parsimonious Estimating Technique for Interaction and Quadratic Latent Variables , 1995 .

[14]  Dale Goodhue,et al.  Task-Technology Fit and Individual Performance , 1995, MIS Q..

[15]  Deborah Compeau,et al.  Application of Social Cognitive Theory to Training for Computer Skills , 1995, Inf. Syst. Res..

[16]  Peter A. Todd,et al.  Understanding Information Technology Usage: A Test of Competing Models , 1995, Inf. Syst. Res..

[17]  Angèle L. M. Cavaye,et al.  User participation in system development revisited , 1995, Inf. Manag..

[18]  Wynne W. Chin,et al.  Adoption intention in GSS: relative importance of beliefs , 1995, DATB.

[19]  Jack J. Baroudi,et al.  The impact of job performance evaluations on career advancement prospects: an examination of gender differences in the IS workplace , 1995 .

[20]  B. E. Wynne,et al.  An experiment assessing group support system and facilitator effects on meeting outcomes , 1995 .

[21]  Timo Saarinen,et al.  Understanding Runaway Information Technology Projects: Results from an International Research Program Based on Escalation Theory , 1994, J. Manag. Inf. Syst..

[22]  Tor Guimaraes,et al.  The Relationship Between User Participation and User Satisfaction: An Investigation of Four Contingency Factors , 1994, MIS Q..

[23]  Radhika Santhanam,et al.  Improving End-User Proficiency: Effects of Conceptual Training and Nature of Interaction , 1994, Inf. Syst. Res..

[24]  Richard T. Watson,et al.  Culture: a fourth dimension of group support systems , 1994, CACM.

[25]  R. Tibshirani,et al.  An Introduction to the Bootstrap , 1995 .

[26]  William R. King,et al.  The evaluation of strategic information system planning , 1994, Inf. Manag..

[27]  Henri Barki,et al.  Explaining the Role of User Participation in Information System Use , 1994 .

[28]  BarkiHenri,et al.  Explaining the Role of User Participation in Information System Use , 1994 .

[29]  Robert M. Brown,et al.  Organization Designs for the Management of End-User Computing: Re-examining the Contingencies , 1994, J. Manag. Inf. Syst..

[30]  Beth H. Jones,et al.  Impact of Communication Medium and Computer Support on Group Perceptions and Performance: A Comparison of Face-to-Face and Dispersed Meetings , 1993, MIS Q..

[31]  Detmar W. Straub,et al.  The Effects of Information Technology and the Perceived Mood of the Feedback Giver on Feedback Seeking , 1993, Inf. Syst. Res..

[32]  C. Judd,et al.  Statistical difficulties of detecting interactions and moderator effects. , 1993, Psychological bulletin.

[33]  Vijay S. Mookerjee,et al.  Inductive Expert System Design: Maximizing System Value , 1993, Inf. Syst. Res..

[34]  Gary W. Dickson,et al.  Exploring Modes of Facilitative Support for GDSS Technology , 1993, MIS Q..

[35]  Gary J. Cook,et al.  An Empirical Investigation of Information Search Strategies with Implications for Decision Support System Design , 1993 .

[36]  C. Coulton,et al.  Interaction Effects in Multiple Regression , 1993 .

[37]  Robert P. Bostrom,et al.  Training End Users: An Experimental Investigation of the Roles of the Computer Interface and Training Methods , 1993, MIS Q..

[38]  Kishore Sengupta,et al.  Cognitive Feedback in GDSS: Improving Control and Convergence , 1993, MIS Q..

[39]  Richard T. Herschel,et al.  Measuring the relationships of task and cognitive style factors and their effects on individual decision-making effectiveness using a geographic information system , 1993, [1993] Proceedings of the Twenty-sixth Hawaii International Conference on System Sciences.

[40]  Kyung Kyu Kim,et al.  Structure and Perceived Effectiveness of Software Development Subunits: A Task Contingency Analysis , 1992, J. Manag. Inf. Syst..

[41]  Magid Igbaria,et al.  A Short Form Measure of Career Orientations: a Psychometric Evaluation , 1992, J. Manag. Inf. Syst..

[42]  Kil-Soo Suh,et al.  A Comparison of Linear Keyword and Restricted Natural Language Data Base Interfaces for Novice Users , 1992, Inf. Syst. Res..

[43]  Izak Benbasat,et al.  The Use of Information in Decision Making: An Experimental Investigation of the Impact of Computer-Based Decision Aids , 1992, MIS Q..

[44]  Jane Fedorowicz,et al.  A Learning Curve Analysis of Expert System Use , 1992 .

[45]  Fred D. Davis,et al.  Extrinsic and Intrinsic Motivation to Use Computers in the Workplace1 , 1992 .

[46]  Christopher A. Higgins,et al.  After-Hours Telecommuting and Work-Family Conflict: A Comparative Analysis , 1992, Inf. Syst. Res..

[47]  Jane M. Mackay,et al.  An Empirical Investigation of the Effects of Decision Aids on Problem-Solving Processes* , 1992 .

[48]  Youjae Yi,et al.  Assumptions of the Two-Step Approach to Latent Variable Modeling , 1992 .

[49]  A. Satorra,et al.  Scaled test statistics and robust standard errors for non-normal data in covariance structure analysis: a Monte Carlo study. , 1991, The British journal of mathematical and statistical psychology.

[50]  Jay F. Nunamaker,et al.  Information technology for negotiating groups: generating options for mutual gain , 1991 .

[51]  M. L. Gibson,et al.  Students as Surrogates for Managers in a Decision-Making Environment: An Experimental Study , 1991, J. Manag. Inf. Syst..

[52]  Starr Roxanne Hiltz,et al.  Group Decision Support: The Effects of Designated Human Leaders and Statistical Feedback in Computerized Conferences , 1991, J. Manag. Inf. Syst..

[53]  Izak Benbasat,et al.  An Experimental Investigation of the Impact of Computer Based Decision Aids on Decision Making Strategies , 1991, Inf. Syst. Res..

[54]  William J. Doll,et al.  The measurement of end-user computing satisfaction: theoretical and methodological issues , 1991 .

[55]  Jay F. Nunamaker,et al.  A Study of Collaborative Group Work With and Without Computer-Based Support , 1990, Inf. Syst. Res..

[56]  Eric W. Noreen,et al.  Computer Intensive Methods for Testing Hypotheses: An Introduction , 1990 .

[57]  C. Fornell,et al.  The cooperative venture formation process: a latent variable structural modeling approach , 1990 .

[58]  Lorne Olfman,et al.  The Importance of Learning Style in End-User Training , 1990, MIS Q..

[59]  V. Sambamurthy,et al.  An experimental evaluation of GDSS effects on group performance during stakeholder analysis , 1990, Twenty-Third Annual Hawaii International Conference on System Sciences.

[60]  Gerardine DeSanctis,et al.  Comprehensiveness and restrictiveness in group decision heuristics: effects of computer support on consensus decision making , 1989, ICIS '89.

[61]  P. Lachenbruch Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[62]  W. Doll,et al.  A discrepancy model of end-user computing involvement , 1989 .

[63]  Fred D. Davis Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[64]  George M. Kasper,et al.  The Effect of Human-Computer Interchange Protocol on Decision Performance , 1989, J. Manag. Inf. Syst..

[65]  Peter Weill,et al.  An Assessment of the Contingency Theory of Management Information Systems , 1989, J. Manag. Inf. Syst..

[66]  Jan-Bernd Lohmöller,et al.  Latent Variable Path Modeling with Partial Least Squares , 1989 .

[67]  W. R. Dillon,et al.  Some Results on the Behavior of Alternate Covariance Structure Estimation Procedures in the Presence of Non-Normal Data , 1989 .

[68]  Lorne Olfman,et al.  EUC training: comparison of methods and the role of individual differences , 1989, [1989] Proceedings of the Twenty-Second Annual Hawaii International Conference on System Sciences. Volume IV: Emerging Technologies and Applications Track.

[69]  Sirkka L. Jarvenpaa,et al.  Computer Support for Meetings of Groups Working on Unstructured Problems: A Field Experiment , 1988, MIS Q..

[70]  James C. Anderson,et al.  STRUCTURAL EQUATION MODELING IN PRACTICE: A REVIEW AND RECOMMENDED TWO-STEP APPROACH , 1988 .

[71]  Iris Vessey,et al.  The Effect of User Involvement on System Success: A Contingency Approach , 1988, MIS Q..

[72]  J. S. Long,et al.  Common Problems/Proper Solutions: Avoiding Error in Quantitative Research , 1988 .

[73]  L. Cronbach Statistical tests for moderator variables: flaws in analyses recently proposed , 1987 .

[74]  Mary J. Culnan,et al.  Mapping the Intellectual Structure of MIS, 1980-1985: A Co-Citation Analysis , 1987, MIS Q..

[75]  Peter M. Bentler,et al.  Practical Issues in Structural Modeling , 1987 .

[76]  Norman L. Eckel,et al.  THE INTERACTION BETWEEN THE RELATIVE ACCURACY OF PROBABILISTIC VS. DETERMINISTIC PREDICTIONS AND THE LEVEL OF PREDICTION‐TASK DIFFICULTY* , 1987 .

[77]  Paul C. Nutt,et al.  Evaluating MIS Design Principles , 1986, MIS Q..

[78]  J. W. Jones,et al.  THE STRUCTURE OF EXECUTIVE INFORMATION SYSTEMS: AN EXPLORATORY ANALYSIS , 1986 .

[79]  A. Greenwald,et al.  Under what conditions does theory obstruct research progress? , 1986, Psychological review.

[80]  George M. Kasper,et al.  A laboratory study of user characteristics and decision-making performance in end-user computing , 1985, Inf. Manag..

[81]  D. A. Kenny,et al.  Estimating the nonlinear and interactive effects of latent variables. , 1984 .

[82]  Blake Ives,et al.  User Involvement and MIS Success: A Review of Research , 1984 .

[83]  Jan Bell,et al.  The Effect of Presentation Form on the Use of Information in Annual Reports , 1984 .

[84]  L. E. Jones,et al.  Analysis of multiplicative combination rules when the causal variables are measured with error. , 1983 .

[85]  B. Efron,et al.  A Leisurely Look at the Bootstrap, the Jackknife, and , 1983 .

[86]  F. Bookstein,et al.  Two Structural Equation Models: LISREL and PLS Applied to Consumer Exit-Voice Theory , 1982 .

[87]  Richard J. Schonberger,et al.  MIS Design: A Contingency Approach , 1980, MIS Q..

[88]  Edward G. Carmines,et al.  Reliability and Validity Assessment , 1979 .

[89]  K. Jöreskog,et al.  Intraclass Reliability Estimates: Testing Structural Assumptions , 1974 .

[90]  R. F. Powers,et al.  MisProject Management: Myths, Opinions, and Reality , 1973 .

[91]  S. March The Information Systems Research , 2003 .

[92]  T. Wan Structural Equation Models with Latent Variables , 2002 .

[93]  A. Satorra Structural Equation Models with Latent Variables , 2002 .

[94]  Wynne W. Chin,et al.  Structural equation modeling analysis with small samples using partial least squares , 1999 .

[95]  Terry E. Duncan,et al.  Approaches to Testing Interaction Effects Using Structural Equation Modeling Methodology. , 1998, Multivariate behavioral research.

[96]  L. Hayduk,et al.  Latent Variable Interaction and Quadratic Effect Estimation: A Two-Step Technique Using Structural Equation Analysis , 1996 .

[97]  Fan Yang,et al.  Nonlinear structural equation models: The Kenny-Judd model with Interaction effects , 1996 .

[98]  Bernard C. Y. Tan,et al.  The Query Cube: A Framework for Assessing User Productivity with Database Information Retrieval , 1994, ICIS.

[99]  Suzanne Iacono,et al.  Use of advanced features and perceptions of software quality: an experimental study , 1994 .

[100]  Martin D. Crossland,et al.  Measuring and testing the effectiveness of a spatial decision support system , 1994, 1994 Proceedings of the Twenty-Seventh Hawaii International Conference on System Sciences.

[101]  John T. Nosek,et al.  Discrimination of Structure and Technology in a Group Support System: The Role of Process Complexity , 1994, ICIS.

[102]  E. Vance Wilson,et al.  The Joint Effects of Interactions between Data Display and Task Variables on Task Performance , 1994, ICIS.

[103]  Larry E. Toothaker,et al.  Multiple Regression: Testing and Interpreting Interactions , 1991 .

[104]  Richard T. Watson,et al.  Dampening Status Influence Using a Group Support System: An Empirical Study , 1993, ICIS.

[105]  Tae Hyoung Kwon,et al.  A Diffusion of Innovation Approach to MIS Infusion: Conceptualization, Methodology, and Management Strategies , 1990, ICIS.

[106]  Richard W. Scamell,et al.  An Examination of Two Screen/Report Design Variables in an Information Recall Context* , 1990 .

[107]  Hugh W. Ryan,et al.  Professional Workstations: Serenity at the Edge of the Envelope , 1989 .

[108]  Robert T. Keim,et al.  An Experimental Study in Overcoming Hypothesis-confirming Search Strategies in Computerized Information Retrieval Systems , 1988, ICIS.

[109]  Douglas R. Vogel,et al.  The Impact of Graphical Displays on Persuasion: an Empirical Study , 1986, ICIS.

[110]  Sirkka L. Jarvenpaa,et al.  End User Learning Behavior in Data Analysis and Data Modeling Tools , 1986, ICIS.

[111]  Dale Goodhue,et al.  Is Attitudes: toward Theoretical and Definition Clarity , 1986, ICIS.

[112]  Martin D. Goslar,et al.  Decision support systems: an empirical assessment for decision making , 1986 .

[113]  Gerardine DeSanctis,et al.  Understanding the effectiveness of computer graphics for decision support: a cumulative experimental approach , 1986, CACM.

[114]  B. Tabachnick,et al.  Using Multivariate Statistics , 1983 .

[115]  Herman Wold,et al.  Systems under indirect observation : causality, structure, prediction , 1982 .

[116]  Herman Wold,et al.  Soft modelling: The Basic Design and Some Extensions , 1982 .

[117]  Charles Russel Franz,et al.  Contingency factors affecting the user involvement role in the design of successful information systems. , 1979 .

[118]  Richard,et al.  Extrinsic and Intrinsic Motivation to Use Computers in the Workplace , 2022 .

[119]  Gerald L. Lohse,et al.  Organizational Behavior and Human Decision Processes a Comparison of Two Process Tracing Methods for Choice Tasks , 2022 .