The longitudinal impact of enterprise system users’ pre-adoption expectations and organizational support on post-adoption proficient usage

Although enterprise systems (ES) are ubiquitous, many firms report less than stellar payoffs from these costly investments, with underutilization often attributed to failures in the implementation process. Unfortunately, research has not provided sufficient insights into these failures, in part because it has focused on actual usage, as opposed to proficient usage, as the benchmark for successful implementation. Moreover, research has not generally examined how the adoption process unfolds over time, thus overlooking potential underlying mechanisms that may help explain how adopters achieve proficiency. To begin addressing these shortcomings, we study how adopters’ pre-adoption expectations, enacted over time, can influence their post-adoption proficiency, by shaping how and why they spend time using the system during the adoption period. We analyzed time-lagged survey data from 153 financial analysts, required to adopt new ES-based software, at a multinational bank. We found that adopters who hold pre-adoption expectations reflecting greater internal and external motives to adopt the system as well as systematically integrate it into their work routines are more apt to use the system in ways that enhance their cumulative knowledge of it, and subsequently develop higher levels of proficiency post-adoption. Moreover, greater organizational support enhanced the impact of adopters’ expectations on proficiency, except when their actual use is low in which case organizational support had an adverse effect.

[1]  Qing Hu,et al.  Assimilation of Enterprise Systems: The Effect of Institutional Pressures and the Mediating Role of Top Management , 2007, MIS Q..

[2]  Juhani Iivari,et al.  Why do individuals use computer technology? A Finnish case study , 1995, Inf. Manag..

[3]  R. T. Due The productivity paradox revisited , 1994 .

[4]  Peter B. Seddon,et al.  A Multi-Project Model of Key Factors Affecting Organizational Benefits from Enterprise Systems , 2010, MIS Q..

[5]  David C. Martin,et al.  Performance Appraisal: Maintaining System Effectiveness , 1998 .

[6]  Jannica Heinström,et al.  Broad exploration or precise specificity: Two basic information seeking patterns among students , 2006, J. Assoc. Inf. Sci. Technol..

[7]  Detmar W. Straub,et al.  Reconceptualizing System Usage: An Approach and Empirical Test , 2006, Inf. Syst. Res..

[8]  Hubert L. Dreyfus,et al.  Mind over Machine: The Power of Human Intuition and Expertise in the Era of the Computer , 1987, IEEE Expert.

[9]  Karin Baier,et al.  Management And Motivation , 2016 .

[10]  B. Tabachnick,et al.  Using Multivariate Statistics , 1983 .

[11]  Chris F. Kemerer,et al.  The assimilation of software process innovations: an organizational learning perspective , 1997 .

[12]  Régis Meissonierm,et al.  Toward an Enacted Approach to Understanding OSS Developer's Motivations , 2012, Int. J. Technol. Hum. Interact..

[13]  John E. Mathieu,et al.  Clarifying conditions and decision points for mediational type inferences in Organizational Behavior , 2006 .

[14]  Marie-Claude Boudreau,et al.  Enacting Integrated Information Technology: A Human Agency Perspective , 2005, Organ. Sci..

[15]  Wanda J. Orlikowski,et al.  CASE Tools as Organizational Change: Investigating Incremental and Radical Changes in Systems Development , 1993, MIS Q..

[16]  Adamantios Diamantopoulos,et al.  Incorporating Formative Measures into Covariance-Based Structural Equation Models , 2011, MIS Q..

[17]  Cheryl Burke Jarvis,et al.  A Critical Review of Construct Indicators and Measurement Model Misspecification in Marketing and Consumer Research , 2003 .

[18]  Marjolein van Offenbeek,et al.  Towards integrating acceptance and resistance research: evidence from a telecare case study , 2013, Eur. J. Inf. Syst..

[19]  Jack M. Feldman,et al.  Performance appraisal: A process focus. , 1983 .

[20]  John R. Schermerhorn,et al.  Management dialogues: Turning on the marginal performer , 1990 .

[21]  Fred D. Davis,et al.  Development and Test of a Theory of Technological Learning and Usage , 1992 .

[22]  Charles Chowa,et al.  Information System Success: Individual and Organizational Determinants , 2006, Manag. Sci..

[23]  Sophia Decker,et al.  Learning Strategies And Learning Styles , 2016 .

[24]  M. Tennant Psychology and Adult Learning , 2019 .

[25]  Kenneth A. Bollen,et al.  Evaluating Effect, Composite, and Causal Indicators in Structural Equation Models , 2011, MIS Q..

[26]  Rex B. Kline,et al.  Principles and Practice of Structural Equation Modeling , 1998 .

[27]  Malcolm Munro,et al.  Assessing User Competence: Conceptualization and Measurement , 2000, Inf. Syst. Res..

[28]  R. Kaplan,et al.  Using the balanced scorecard as a strategic management system , 1996 .

[29]  Magid Igbaria,et al.  End-user computing effectiveness: A structural equation model , 1990 .

[30]  Bradley L. Kirkman,et al.  The Impact of Team Empowerment on Virtual Team Performance: The Moderating Role of Face-to-Face Interaction , 2004 .

[31]  Donald H. Saklofske,et al.  International Handbook of Personality and Intelligence , 2010 .

[32]  Richard T. Dué,et al.  THE PRODUCTIVITY PARADOX REVISITED PARODOX REVISITED , 1994 .

[33]  Richard E. Mayer,et al.  Cognition and Instruction: Their Historic Meeting within Educational Psychology. , 1992 .

[34]  Patrick Y. K. Chau,et al.  An Empirical Assessment of a Modified Technology Acceptance Model , 1996, J. Manag. Inf. Syst..

[35]  Fred D. Davis,et al.  User Acceptance of Computer Technology: A Comparison of Two Theoretical Models , 1989 .

[36]  Eva Cools,et al.  Development and Validation of the Cognitive Style Indicator , 2007, The Journal of psychology.

[37]  Brian Sauser,et al.  Knowledge Networks: How Independence and Subject Matter Experts Can Influence Project Reviews , 2008 .

[38]  R. Eisenberger,et al.  Affective commitment to the organization: the contribution of perceived organizational support. , 2001, The Journal of applied psychology.

[39]  Scott B. MacKenzie,et al.  Common method biases in behavioral research: a critical review of the literature and recommended remedies. , 2003, The Journal of applied psychology.

[40]  K. Weick ENACTED SENSEMAKING IN CRISIS SITUATIONS[1] , 1988 .

[41]  Anand Jeyaraj,et al.  A review of the predictors, linkages, and biases in IT innovation adoption research , 2006, J. Inf. Technol..

[42]  Richard,et al.  Extrinsic and Intrinsic Motivation to Use Computers in the Workplace , 2022 .

[43]  Jane M. Howell,et al.  Personal Computing: Toward a Conceptual Model of Utilization , 1991, MIS Q..

[44]  Henry C. Lucas,et al.  Empirical Evidence for a Descriptive Model of Implementation , 1978, MIS Q..

[45]  Jaak Jurison,et al.  The temporal nature of IS benefits: A longitudinal study , 1996, Inf. Manag..

[46]  Huy P. Phan,et al.  Empirical model and analysis of mastery and performance‐approach goals: a developmental approach , 2010 .

[47]  Kee-Young Kwahk,et al.  Managing readiness in enterprise systems-driven organizational change , 2008, Behav. Inf. Technol..

[48]  M. Treacy,et al.  Utilization as a dependent variable in MIS research , 2015, DATB.

[49]  A. Bandura Social Foundations of Thought and Action: A Social Cognitive Theory , 1985 .

[50]  Huy P. Phan,et al.  Relations between goals, self‐efficacy, critical thinking and deep processing strategies: a path analysis , 2009 .

[51]  E. Burton Swanson,et al.  INFORMATION CHANNEL DISPOSITION AND USE , 1987 .

[52]  Detmar W. Straub,et al.  Measuring System Usage: Implications for IS Theory Testing , 1995 .

[53]  G. Walsham Making a World of Difference: IT in a Global Context , 2001 .

[54]  John R. Hollenbeck,et al.  Beyond Team Types and Taxonomies: A Dimensional Scaling Conceptualization for Team Description , 2012 .

[55]  Hongwei Du,et al.  Toward a better understanding of behavioral intention and system usage constructs , 2012, Eur. J. Inf. Syst..

[56]  Sue Abdinnour-Helm,et al.  Examining the Impact of Pre-Implementation Expectations on Post-Implementation Use of Enterprise Systems: A Longitudinal Study , 2010, Decis. Sci..

[57]  M. Markus,et al.  The Enterprise System Experience— From Adoption to Success , 2000 .

[58]  Brian R. Chabowski,et al.  Knowledge Management and Balanced Scorecard Outcomes: Exploring the Importance of Interpretation, Learning and Internationality , 2010 .

[59]  Kristopher J Preacher,et al.  SPSS and SAS procedures for estimating indirect effects in simple mediation models , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[60]  Venkatesh,et al.  A Longitudinal Field Investigation of Gender Differences in Individual Technology Adoption Decision-Making Processes. , 2000, Organizational behavior and human decision processes.

[61]  Steven J. Armstrong,et al.  The Influence of Individual Cognitive Style on Performance in Management Education , 2000 .

[62]  R. Eisenberger,et al.  Perceived supervisor support: contributions to perceived organizational support and employee retention. , 2002, The Journal of applied psychology.

[63]  Peer C. Fiss A set-theoretic approach to organizational configurations , 2007 .

[64]  Charles C. Ragin,et al.  Redesigning social inquiry , 2008 .

[65]  E. Clemons,et al.  Newly vulnerable markets in an age of pure information products: an analysis of online music and online news , 2002, Proceedings of the 35th Annual Hawaii International Conference on System Sciences.

[66]  Andrew Dillon,et al.  How User Perceptions Influence Software Use , 1997, IEEE Softw..

[67]  Michael J. Ginzberg,et al.  Early Diagnosis of MIS Implementation Failure: Promising Results and Unanswered Questions , 1981 .

[68]  David P Mackinnon,et al.  Confidence Limits for the Indirect Effect: Distribution of the Product and Resampling Methods , 2004, Multivariate behavioral research.

[69]  James C. Brancheau,et al.  Adoption and Utilization of Commercial Software Packages: Exploring Utilization Equilibria, Transitions, Triggers, and Tracks , 1999, J. Manag. Inf. Syst..

[70]  Fred D. Davis Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[71]  Phillip L. Ackerman,et al.  Determinants of Learning and Performance in an Associative Memory/Substitution Task: Task Constraints, Individual Differences, Volition, and Motivation. , 1994 .

[72]  D. A. Kenny,et al.  Data analysis in social psychology. , 1998 .

[73]  Diana Adler,et al.  Using Multivariate Statistics , 2016 .

[74]  Deborah Compeau,et al.  Social Cognitive Theory and Individual Reactions to Computing Technology: A Longitudinal Study , 1999, MIS Q..

[75]  Jacob Cohen,et al.  Applied multiple regression/correlation analysis for the behavioral sciences , 1979 .

[76]  Susan A. Brown,et al.  Do I really have to? User acceptance of mandated technology , 2002, Eur. J. Inf. Syst..

[77]  Arie Y. Lewin,et al.  Microfoundations of Internal and External Absorptive Capacity Routines , 2011, Organ. Sci..

[78]  Sue Newell,et al.  Exploring the Importance of Participation in the Post-Implementation Period of an ES Project: A Neglected Area , 2007, J. Assoc. Inf. Syst..

[79]  Jeanne W. Ross,et al.  Learning to Implement Enterprise Systems: An Exploratory Study of the Dialectics of Change , 2002, J. Manag. Inf. Syst..

[80]  R. Riding,et al.  Towards a Categorisation of Cognitive Styles and Learning Styles , 1997 .

[81]  Malcolm Munro,et al.  Understanding and measuring user competence , 1997, Inf. Manag..

[82]  R. G. Hunt,et al.  Cognitive style and decision making , 1989 .

[83]  E. Pedhazur Multiple Regression in Behavioral Research: Explanation and Prediction , 1982 .

[84]  Kristopher J Preacher,et al.  Addressing Moderated Mediation Hypotheses: Theory, Methods, and Prescriptions , 2007, Multivariate behavioral research.

[85]  Alan R. Hevner,et al.  It's more than just use: An exploration of telemedicine use quality , 2007, Decis. Support Syst..

[86]  Russell L. Purvis,et al.  The Assimilation of Knowledge Platforms in Organizations: An Empirical Investigation , 2001 .

[87]  Alexander M. Maish A User's Behavior Toward His MIS , 1979, MIS Q..

[88]  I. Nonaka A Dynamic Theory of Organizational Knowledge Creation , 1994 .

[89]  Nathan P. Podsakoff,et al.  The Role of Formative Measurement Models in Strategic Management Research: Review, Critique, and Implications for Future Research , 2006 .

[90]  Barbara H Wixom,et al.  A Theoretical Integration of User Satisfaction and Technology Acceptance , 2005, Inf. Syst. Res..

[91]  Frantz Rowe,et al.  Strategizing information systems-enabled organizational transformation: A transdisciplinary review and new directions , 2012, J. Strateg. Inf. Syst..

[92]  P. Levy,et al.  Performance appraisal reactions: measurement, modeling, and method bias. , 2000, The Journal of applied psychology.

[93]  Sandra Lowe,et al.  Redesigning Social Inquiry Fuzzy Sets And Beyond , 2016 .

[94]  V. Grover An Empirically Derived Model for the Adoption of Customer‐based Interorganizational Systems* , 1993 .

[95]  Kieran Mathieson,et al.  Predicting User Intentions: Comparing the Technology Acceptance Model with the Theory of Planned Behavior , 1991, Inf. Syst. Res..

[96]  Edward L. Deci,et al.  Management and motivation , 1992 .

[97]  Richard P. Bagozzi,et al.  Assessing Construct Validity in Organizational Research , 1991 .

[98]  Fred D. Davis,et al.  Extrinsic and Intrinsic Motivation to Use Computers in the Workplace1 , 1992 .

[99]  Viswanath Venkatesh,et al.  Where To Go From Here? Thoughts on Future Directions for Research on Individual-Level Technology Adoption with a Focus on Decision Making , 2006, Decis. Sci..

[100]  Leon Coetsee,et al.  From Resistance to Commitment , 1999 .

[101]  Kee-Young Kwahk,et al.  ERP Acceptance: Organizational Change Perspective , 2006, Proceedings of the 39th Annual Hawaii International Conference on System Sciences (HICSS'06).

[102]  Eero Sormunen,et al.  A critical review of research on information behavior in assigned learning tasks , 2008, J. Documentation.

[103]  Shan Ling Pan,et al.  Enterprise Systems Use: Towards a Structurational Analysis of Enterprise Systems Induced Organizational Transformation , 2007, Commun. Assoc. Inf. Syst..

[104]  Dianne Jamieson-Noel,et al.  Implications of task structure on self‐regulated learning and achievement , 2009 .

[105]  Amy L. Sales,et al.  The implementation and adoption of new technology in organizations: The impact on work, people, and culture , 1991 .

[106]  E. Salas,et al.  Application of cognitive, skill-based, and affective theories of learning outcomes to new methods of training evaluation. , 1993 .

[107]  David Kember,et al.  Learning approaches, study time and academic performance , 1995 .

[108]  Gloria Banner,et al.  Working memory, cognitive style, and behavioural predictors of GCSE exam success , 2008 .

[109]  L. Argote,et al.  The persistence and transfer of learning in industrial settings , 1990 .

[110]  E. Rogers,et al.  Diffusion of innovations , 1964, Encyclopedia of Sport Management.

[111]  Elliot Bendoly,et al.  Order Lead-Time Improvement Following Enterprise Information Technology Implementation: An Empirical Study , 2006, MIS Q..

[112]  J. Mathieu,et al.  A Longitudinal Examination of Individual, Organizational, and Contextual Factors on Sales Technology Adoption and Job Performance , 2006 .

[113]  Deborah Compeau,et al.  Computer Self-Efficacy: Development of a Measure and Initial Test , 1995, MIS Q..

[114]  S. West,et al.  A comparison of methods to test mediation and other intervening variable effects. , 2002, Psychological methods.

[115]  I. Ajzen,et al.  Belief, Attitude, Intention, and Behavior: An Introduction to Theory and Research , 1977 .

[116]  Ben Light,et al.  A Critical Success Factors Model for ERP Implementation , 1999, IEEE Softw..

[117]  Elena Karahanna,et al.  Time Flies When You're Having Fun: Cognitive Absorption and Beliefs About Information Technology Usage , 2000, MIS Q..

[118]  Gerardine DeSanctis,et al.  Capturing the Complexity in Advanced Technology Use: Adaptive Structuration Theory , 1994 .

[119]  Jane M. Howell,et al.  Influence of Experience on Personal Computer Utilization: Testing a Conceptual Model , 1994, J. Manag. Inf. Syst..

[120]  Keith A. Markus,et al.  Principles and Practice of Structural Equation Modeling by Rex B. Kline , 2012 .

[121]  Anne Beaudry,et al.  Understanding User Responses to Information Technology: A Coping Model of User Adaption , 2005, MIS Q..

[122]  P. Ein-Dor,et al.  Organizational Context and the Success of Management Information Systems , 1978 .

[123]  John Hayes,et al.  Cognitive Style and its Relevance for Management Practice , 1994 .

[124]  Ephraim R. McLean,et al.  The DeLone and McLean Model of Information Systems Success: A Ten-Year Update , 2003, J. Manag. Inf. Syst..

[125]  Shu-Lun Wong,et al.  Approaches to Study of Distance Education Students. , 1992 .

[126]  William Tate Developing Managerial Competence: A Critical Guide to Methods and Materials , 1996 .

[127]  John K. Tsotsos Explanations and Predictions , 2011 .

[128]  Charles C. Ragin,et al.  Fuzzy-Set Social Science , 2001 .

[129]  Takeshi Kosaka,et al.  An effective architecture for Decision Support Systems , 1982, Inf. Manag..

[130]  Andreas Ritter,et al.  Structural Equations With Latent Variables , 2016 .

[131]  J. Elashoff,et al.  Multiple Regression in Behavioral Research. , 1975 .

[132]  Elaine H. Ferneley,et al.  Resist, comply or workaround? An examination of different facets of user engagement with information systems , 2006, Eur. J. Inf. Syst..

[133]  L. Sproull,et al.  Thinking About Implementation , 1986 .

[134]  Gordon B. Davis,et al.  User Acceptance of Information Technology: Toward a Unified View , 2003, MIS Q..

[135]  Venkatesh,et al.  Computer Technology Training in the Workplace: A Longitudinal Investigation of the Effect of Mood. , 1999, Organizational behavior and human decision processes.

[136]  Christopher W. Allinson,et al.  The Cognitive Style Index: A Measure of Intuition‐Analysis For Organizational Research , 1996 .

[137]  Daniel Robey,et al.  User Attitudes and Management Information System Use , 1979 .

[138]  Louis Raymond,et al.  Determinants of EIS use: Testing a behavioral model, , 1995, Decis. Support Syst..