Antecedents and consequences of perceived knowledge update in the context of an ERP simulation game: A multi-level perspective

Researchers and practitioners have encouraged the use of simulation games as a means of training for enhancing users' IT knowledge. However, prior research on IT knowledge has not paid much attention as to how individuals' perceptions of knowledge shift from the pre-training to the post-training state, and has focused mainly on individual-level interventions. Drawing on the theoretical foundation of belief and attitude change, this study examines the construct of perceived knowledge update (i.e., the difference between perceived post-training knowledge and perceived pre-training knowledge) and its antecedents and consequences. In particular, we examine team collaboration effectiveness at the team level and participant effort at the individual level as predictors of perceived ERP knowledge update, which then influences intention to learn about ERP systems. We tested our research model using 252 students in 85 teams in the context of an ERP (Enterprise Resource Planning) simulation game. ERP systems are a business process management software which allows an organization to utilize a system of integrated applications. ERP simulation games are designed to educate ERP system users on the complexities of such systems. Our results show that team collaboration effectiveness positively influences individual effort and perceived knowledge update. We also provide empirical evidence that individual effort positively affects perceived knowledge update which in turn influences intention to learn about ERP systems. This study examines perceived ERP knowledge update in the context of ERP training.This study identifies antecedents and consequences of perceived knowledge update.Team collaboration effectiveness significantly predicts perceived knowledge update.Individual effort positively influences perceived knowledge update.Perceived knowledge update affects intention to learn about ERP systems.

[1]  Fred D. Davis,et al.  User Acceptance of Computer Technology: A Comparison of Two Theoretical Models , 1989 .

[2]  Zoran Budimac,et al.  Wiki usage in team assignments for computer science students , 2011, CompSysTech '11.

[3]  Daniel T. Hickey,et al.  A multilevel analysis of the effects of external rewards on elementary students' motivation, engagement and learning in an educational game , 2014, Comput. Educ..

[4]  Ryad Titah,et al.  Information System Use - Related Activity: An Expanded Behavioral Conceptualization of Individual-Level Information System Use , 2007, Inf. Syst. Res..

[5]  Charles E. Naquin,et al.  The team halo effect: why teams are not blamed for their failures. , 2003, The Journal of applied psychology.

[6]  Angel Cabrera,et al.  Determinants of individual engagement in knowledge sharing , 2006 .

[7]  Dorothy E. Leidner,et al.  Review: Knowledge Management and Knowledge Management Systems: Conceptual Foundations and Research Issues , 2001, MIS Q..

[8]  R. Humphrey,et al.  Career development, collective efficacy, and individual task performance , 2009 .

[9]  Mark Sanderson,et al.  Understanding collaborative search for places of interest , 2016, J. Assoc. Inf. Sci. Technol..

[10]  Anol Bhattacherjee,et al.  Understanding Changes in Belief and Attitude Toward Information Technology Usage: A Theoretical Model and Longitudinal Test , 2004, MIS Q..

[11]  Kai H. Lim,et al.  Research Note - A Multilevel Analysis of the Effect of Group Appropriation on Collaborative Technologies Use and Performance , 2012, Inf. Syst. Res..

[12]  J. Cacioppo,et al.  Personal involvement as a determinant of argument based persuasion , 1981 .

[13]  C. Cramton The Mutual Knowledge Problem and Its Consequences for Dispersed Collaboration , 2001 .

[14]  Graeme G. Shanks,et al.  Differences in Critical Success Factors in ERP Systems Implementation in Australia and China: A Cultural Analysis , 2000, ECIS.

[15]  J. McGrath Time, Interaction, and Performance (TIP) , 1991 .

[16]  C. Fornell,et al.  Evaluating structural equation models with unobservable variables and measurement error. , 1981 .

[17]  D. DavisFred,et al.  User Acceptance of Computer Technology , 1989 .

[18]  Namkee Park,et al.  Effects of ego involvement and social norms on individuals' uploading intention on Wikipedia: A comparative study between the United States and South Korea , 2015, J. Assoc. Inf. Sci. Technol..

[19]  E. Rogers,et al.  Diffusion of innovations , 1964, Encyclopedia of Sport Management.

[20]  P. Bliese Group Size, ICC Values, and Group-Level Correlations: A Simulation , 1998 .

[21]  Laura Hall,et al.  Computer self-efficacy, training effectiveness and user attitudes: An empirical study , 1999, Behav. Inf. Technol..

[22]  Richard E. Petty,et al.  The Effects of Group Size on Cognitive Effort and Evaluation , 1977 .

[23]  D. Chan Functional Relations among Constructs in the Same Content Domain at Different Levels of Analysis: A Typology of Composition Models , 1998 .

[24]  E. Hutchins Cognition in the wild , 1995 .

[25]  Seth R. Silver,et al.  Taking Empowerment to the Next Level: A Multiple-Level Model of Empowerment, Performance, and Satisfaction , 2004 .

[26]  Rohit Aggarwal,et al.  Early to Adopt and Early to Discontinue: The Impact of Self-Perceived and Actual IT Knowledge on Technology Use Behaviors of End Users , 2015, Inf. Syst. Res..

[27]  John T. Cacioppo,et al.  Forewarning, cognitive responding, and resistance to persuasion. , 1977 .

[28]  Laura M. Padilla‐Walker,et al.  Negative and positive peer influence: Relations to positive and negative behaviors for African American, European American, and Hispanic adolescents. , 2009, Journal of adolescence.

[29]  Jason Bennett Thatcher,et al.  Moving Beyond Intentions and Toward the Theory of Trying: Effects of Work Environment and Gender on Post-Adoption Information Technology Use , 2005, MIS Q..

[30]  H. Raghav Rao,et al.  Knowledge Acquisition via Three Learning Processes in Enterprise Information Portals: Learning-by-Investment, Learning-by-Doing, and Learning-from-Others , 2005, MIS Q..

[31]  Yuwen Liu,et al.  Examining the antecedents of knowledge sharing in facilitating team innovativeness from a multilevel perspective , 2011, Int. J. Inf. Manag..

[32]  Huey-Wen Chou,et al.  Drivers and effects of post-implementation learning on ERP usage , 2014, Comput. Hum. Behav..

[33]  Deborah Compeau,et al.  Application of Social Cognitive Theory to Training for Computer Skills , 1995, Inf. Syst. Res..

[34]  Charles C. Manz,et al.  An Organizational Memory Approach to Information Management , 1998 .

[35]  S. Kozlowski,et al.  From Micro to Meso: Critical Steps in Conceptualizing and Conducting Multilevel Research , 2000 .

[36]  Mark Stansfield,et al.  Evaluation of a game to teach requirements collection and analysis in software engineering at tertiary education level , 2011, Comput. Educ..

[37]  J. Fleiss,et al.  Intraclass correlations: uses in assessing rater reliability. , 1979, Psychological bulletin.

[38]  Wynne W. Chin The partial least squares approach for structural equation modeling. , 1998 .

[39]  Alton Y. K. Chua The design and implementation of a simulation game for teaching knowledge management: Special Topic Section on Knowledge Management in Asia , 2005 .

[40]  Michael Barnett,et al.  Using Video Games to Support Pre-Service Elementary Teachers Learning of Basic Physics Principles , 2011 .

[41]  Robert W. Zmud,et al.  Behavioral Intention Formation in Knowledge Sharing: Examining the Roles of Extrinsic Motivators, Social-Psychological Factors, and Organizational Climate , 2005, MIS Q..

[42]  K. Sutcliffe,et al.  Management team learning orientation and business unit performance. , 2003, The Journal of applied psychology.

[43]  Molly McLure Wasko,et al.  The Effects of Leader-Member Exchange on Member Performance in Virtual World Teams , 2012, J. Assoc. Inf. Syst..

[44]  P. Kirschner,et al.  Team learning: building shared mental models , 2011 .

[45]  C. J. Wolfe,et al.  Knowledge Sharing: The Effects of Incentives, Environment, and Person , 2008, J. Inf. Syst..

[46]  E. E. Jones,et al.  Foundations of Social Psychology , 1967 .

[47]  Etienne Wenger,et al.  Situated Learning: Legitimate Peripheral Participation , 1991 .

[48]  Traci Sitzmann A META-ANALYTIC EXAMINATION OF THE INSTRUCTIONAL EFFECTIVENESS OF COMPUTER-BASED SIMULATION GAMES , 2011 .

[49]  Viswanath Venkatesh,et al.  Hype or Help? A Longitudinal Field Study of Virtual World Use for Team Collaboration , 2012, J. Assoc. Inf. Syst..

[50]  Ashok Ranchhod,et al.  Evaluating the educational effectiveness of simulation games: A value generation model , 2014, Inf. Sci..

[51]  Juho Hamari,et al.  Demographic differences in perceived benefits from gamification , 2014, Comput. Hum. Behav..

[52]  Gilbert Babin,et al.  Business simulation training in information technology education: Guidelines for new approaches in IT training , 2011 .

[53]  Ritu Agarwal,et al.  Adoption of Electronic Health Records in the Presence of Privacy Concerns: The Elaboration Likelihood Model and Individual Persuasion , 2009, MIS Q..

[54]  Lennart E. Nacke,et al.  From game design elements to gamefulness: defining "gamification" , 2011, MindTrek.

[55]  Timothy C. Brock,et al.  10 – Implications of Commodity Theory for Value Change1 , 1968 .

[56]  Hui Lin,et al.  Do feelings matter? The effects of intrinsic benefits on individuals' commitment toward knowledge systems , 2014, Comput. Hum. Behav..

[57]  R. Oliver A Cognitive Model of the Antecedents and Consequences of Satisfaction Decisions , 1980 .

[58]  Bernard J. Jaworski,et al.  Information Processing from Advertisements: Toward an Integrative Framework , 1989 .

[59]  Hing Keung Ma,et al.  A longitudinal study of peer and teacher influences on prosocial and antisocial behavior of Hong Kong Chinese adolescents , 2002 .

[60]  Anthony S. Bryk,et al.  Hierarchical Linear Models: Applications and Data Analysis Methods , 1992 .

[61]  Izak Benbasat,et al.  The Influence of Business Managers' IT Competence on Championing IT , 2003, Inf. Syst. Res..

[62]  Massimo Magni,et al.  What's the Weather Like? The Effect of Team Learning Climate, Empowerment Climate, and Gender on Individuals' Technology Exploration and Use , 2012, J. Manag. Inf. Syst..

[63]  L. James,et al.  Estimating within-group interrater reliability with and without response bias. , 1984 .

[64]  M. Markus,et al.  Information technology and organizational change: causal structure in theory and research , 1988 .

[65]  Alton Yeow-Kuan Chua,et al.  The design and implementation of a simulation game for teaching knowledge management , 2005, J. Assoc. Inf. Sci. Technol..

[66]  Naresh K. Malhotra,et al.  A Longitudinal Model of Continued IS Use: An Integrative View of Four Mechanisms Underlying Postadoption Phenomena , 2005, Manag. Sci..

[67]  E. A. Locke,et al.  Work Motivation and Satisfaction: Light at the End of the Tunnel , 1990 .

[68]  I. Ajzen,et al.  Belief, Attitude, Intention, and Behavior: An Introduction to Theory and Research , 1977 .

[69]  Richard G. Netemeyer,et al.  Handbook of Marketing Scales: Multi-Item Measures for Marketing and Consumer Behavior Research , 1993 .

[70]  A. Bandura Self-efficacy mechanism in human agency. , 1982 .

[71]  Jeylan T. Mortimer,et al.  Becoming Adult: How Teenagers Prepare for the World of Work.By Mihaly Csikszentmihalyi and Barbara Schneider. Basic Books, 2000. 289 pp , 2003 .

[72]  Timothy Paul Cronan,et al.  Developing and Assessing Erp Competencies: Basic and Complex Knowledge , 2016, J. Comput. Inf. Syst..

[73]  J. Sawyer Goal and Process Clarity: Specification of Multiple Constructs of Role Ambiguity and a Structural Equation Model of Their Antecedents and Consequences , 1992 .

[74]  A. Edmondson Psychological Safety and Learning Behavior in Work Teams , 1999 .

[75]  Elizabeth K. Bowman Measuring Team Collaboration in a Distributed Coalition Network , 2007 .

[76]  Qing Hu,et al.  The Centrality of Awareness in the Formation of User Behavioral Intention toward Protective Information Technologies , 2007, J. Assoc. Inf. Syst..

[77]  Pearson Prentice,et al.  Canonical Correlation a Supplement to Multivariate Data Analysis Multivariate Data Analysis , 2022 .

[78]  Timothy Paul Cronan,et al.  Comparing Objective Measures and Perceptions of Cognitive Learning in an ERP Simulation Game , 2012 .

[79]  Massimo Magni,et al.  Motivating Employees to Explore Collaboration Technology in Team Contexts , 2015, MIS Q..

[80]  S. C. Gardiner,et al.  ERP and the reengineering of industrial marketing processes , 2002 .

[81]  Judy A. Siguaw,et al.  Formative versus Reflective Indicators in Organizational Measure Development: A Comparison and Empirical Illustration , 2006 .

[82]  John T. Cacioppo,et al.  The Elaboration Likelihood Model of Persuasion , 1986, Advances in Experimental Social Psychology.