How Does ERPsim Influence Students' Perceived Learning Outcomes in an Information Systems Course? An Empirical Study

1. INTRODUCTION Today, business processes and decision making depend heavily on information systems such as Enterprise Resource Planning (ERP). ERP are complex information systems, which integrate business processes and decision-making at the organizational level. Understanding business processes and being able to use enterprise software are skills in great demand by industry and many business schools require the teaching of hands-on skills in ERP. However, it is a challenge for instructors to teach and students to learn business processes and ERP software in the classroom since business students often lack knowledge of real-world business processes and have limited IT skills available to operate an ERP software application (Leger, 2006; Seethamraju, 2011). To overcome this difficulty, many business schools have introduced ERP simulation software to their curriculum. Using simulation games in business education is an innovative pedagogical approach. By playing software games, students can understand better business processes and ERP from learning by doing (Leger, 2006). ERPsim (ERP Simulation Game) is an ERP teaching-learning software tool developed by HEC Montreal, Canada. ERPsim simulates a real-world marketplace in which virtual companies can operate business processes using a commercial version of SAP software (Leger, 2006). In the classroom, student teams operate a virtual wholesale beverage distribution company using a SAP client. Each team uses standard ERP reports and transactions to manage all business processes involved in the marketing, inventory, sales, and forecasting of various bottled water products. The teams analyze these transactions and review financial reports during the simulation and compete against each other in the same marketplace with the goal of maximizing profit. The simulated marketplace provides students with opportunities to practice their business strategies and to develop hands-on skills to manage business processes using SAP clients. "Using the SAP simulation, students also develop technical skills through direct interaction with an actual SAP client." (Cronan and Douglas, 2012, p. 4). Worldwide, over 130 universities have adopted ERPsim (https://erpsim.hec.ca/en/about/participating_universities) in their IS or other business courses. Pedagogical evidences suggest that ERPsim improves students' learning performance in IS courses (Leger, 2006; Seethamraju, 2011; Cronan and Douglas, 2012). However, an extensive literature review indicates that little is known about causal relationships among cognitive-psychological factors, learning behavior and learning outcomes. There is also a lack of theory-supported empirical studies on the effectiveness of ERPsim in students' learning behavior and performance. In particular, no empirical study has investigated how cognitive-psychological antecedents influence students' learning behavior and outcomes when they used ERPsim as a learning tool. It is not known what these factors are and how they improve students' learning performance when using ERPsim. This study aims to close the research gap with an empirical examination of the effects of some psychological factors on students' learning behavior and outcomes when they participate in ERPsim games in the classroom. Specifically, a theoretical model is proposed to investigate the effects of enjoyment and cognitive appraisal on the behavioral intention to use the learning tool and the effectiveness of the learning tool. The effects of enjoyment and cognitive appraisal on behavior are well acknowledged in both IS and pedagogy literature (e.g., Davis, Bagozzi, and Warshaw, 1992; Venkatesh, 2000; Van der Heijden, 2004; Wakefield and Whitten, 2006; Beaudry and Pinsonneault, 2005; Fadel and Brown, 2010). The contribution of this study is twofold. First, the researchers extend upon prior research of ERPsim by focusing on causal relations among antecedent variables and learning behavior and outcomes. …

[1]  Joan A. Ballantine,et al.  Computer usage and the validity of self-assessed computer competence among first-year business students , 2007, Comput. Educ..

[2]  Christine Legner,et al.  Designing Capstone Courses in Management Education: Knowledge Activation and Integration Using an ERP-based Simulation Game , 2013, ICIS.

[3]  Charmain Cilliers,et al.  A Comprehensive, Competency-Based Education Framework Using Medium Sized ERP Systems , 2012, J. Inf. Syst. Educ..

[4]  Dominique Sluijsmans,et al.  Creating a Learning Environment by Using Self-, Peer- and Co-Assessment , 1998 .

[5]  I. Ajzen The theory of planned behavior , 1991 .

[6]  Alan D. Carswell,et al.  Learner outcomes in an asynchronous distance education environment , 2002, Int. J. Hum. Comput. Stud..

[7]  Dag H. Olsen,et al.  Educating reflective Enterprise Systems practitioners: a design research study of the iterative building of a teaching framework , 2014, Inf. Syst. J..

[8]  Fred D. Davis,et al.  Extrinsic and Intrinsic Motivation to Use Computers in the Workplace1 , 1992 .

[9]  Youngjin Yoo,et al.  A Comparative Study of Distributed Learning Environments on Learning Outcomes , 2002, Inf. Syst. Res..

[10]  Younghwa Lee,et al.  Designing usable online stores: A landscape preference perspective , 2009, Inf. Manag..

[11]  H. Wold Causal flows with latent variables: Partings of the ways in the light of NIPALS modelling , 1974 .

[12]  Andrew N. K. Chen,et al.  Can Online Wait Be Managed? The Effect of Filler Interfaces and Presentation Modes on Perceived Waiting Time Online , 2012, MIS Q..

[13]  Khaled A. Alshare,et al.  Predicting Student-Perceived Learning Outcomes and Satisfaction in ERP Courses: An Empirical Investigation , 2011, Commun. Assoc. Inf. Syst..

[14]  Rex B. Kline,et al.  Principles and Practice of Structural Equation Modeling , 1998 .

[15]  Susan A. Brown,et al.  Information Systems Appraisal and Coping: The Role of User Perceptions , 2010, Commun. Assoc. Inf. Syst..

[16]  Viswanath Venkatesh,et al.  User Acceptance Enablers in Individual Decision Making About Technology: Toward an Integrated Model , 2002, Decis. Sci..

[17]  Mun Y. Yi,et al.  Predicting the use of web-based information systems: self-efficacy, enjoyment, learning goal orientation, and the technology acceptance model , 2003, Int. J. Hum. Comput. Stud..

[18]  Blair H. Sheppard,et al.  The Theory of Reasoned Action: A Meta-Analysis of Past Research with Recommendations for Modifications and Future Research , 1988 .

[19]  L. Moratis,et al.  A dual challenge facing management education: Simulation‐based learning and learning about CSR , 2006 .

[20]  S. Folkman,et al.  Stress, appraisal, and coping , 1974 .

[21]  Viswanath Venkatesh,et al.  Determinants of Perceived Ease of Use: Integrating Control, Intrinsic Motivation, and Emotion into the Technology Acceptance Model , 2000, Inf. Syst. Res..

[22]  C. Fornell,et al.  Evaluating structural equation models with unobservable variables and measurement error. , 1981 .

[23]  Wynne W. Chin,et al.  A Partial Least Squares Latent Variable Modeling Approach for Measuring Interaction Effects: Results from a Monte Carlo Simulation Study and an Electronic - Mail Emotion/Adoption Study , 2003, Inf. Syst. Res..

[24]  Jane M. Howell,et al.  Personal Computing: Toward a Conceptual Model of Utilization , 1991, MIS Q..

[25]  Anne Beaudry,et al.  Understanding User Responses to Information Technology: A Coping Model of User Adaption , 2005, MIS Q..

[26]  J. Grimshaw,et al.  Constructing questionnaires based on the theory of planned behaviour: A manual for health services researchers , 2004 .

[27]  Robin L. Wakefield,et al.  Mobile computing: a user study on hedonic/utilitarian mobile device usage , 2006, Eur. J. Inf. Syst..

[28]  Andrew N. K. Chen,et al.  Usability Design and Psychological Ownership of a Virtual World , 2011, J. Manag. Inf. Syst..

[29]  Steven McEachern,et al.  Experiential Learning in Social Science Theory: An investigation of the relationship between student enjoyment and learning , 2003 .

[30]  Rudolf R. Sinkovics,et al.  The Use of Partial Least Squares Path Modeling in International Marketing , 2009 .

[31]  Jeffrey S. Harper,et al.  Assurance of Learning in the MIS Program. , 2009 .

[32]  Tal Ben-Zvi,et al.  Using Business Games in Teaching DSS , 2007, J. Inf. Syst. Educ..

[33]  Elena Karahanna,et al.  Time Flies When You're Having Fun: Cognitive Absorption and Beliefs About Information Technology Usage , 2000, MIS Q..

[34]  Marios Koufaris,et al.  Applying the Technology Acceptance Model and Flow Theory to Online Consumer Behavior , 2002, Inf. Syst. Res..

[35]  Joan Ballantine,et al.  Evaluating the validity of self-assessment: measuring computer literacy among entry-level undergraduates within accounting degree programmes at two UK universities , 2003 .

[36]  Michael Bieber,et al.  Acceptance of Educational Technology: Field Studies of Asynchronous Participatory Examinations , 2010, Commun. Assoc. Inf. Syst..

[37]  Jawaid A. Ghani,et al.  The Experience Of Flow In Computer-Mediated And In Face-To-Face Groups , 1991, ICIS.

[38]  Detmar W. Straub,et al.  Structural Equation Modeling and Regression: Guidelines for Research Practice , 2000, Commun. Assoc. Inf. Syst..

[39]  Timothy Paul Cronan,et al.  A Student ERP Simulation Game: A Longitudinal Study , 2012, J. Comput. Inf. Syst..

[40]  Izak Benbasat,et al.  Quo vadis TAM? , 2007, J. Assoc. Inf. Syst..

[41]  S. Breckler Empirical validation of affect, behavior, and cognition as distinct components of attitude. , 1984, Journal of personality and social psychology.

[42]  T. M. Rajkumar,et al.  Are Student Self-Assessments a Valid Proxy for Direct Assessments in Efforts to Improve Information Systems Courses and Programs? An Empirical Study , 2011, Commun. Assoc. Inf. Syst..

[43]  R. Bagozzi,et al.  On the nature and direction of relationships between constructs and measures. , 2000, Psychological methods.

[44]  Ravi Seethamraju,et al.  Enhancing Student Learning of Enterprise Integration and Business Process Orientation through an ERP Business Simulation Game , 2011, J. Inf. Syst. Educ..

[45]  Wynne W. Chin The partial least squares approach for structural equation modeling. , 1998 .

[46]  Detmar W. Straub,et al.  Specifying Formative Constructs in Information Systems Research , 2007, MIS Q..

[47]  Joseph E LeDoux Emotion: clues from the brain. , 1995, Annual review of psychology.

[48]  Paul A. Pavlou,et al.  Understanding and Predicting Electronic Commerce Adoption: An Extension of the Theory of Planned Behavior , 2006, MIS Q..

[49]  Heshan Sun,et al.  Causal Relationships between Perceived Enjoyment and Perceived Ease of Use: An Alternative Approach , 2006, J. Assoc. Inf. Syst..

[50]  Dov Te'eni,et al.  Review: A Cognitive-Affective Model of Organizational Communication for Designing IT , 2001, MIS Q..

[51]  Barbara A. Price,et al.  Assessing Learning Outcomes in Quantitative Courses: Using Embedded Questions for Direct Assessment , 2008 .

[52]  Jan-Bernd Lohmoller,et al.  The PLS Program System: Latent Variables Path Analysis with Partial Least Squares Estimation. , 1988, Multivariate behavioral research.

[53]  J. Nunnally Psychometric Theory (2nd ed), New York: McGraw-Hill. , 1978 .

[54]  Hans van der Heijden,et al.  User Acceptance of Hedonic Information Systems , 2004, MIS Q..

[55]  Robert Tibshirani,et al.  An Introduction to the Bootstrap , 1994 .

[56]  Ronald E. Rice,et al.  Technology adaption: the case of a computer-supported inter-organizational virtual team 1 , 2000 .

[57]  Ronald E. Rice,et al.  Technology Adaptation: The Case of a Computer-Supported Inter-Organizational Virtual Team , 2000, MIS Q..