Assessing ERP Learning (Management, Business Process, and Skills) and Attitudes

Critical to successful implementation and maximizing the potential benefits of enterprise resource planning (ERP) systems are knowledgeable and skilled users. Effective training for the required knowledge and skills is both difficult and challenging. Focusing on the assessment of ERP learning, this research develops learning constructs based on Kang and Santhanam’s (2003-4) collaborative application learning model. A valid and reliable ERP learning instrument that can be used to measure ERP learning and attitudes toward ERP is presented. The ERP learning instrument consists of three constructs (16 items) to measure ERP learning (business process knowledge, enterprise systems management knowledge, and transaction skills) as well as measures of attitudes toward ERP (instrument available from the authors at no cost) . The results of the study indicate that an ERP simulation game enhanced student learning and influenced student attitudes toward an ERP system. DOI: 10.4018/joeuc.2013040104 60 Journal of Organizational and End User Computing, 25(2), 59-74, April-June 2013 Copyright © 2013, IGI Global. Copying or distributing in print or electronic forms without written permission of IGI Global is prohibited. focused on research associated with the assessment of cognitive learning in business simulations. The authors indicate that little progress has occurred in objectively assessing cognitive learning in simulations and call for research that might help determine whether simulations accomplish what they purport to achieve in terms of participant learning. Seethamraju (2011) focused on the use of an ERP simulation game in learning enterprise resource planning (ERP) concepts. He attempts to address some of the concerns raised by Anderson and Lawton (2009); his results suggest that an ERP simulation game had a significant impact on students’ ERP abilities and contributed to learning in addition to significant improvements in their process orientation and skills. The current research develops ERP learning constructs designed to assess cognitive learning. Using Kang and Santhanam’s (2003-4) collaborative application learning model, ERP learning measures (based initially on Seethamraju’s (2011) items) are further developed and refined into ERP knowledge constructs for assessing ERP learning. Consequently, a valid and reliable ERP learning instrument used to measure ERP learning and attitudes toward ERP is presented and made available. This research develops, validates, and presents a sixteen (16) item instrument using three constructs to measure ERP learning – business process knowledge, transaction skills, and enterprise systems management knowledge. In addition, measures of attitude toward ERP are presented. Moreover, based on multiple samples of learners that used an ERP simulation game, this study presents evidence of significant improvements in ERP learning and significant changes in attitude toward ERP and ERP software. RELATED STUDIES: ENTERPRISE SYSTEMS TRAINING AND KNOWLEDGE In response to rapidly increasing competitive pressures and significant uncertainty in the current business environment, organizations are increasingly moving toward integrating their functional processes as a major strategy in information systems. In the past few years, ERP systems have had a significant impact on business organizations (Liang, et al., 2007). Consequently, universities and corporate training programs have incorporated some of the commonly used ERP systems (e.g., SAP, Oracle and Microsoft Dynamics) into curricula and training (Hayen & Andrea, 2003; Antonucci et al., 2004). This is primarily a result of the everincreasing use of ERP and enterprise systems as a significant component of the business. These large commercial software packages enable the integration of transaction-oriented data and business processes throughout the organization (Brehm et al., 2000). ERP systems were developed to replace functional information systems, which typically operate in silos within an organization and generate inefficiencies and inconsistencies due to their lack of integration. Even with widespread adoption of ERP, new implementations continue to have challenges and failures (Momoh, 2010)1. These failures underscore the need for education and training. Businesses are making significant investments in ERP systems with the goal of providing faster, higher quality decision-making information through the integration of processes which eliminates functional information silos. One result of this widespread implementation of ERP systems is an increase in the demand for professionals who have knowledge and skills of ERP systems and their underlying integrated processes. This demand creates new challenges for business schools and IS (information systems) programs. Business instructors have typically delivered their education through functional-based courses such as marketing, operations, finance, and accounting (Cannon, Klein, Koste, & Magal, 2004). Education through a function-based courses approach has been criticized because it does not prepare students to work with cross-functional systems that are becoming increasingly common in this ERP era (Malekzadeh, 1998). Yet, until recently few learning methods other than comprehensive case-based methods have been available 14 more pages are available in the full version of this document, which may be purchased using the "Add to Cart" button on the product's webpage: www.igi-global.com/article/assessing-erp-learningmanagement-business/76877?camid=4v1 This title is available in InfoSci-Journals, InfoSci-Journal Disciplines Communications and Social Science, InfoSciSelect, InfoSci-Technology Adoption, Ethics, and Human Computer Interaction eJournal Collection, InfoSciManagement Science and Organizational Research eJournal Collection, InfoSci-Journal Disciplines Computer Science, Security, and Information Technology, InfoSci-Journal Disciplines Business, Administration, and Management. Recommend this product to your librarian: www.igi-global.com/e-resources/libraryrecommendation/?id=2

[1]  Spyros Lalis,et al.  Ad-hoc composition in wearable and mobile computing , 2005, CACM.

[2]  Qing Hu,et al.  Assimilation of Enterprise Systems: The Effect of Institutional Pressures and the Mediating Role of Top Management , 2007, MIS Q..

[3]  Ravi Seethamraju,et al.  Enhancing Student Learning of Enterprise Integration and Business Process Orientation through an ERP Business Simulation Game , 2011, J. Inf. Syst. Educ..

[4]  Lorne Olfman,et al.  Rethinking end-user training strategy: applying a hierarchical knowledge-level model , 1999 .

[5]  Radhika Santhanam,et al.  Using Self-Regulatory Learning to Enhance E-Learning-Based Information Technology Training , 2008, Inf. Syst. Res..

[6]  Lorne Olfman,et al.  ERP training strategies: conceptual training and the formation of accurate mental models , 2003, SIGMIS CPR '03.

[7]  Helmut Schneider,et al.  Using ERP Systems in Education , 1999, Commun. Assoc. Inf. Syst..

[8]  T. M. Rajkumar,et al.  Teaching ERP Concepts in a Capstone Course , 2007 .

[9]  P. Anderson,et al.  Business Simulations and Cognitive Learning , 2009 .

[10]  Brian H. Cameron,et al.  Enterprise systems education: new directions & challenges for the future , 2008, SIGMIS CPR '08.

[11]  Radhika Santhanam,et al.  A Longitudinal Field Study of Training Practices in a Collaborative Application Environment , 2003, J. Manag. Inf. Syst..

[12]  Gilbert Babin,et al.  Assessing the dimensionality of an objective measurement of ERP knowledge , 2009 .

[13]  Marie-Claude Boudreau,et al.  Learning to use ERP technology: a causal model , 2003, 36th Annual Hawaii International Conference on System Sciences, 2003. Proceedings of the.

[14]  Fred D. Davis,et al.  Developing and Validating an Observational Learning Model of Computer Software Training and Skill Acquisition , 2003, Inf. Syst. Res..

[15]  Ravi Seethamraju,et al.  Enterprise Systems (ES) Software in Business School Curriculum: Evaluation of Design and Delivery , 2007, J. Inf. Syst. Educ..

[16]  Fred D. Davis,et al.  Improving computer skill training: behavior modeling, symbolic mental rehearsal, and the role of knowledge structures. , 2004, The Journal of applied psychology.

[17]  Ali R. Malekzadeh Diversity, Integration, Globalization, and Critical Thinking in the Upper Division , 1998 .

[18]  Lorne Olfman,et al.  End-user training and learning , 1995, CACM.

[19]  Robert P. Bostrom,et al.  Technology-Mediated Learning: A Comprehensive Theoretical Model , 2009, J. Assoc. Inf. Syst..

[20]  M. Lynne Markus,et al.  Tailoring ERP systems: a spectrum of choices and their implications , 2001, Proceedings of the 34th Annual Hawaii International Conference on System Sciences.

[21]  Rajkumar Roy,et al.  Challenges in enterprise resource planning implementation: state-of-the-art , 2010, Bus. Process. Manag. J..

[22]  Gail Corbitt,et al.  Enterprise Systems Education: Where are We? Where are We Going? , 2004, J. Inf. Syst. Educ..

[23]  R. Ryan Nelson,et al.  The assessment of end-user training needs , 1995, CACM.

[24]  Paul H. Cheney,et al.  Training End Users: An Exploratory Study , 1987, MIS Q..

[25]  Gordon B. Davis,et al.  User Acceptance of Information Technology: Toward a Unified View , 2003, MIS Q..

[26]  David M. Cannon,et al.  Curriculum Integration Using Enterprise Resource Planning: An Integrative Case Approach , 2004 .

[27]  Upkar Varshney,et al.  Networking Support For Mobile Computing , 1999, Commun. Assoc. Inf. Syst..

[28]  Vincent S. Lai,et al.  Evaluating end-user training programs , 2005, CACM.

[29]  Saul Rockman In school or out: technology, equity, and the future of our kids , 1995, CACM.

[30]  Aleda V. Roth,et al.  Enterprise Resource Planning (ERP) Competence Constructs: Two-Stage Multi-Item Scale Development and Validation , 2002, Decis. Sci..