Assessment of Effectiveness of Web-based Training on Demand

e-Learning is bringing training to the attention of upper management in a way that other learning technologies have never done. Web-based training will remain predominant to the design and delivery of workplace learning in the 21st century because of its advantages over traditional classroom-based training. A comprehensive framework that delineates the relationship between learner control and learning effectiveness in educational training is absent. This study therefore aims to fill this void. Unlike previous relevant research, this study compares learning effectiveness between two educational training delivery methodologies: traditional classroom-based training (TCT) and web-based training (WBT). Our framework focuses on learning effectiveness of web training in the context of the educational training programmes of two colleges' administration application systems. Based on the WBT literature, this study uses a model that investigates the relationship between learner control and learning effectiveness under five dimensions: learning performance, learner satisfaction, accumulation of learning experience, document navigation, and problem solving. To compare learning effectiveness between TCT and WBT we conducted a field experiment. Data were collected from two colleges that received training on their administration application systems. A total of 288 usable responses were analysed. The results allow five conclusions to be drawn: (1) learners receiving WBT achieved better learning performance than their counterparts receiving TCT; (2) learners receiving WBT reported higher levels of satisfaction than their counterparts with the traditional approach; (3) learners receiving WBT accumulated more learning experience than their counterparts with TCT; (4) WBT provided more integrated document navigation than the traditional format; (5) WBT offered faster problem solving mechanisms than TCT. The implications of this study are discussed and further research directions are proposed.

[1]  R. Gagne.  Conditions of Learning , 1965 .

[2]  William C. Chu,et al.  ANTS: Agent-Based Navigational Training System , 2005, ICWL.

[3]  Morten T. Hansen,et al.  What's your strategy for managing knowledge? , 1999, Harvard business review.

[4]  Alan Freedman.  The Computer Desktop Encyclopedia , 1996 .

[5]  M. Lepper.  Microcomputers in education: Motivational and social issues. , 1985 .

[6]  Stuart A. Sutton.  Building a Web-based Education System , 1999 .

[7]  Leslie J. Briggs,et al.  The affective and cognitive domains : integration for instruction and research , 1986 .

[8]  Xianggui Qu,et al.  Multivariate Data Analysis , 2007, Technometrics.

[9]  Sirkka L. Jarvenpaa,et al.  The Use of Information Technology to Enhance Management School Education: A Theoretical View , 1995, MIS Q..

[10]  Thomas H. Davenport,et al.  The Attention economy , 2001, UBIQ.

[11]  G. Loos,et al.  Occupational Safety and Health Training on the Internet , 2001, AAOHN journal : official journal of the American Association of Occupational Health Nurses.

[12]  Huey B. Long,et al.  Resources Related to Overcoming Resistance to Self-Direction in Learning. , 1994 .

[13]  E. R. Steinberg.  Cognition and learner control: a literature review, 1977–1988 , 1989 .

[14]  Charles M. Reigeluth,et al.  Instructional Design Theories and Models : An Overview of Their Current Status , 1983 .

[15]  David H. Jonassen,et al.  Handbook of Research for educational Communications and Technology , 1997 .

[16]  M. Merrill.  Learner control: Beyond aptitude-treatment interactions , 1975 .

[17]  William C. Chu,et al.  Applying dynamic fuzzy petri net to web learning system , 2005, Interact. Learn. Environ..

[18]  James T. C. Teng,et al.  The Relationship of Information System Training Methods and Cognitive Ability to End-User Satisfaction, Comprehension, and Skill Transfer: A Longitudinal Field Study , 1996, Inf. Syst. Res..

[19]  Michael Riley,et al.  Tracing Skills Accumulated through Experience: A Method of Skill Auditing , 1994 .

[20]  Jean-Paul A. Barthès,et al.  Knowledge Management , 1994, Encyclopedia of Database Systems.

[21]  Young-Jin Lee.  The Effect of Creating External Representations on the Efficiency of Web Search , 2004, Interact. Learn. Environ..

[22]  C. Douglas Wetzel,et al.  Instructional Effectiveness of Video Media , 1994 .

[23]  Maryam Alavi,et al.  Computer-Mediated Collaborative Learning: An Empirical Evaluation , 1994, MIS Q..

[24]  Peter J. Smith.  Enhancing flexible business training: learners and enterprises , 2001 .

[25]  Jeffrey J. Reuer,et al.  Interorganizational Routines and Performance in Strategic Alliances , 2002, Organ. Sci..

[26]  W. Milheim,et al.  Theoretical bases for the use of learner control: Three different perspectives. , 1991 .

[27]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[28]  William Haseman,et al.  User attitude as a mediator of learning performance improvement in an interactive multimedia environment: an empirical investigation of the degree of interactivity and learning styles , 2001, Int. J. Hum. Comput. Stud..

[29]  Scott W. Brown,et al.  Learner Control versus Program Control in Interactive Videodisc Instruction: What Are the Effects in Procedural Learning?. , 1992 .

[30]  Kim Kiser.  10 Things We Know So Far about Online Training. , 1999 .

[31]  Peter Roberts,et al.  Information technology acceptance in a sample of government employees: a test of the technology acceptance model , 2000, Interact. Comput..

[32]  J. Keller.  Motivational Design of Instruction , 1983 .

[33]  S. Debowski.  Knowledge Management , 2005 .

[34]  Shu-Hsien Liao,et al.  Problem solving and knowledge inertia , 2002, Expert Syst. Appl..

[35]  Gezinus J. Hidding,et al.  Anatomy of a learning organization: turning knowledge into capital at Andersen Consulting , 1998 .

[36]  Betty Collis,et al.  Learner Led Learning in an Online Community The central role of the learner and its benefits , 2001 .

[37]  Esther R. Steinberg,et al.  Review of Student Control in Computer-Assisted Instruction , 1977 .

[38]  Jonathon N. Cummings.  Work Groups, Structural Diversity, and Knowledge Sharing in a Global Organization , 2004, Manag. Sci..

[39]  Michael Bieber,et al.  Backtracking in a multiple-window hypertext environment , 1994, ECHT '94.

[40]  Jakob Nielsen,et al.  Designing Web Usability: The Practice of Simplicity , 1999 .

[41]  Jay Liebowitz,et al.  Knowledge management and its link to artificial intelligence , 2001, Expert Syst. Appl..

[42]  Chiung-Hui Chiu,et al.  The Influence of Navigation Map Scope on Disorientation of Elementary Students in Learning a Web-Based Hypermedia Course , 2000 .

[43]  Lynda Margaret Stansfield.  “Employee ‐ develop yourself!” Experiences of self‐directed learners , 1997 .

[44]  Brian T. Pentland,et al.  Information systems and organizational learning: The social epistemology of organizational knowledge systems , 1995 .

[45]  KIMBERLY A. LAWLESS,et al.  Multimedia learning environments: Issues of learner control and navigation , 1997 .

[46]  Sven Erik Nordenbo.  How Do Computer Novices Perceive Information Technology? A Qualitative Study Based on a New Methodology , 1990 .

[47]  Joseph S. Valacich,et al.  Using IT to Reengineer Business Education: An Exploratory Investigation of Collaborative Telelearning , 1995, MIS Q..

[48]  Eric von Hippel,et al.  Locating Adaptive Learning: The Situated Nature of Adaptive Learning in Organizations , 1997 .

[49]  N. Bontis.  Intellectual capital: an exploratory study that develops measures and models , 1998 .

[50]  Chien-Hung Liu,et al.  Learning effectiveness in a Web-based virtual learning environment: a learner control perspective , 2005, J. Comput. Assist. Learn..

[51]  Paul G. Shotsberger.  Instructional Uses of the World Wide Web: Exemplars and Precautions. , 1996 .

[52]  Allen Tough,et al.  The adult's learning projects , 1979 .

[53]  J. McNally.  Self-Directed Learning, A Guide for Learners and Teachers , 1976 .

[54]  Ikujiro Nonaka,et al.  A firm as a dialectical being: towards a dynamic theory of a firm , 2002 .

[55]  Blake Ives,et al.  Web-based Virtual Learning Environments: a Research Framework and a Preliminary Assessment of Effectiveness in Basic It Skills Training Author(s): Piccoli Et Al./web-based Virtual Learning Environments Web-based Virtual Learning Environments: a Research Framework and a Preliminary Assessment of Effe , 2022 .

[56]  M. David Merrill.  Learner control in computer based learning , 1980 .

[57]  Howard J. Sullivan,et al.  Navigational Aids and Learner Control in Hypermedia Instructional Programs , 1998 .

[58]  Robert D. Sherwood,et al.  Hypermedia in Science and Mathematics: Applications in Teacher Education, Problem Solving and Student Testing , 1997 .

[59]  Michael J. Hannafin,et al.  Guidelines for using locus of instructional control in the design of computer-assisted instruction , 1984 .

[60]  Gene Golovchinsky.  Going back in Hypertext , 2002, HYPERTEXT '02.

[61]  Nicholas J. Belkin,et al.  A case for interaction: a study of interactive information retrieval behavior and effectiveness , 1996, CHI.

[62]  Philip C. Candy,et al.  Self-Direction for Lifelong Learning: A Comprehensive Guide to Theory and Practice , 1991 .

[63]  Omar El Sawy,et al.  Redesigning the Customer Support Process for the Electronic Economy: Insights From Storage Dimensions , 1997, MIS Q..

[64]  Kathleen M. Eisenhardt,et al.  Integrating Knowledge in Groups: How Formal Interventions Enable Flexibility , 2002, Organ. Sci..

[65]  W. Ocasio.  TOWARDS AN ATTENTION-BASED VIEW OF THE FIRM , 1997 .