Web-based Virtual Learning Environments: a Research Framework and a Preliminary Assessment of Effectiveness in Basic It Skills Training Author(s): Piccoli Et Al./web-based Virtual Learning Environments Web-based Virtual Learning Environments: a Research Framework and a Preliminary Assessment of Effe

Internet technologies are having a significant impact on the learning industry. For-profit organizations and traditional institutions of higher education have developed and are using web-based courses, but little is known about their effectiveness compared to traditional classroom education. Our work focuses on the effectiveness of a web-based virtual learning environment (VLE) in the context of basic information technology skills training. This article provides three main contributions. First, it introduces and defines the concept of VLE, discussing how a VLE differs from the traditional classroom and differentiating it from the related, but narrower, concept of computer aided instruction (CAI). Second, it presents a framework of VLE effectiveness, grounded in the technology-mediated learning literature, which frames the VLE research domain, and addresses the relationship between the main constructs. Finally, it focuses on one essential VLE design variable, learner control, and compares a web-based VLE to a traditional classroom through a longitudinal experimental design. Our results indicate that, in the context of IT basic skills training in undergraduate education, there are no significant differences in performance between students enrolled in the two environments. However, the VLE leads to higher reported computer self-efficacy, while participants report being less satisfied with the learning process.

[1]  R. Clark Media will never influence learning , 1994 .

[2]  E. R. Steinberg Cognition and learner control: a literature review, 1977–1988 , 1989 .

[3]  James T. C. Teng,et al.  The Relationship of Information System Training Methods and Cognitive Ability to End-User Satisfaction, Comprehension, and Skill Transfer: A Longitudinal Field Study , 1996, Inf. Syst. Res..

[4]  Roger Bailey,et al.  A New School. , 1979 .

[5]  Charles M. Reigeluth,et al.  Instructional Design Theories and Models : An Overview of Their Current Status , 1983 .

[6]  J. Webster,et al.  Teaching Effectiveness in Technology-Mediated Distance Learning , 1997 .

[7]  Thomas C. Reeves,et al.  Pseudoscience in Computer-Based Instruction: The Case of Learner Control Research. , 1993 .

[8]  S. Green,et al.  The effects of three social decision schemes on decision group process , 1980 .

[9]  Dorothy E. Leidner,et al.  Research Commentary: Technology-Mediated Learning - A Call for Greater Depth and Breadth of Research , 2001, Inf. Syst. Res..

[10]  Thomas Hill,et al.  Role of efficacy expectations in predicting the decision to use advanced technologies: The case of computers. , 1987 .

[11]  Deborah Compeau,et al.  Application of Social Cognitive Theory to Training for Computer Skills , 1995, Inf. Syst. Res..

[12]  Deborah Compeau,et al.  Computer Self-Efficacy: Development of a Measure and Initial Test , 1995, MIS Q..

[13]  Carol Saunders,et al.  Computerspeak: Message Content and Perceived Appropriateness in an Educational Setting , 1993 .

[14]  Maryam Alavi,et al.  Computer-Mediated Collaborative Learning: An Empirical Evaluation , 1994, MIS Q..

[15]  J. G. Schutte,et al.  Virtual teaching in higher education: The new intellectual superhighway or just another traffic jam , 1995 .

[16]  Patrick J. Schloss,et al.  Learner Control over Feedback as a Variable in Computer Assisted Instruction , 1988 .

[17]  Leslie J. Briggs,et al.  The affective and cognitive domains : integration for instruction and research , 1986 .

[18]  David H. Jonassen,et al.  Learning Strategies: A New Educational Technology , 1985 .

[19]  Sirkka L. Jarvenpaa,et al.  The Use of Information Technology to Enhance Management School Education: A Theoretical View , 1995, MIS Q..

[20]  Robert M. Fano Computer-Mediated Communication , 1985, IEEE Technology and Society Magazine.

[21]  Starr Roxanne Hiltz,et al.  The Virtual Classroom: Learning Without Limits Via Computer Networks , 1994 .

[22]  J. Walther Interpersonal Effects in Computer-Mediated Interaction , 1992 .

[23]  R. Tennyson Instructional control strategies and content structure as design variables in concept acquisition using computer-based instruction. , 1980 .

[24]  Sirkka L. Jarvenpaa,et al.  The Information Age Confronts Education: Case Studies on Electronic Classrooms , 1993, Inf. Syst. Res..

[25]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[26]  P. Evans,et al.  Strategy and the new economics of information. , 1997, Harvard business review.

[27]  David H. Jonassen The trouble with learning environments , 1993 .

[28]  Dietmar Wolfram Audiographics for Distance Education: A Case Study in Student Attitudes and Perceptions , 1994 .

[29]  Philippe C. Duchastel,et al.  Intelligent Computer Assisted Instruction Systems: The Nature of Learner Control , 1986 .

[30]  M. Sherif,et al.  The psychology of attitudes. , 1946, Psychological review.

[31]  R. Tennyson Use of Adaptive Information for Advisement in Learning Concepts and Rules Using Computer-assisted Instruction , 1981 .

[32]  Rosemary L. Newkirk A Comparison of Learner Control and Machine Control Strategies for Computer‐Assisted Instruction , 1973 .

[33]  K. Brown,et al.  The role of internal and external factors in the discontinuation of off‐campus students , 1996 .

[34]  Detmar W. Straub,et al.  Gender Differences in the Perception and Use of E-Mail: An Extension to the Technology Acceptance Model , 1997, MIS Q..

[35]  S. Jarvenpaa,et al.  Will the Internet revolutionize business education and research? Sloan Management Review , 1996 .

[36]  M. Lepper Microcomputers in education: Motivational and social issues. , 1985 .

[37]  Noriko Hara,et al.  Students’ Distress with a Web-based Distance Education Course: An Ethnographic Study of Participants' Experiences , 2003 .

[38]  Gabriele Piccoli,et al.  Virtual Learning Environments: An Information Technology Basic Skills Course on the Web , 1998 .

[39]  W. Milheim,et al.  Theoretical bases for the use of learner control: Three different perspectives. , 1991 .

[40]  W S Maki,et al.  Evaluation of a Web-based introductory psychology course: I. Learning and satisfaction in on-line versus lecture courses , 2000, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[41]  Joseph S. Valacich,et al.  Using IT to Reengineer Business Education: An Exploratory Investigation of Collaborative Telelearning , 1995, MIS Q..

[42]  Marilyn E. Gist,et al.  EFFECTS OF ALTERNATIVE TRAINING METHODS ON SELF-EFFICACY AND PERFORMANCE IN COMPUTER SOFTWARE TRAINING , 1989 .

[43]  Starr Roxanne Hiltz,et al.  The “Virtual Classroom”: Using Computer‐Mediated Communication for University Teaching , 1986 .

[44]  S.-S. Lee,et al.  Adaptive program vs. learner control strategy on computer aided learning of gravimetric stoichiometry problems , 1989 .

[45]  Joseph J. Martocchio,et al.  Microcomputer playfulness: development of a measure with workplace implications , 1992 .

[46]  D B Yoffie,et al.  Judo strategy. The competitive dynamics of Internet time. , 1999, Harvard business review.

[47]  Starr Roxanne Hiltz,et al.  Teaching in a Virtual Classroom , 1995 .

[48]  Robert M. Gagné,et al.  The Conditions of Learning and Theory of Instruction , 1985 .

[49]  Blake Ives,et al.  Knowledge management in academia: A proposed framework , 2000, Inf. Technol. Manag..

[50]  M. Chi,et al.  The Content of Physics Self-Explanations , 1991 .

[51]  Michael J. Hannafin,et al.  A framework for the study of hypertext , 1994 .

[52]  Kim Kiser 10 Things We Know So Far about Online Training. , 1999 .

[53]  J. Keller Motivational Design of Instruction , 1983 .

[54]  B. Wilson Constructivist Learning Environments: Case Studies in Instructional Design , 1995 .

[55]  E. H. Robson,et al.  Learner Control in Computer Assisted Learning. , 1985 .

[56]  Starr Roxanne Hiltz,et al.  An Assessment of Group Support Systems Experimental Research: Methodology and Results , 1998, J. Manag. Inf. Syst..

[57]  M. David Merrill,et al.  Instructional Design Theory , 1971 .

[58]  Rosalie A. Wells,et al.  Computer-Mediated Communications for Distance Education and Training: Literature Review and International Resources , 1990 .

[59]  Michael J. Jacobson,et al.  Hypertext Learning Environments, Cognitive Flexibility, and the Transfer of Complex Knowledge: an Empirical Investigation Center for the Study of Reading Center for the Study of Reading Hypertext Learning Environments, Cognitive Flexibility, and the Transfer of Complex Knowledge: an Empirical Invest , 2007 .

[60]  Michal Beller,et al.  The Crossroads between Lifelong Learning and Information Technology, A Challenge Facing Leading Universities , 2006, J. Comput. Mediat. Commun..

[61]  David H. Jonassen,et al.  Handbook of Research for educational Communications and Technology , 1997 .

[62]  Allan Collins,et al.  Cognitive Apprenticeship and Instructional Technology , 1988 .

[63]  Seong-Soo Lee,et al.  Effects of Learner-Control versus Program-Control Strategies on Computer-Aided Learning of Chemistry Problems: For Acquisition or Review?. , 1991 .

[64]  Betty Collis,et al.  Anticipating the impact of multimedia in education : lessons from literature , 1991 .

[65]  Steven Hackbarth,et al.  The Educational Technology Handbook: A Comprehensive Guide : Process and Products for Learning , 1996 .