THE COMPARATIVE EFFECTIVENESS OF WEB-BASED AND CLASSROOM INSTRUCTION:

Meta-analytictechniqueswereusedtoexaminetheeffectivenessofWebbased instruction (WBI) relative to classroom instruction (CI) and to examine moderators of the comparative effectiveness of the 2 delivery media.TheoverallresultsindicatedWBIwas6%moreeffectivethanCI for teaching declarative knowledge, the 2 delivery media were equally effective for teaching procedural knowledge, and trainees were equally satisfied with WBI and CI. However, WBI and CI were equally effective for teaching declarative knowledge when the same instructional methods were used to deliver both WBI and CI, suggesting media effects are spurious and supporting Clark’s (1983, 1994) theory. Finally, WBI was 19% more effective than CI for teaching declarative knowledge when Web-based trainees were provided with control, in long courses, and when trainees practiced the training material and received feedback during training. Study limitations and directions for future research are discussed.

[1]  Ellen D. Wagner,et al.  In Support of a Functional Definition of Interaction , 1994 .

[2]  Dennis Earl Partrich.  An analysis of learning style and grade achievement in relation to Web-based and on-campus courses , 2003 .

[3]  Robert D. Tennyson,et al.  Computer-Based Instructional Systems for Adaptive Education: A Review. , 1983 .

[4]  Marcia J. Simmering,et al.  E-learning: emerging uses, empirical results and future directions , 2003 .

[5]  R. Clark.  Reconsidering Research on Learning from Media , 1983 .

[6]  Matthew Fleming,et al.  A comparison of in-class and online quizzes on student exam performance , 2003, J. Comput. High. Educ..

[7]  Roger Azevedo,et al.  A Meta-Analysis of the Effects of Feedback in Computer-Based Instruction , 1995 .

[8]  Clark Germann,et al.  Technical Communication on the Web: A Profile of Learners and Learning Environments , 1999 .

[9]  Eduardo Salas,et al.  Optimizing e‐learning: Research‐based guidelines for learner‐controlled training , 2004 .

[10]  Cathy Owens Swift,et al.  Retaining the Online Learner: Profile of Students in an Online MBA Program and Implications for Teaching Them , 2004 .

[11]  L. Davis,et al.  Comparison of student outcomes and preferences in a traditional vs. World Wide Web-based baccalaureate nursing research course. , 2000, The Journal of nursing education.

[12]  Stefanie B. Waschull,et al.  The Online Delivery of Psychology Courses: Attrition, Performance, and Evaluation , 2001 .

[13]  Robert J. Dufresne,et al.  The Effect of Web-Based Homework on Test Performance in Large Enrollment Introductory Physics Courses , 2002 .

[14]  N. Entwistle,et al.  Contrasting forms of understanding for degree examinations: the student experience and its implications , 1991 .

[15]  Gary M. Klass,et al.  An Experimental Evaluation of Web-Based Tutorial Quizzes , 2000 .

[16]  G. Latham.  Human Resource Training and Development , 1988 .

[17]  Michael Kerres,et al.  A Didactical Framework for the Design of Blended Learning Arrangements , 2003 .

[18]  K. Brown.  An examination of the structure and nomological network of trainee reactions: a closer look at "smile sheets". , 2005, The Journal of applied psychology.

[19]  Randi L. Sims,et al.  Learning in an Online Format versus an In-Class Format: An Experimental Study , 1999 .

[20]  W S Maki,et al.  Evaluation of a Web-based introductory psychology course: I. Learning and satisfaction in on-line versus lecture courses , 2000, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[21]  Kurt Kraiger,et al.  Perspectives on Training and Development , 2003 .

[22]  Diane M. Christophel.  The relationships among teacher immediacy behaviors, student motivation, and learning , 1990 .

[23]  Joseph S. Valacich,et al.  Using IT to Reengineer Business Education: An Exploratory Investigation of Collaborative Telelearning , 1995, MIS Q..

[24]  Cynthia L. Friend,et al.  Learner control in computer-based instruction: a current literature review , 1990 .

[25]  E. Bailey,et al.  Teaching via the Internet. , 1994 .

[26]  Ron Thomas,et al.  Web-Based Instruction , 1997, Encyclopedia of Education and Information Technologies.

[27]  Diane J. Hanson,et al.  E-Learning: Strategies for Delivering Knowledge in the Digital Age , 2003, J. Educ. Technol. Soc..

[28]  M A Woo,et al.  Comparison of Internet versus lecture instructional methods for teaching nursing research. , 2000, Journal of professional nursing : official journal of the American Association of Colleges of Nursing.

[29]  Jonathan Lewis Ross.  An exploratory analysis of post-secondary student achievement comparing a web-based and a conventional course learning environment , 2000 .

[30]  Penny Beile,et al.  Library Instruction and Graduate Professional Development: Exploring the Effect of Learning Environments on Self-Efficacy and Learning Outcomes. , 2002 .

[31]  Harold F. O'Neil,et al.  Meta-analytic studies of findings on computer-based instruction. , 1994 .

[32]  Richard L. Daft,et al.  Organizational information requirements, media richness and structural design , 1986 .

[33]  Harold Modell,et al.  Assessment of Student Performance , 2003 .

[34]  Gary J. Anglin.  Instructional technology : past, present, and future , 1995 .

[35]  E. Salas,et al.  Application of cognitive, skill-based, and affective theories of learning outcomes to new methods of training evaluation. , 1993 .

[36]  Scott D. Johnson,et al.  Comparative analysis of learner satisfaction and learning outcomes in online and face-to-face learning environments , 2000 .

[37]  Linda Cooper,et al.  A comparison of online and traditional computer applications classes , 2001 .

[38]  Gail H. Weems.  Comparison of Beginning Algebra Taught Onsite versus Online. , 2002 .

[39]  John E. Laird,et al.  Symbolic architectures for cognition , 1989 .

[40]  J. W. Asher,et al.  A meta‐analysis of the effectiveness of telecourses in distance education , 2000 .

[41]  Craig Eric Schneier,et al.  Developing and Training Human Resources in Organizations , 1983 .

[42]  R. Hallgren,et al.  An Interactive, Web‐based Tool for Learning Anatomic Landmarks , 2002, Academic medicine : journal of the Association of American Medical Colleges.

[43]  Tom Cobb,et al.  Cognitive efficiency: Toward a revised theory of media , 1997 .

[44]  S. Patrick.  GENDER DIFFERENCES AND THE ONLINE CLASSROOM: MALE AND FEMALE COLLEGE STUDENTS EVALUATE THEIR EXPERIENCES , 2001 .

[45]  J. B. Arbaugh,et al.  Is There an Optimal Design for On-Line MBA Courses? , 2005 .

[46]  W. Vaught,et al.  MedEthEx Online: A Computer-Based Learning Program in Medical Ethics and Communication Skills , 2000, Teaching and learning in medicine.

[47]  S. Wilson,et al.  Evaluation of The Psychology Place: A Web-Based Instructional Tool for Psychology Courses , 2002 .

[48]  Chen-Lin C. Kulik,et al.  Effectiveness of computer-based instruction: An updated analysis. , 1991 .

[49]  G Shaw,et al.  LEARNERS PERFORMANCE AND EVALUATION OF ATTITUDE TOWARDS WEB COURSE TOOLS IN THE DELIVERY OF AN APPLIED SPORTS SCIENCE MODULE , 2000 .

[50]  Blake Ives,et al.  Web-based Virtual Learning Environments: a Research Framework and a Preliminary Assessment of Effectiveness in Basic It Skills Training Author(s): Piccoli Et Al./web-based Virtual Learning Environments Web-based Virtual Learning Environments: a Research Framework and a Preliminary Assessment of Effe , 2022 .

[51]  John R. Pratt.  The Manager’s Role in Creating a Blended Learning Environment , 2002 .

[52]  Michael J. Strube,et al.  Validity Generalization: A Critical Review , 2004 .

[53]  Robert S. Feldman,et al.  Teaching in Cyberspace: Online versus Traditional Instruction Using a Waiting-List Experimental Design , 2004 .

[54]  P. Nick Blanchard,et al.  Effective Training: Systems, Strategies and Practices , 1998 .

[55]  Matt R. Raven,et al.  The Effects of World Wide Web Instruction and Traditional Instruction and Learning Styles on Achievement and Changes in Student Attitudes in a Technical Writing in Agricommunication Course , 1998 .

[56]  Sheila Tucker.  Distance Education: Better, Worse, Or As Good As Traditional Education? , 2001 .

[57]  Chen-Lin C. Kulik,et al.  Timing of Feedback and Verbal Learning , 1988 .

[58]  Regina Schoenfeld-Tacher,et al.  Do No Harm—A Comparison of the Effects of On-Line vs. Traditional Delivery Media on a Science Course , 2001 .

[59]  Winfred Arthur,et al.  Development of a new outlier statistic for meta-analytic data , 1995 .

[60]  Robert B. Kozma,et al.  A reply: Media and methods , 1994 .

[61]  Jessica M. Lahner,et al.  The Use and Effectiveness of a Web-Based Instructional Supplement in a College Student Success Program , 2002 .

[62]  Yung-Chen Hsu,et al.  The effectiveness of computer-assisted instruction in statistics education: a meta-analysis , 2003 .

[63]  Fred D. Davis.  Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[64]  M L Sole,et al.  Enhancing traditional, televised, and videotaped courses with Web-based technologies: a comparison of student satisfaction. , 2001, Nursing outlook.

[65]  G. Yukl,et al.  Training and development in work organizations. , 1992 .

[66]  Frederick L. Oswald,et al.  Meta-analysis and the art of the average. , 2003 .

[67]  Fayiz Mensher Alzafiri.  An experimental investigation on the effects of Web-based instruction/training on cognitive and psychomotor learning , 2000 .

[68]  I. Goldstein.  Training in Work Organizations , 1980 .

[69]  J. B. Arbaugh,et al.  Virtual Classroom versus Physical Classroom: An Exploratory Study of Class Discussion Patterns and Student Learning in an Asynchronous Internet-Based MBA Course , 2000 .

[70]  William S Maki,et al.  Multimedia comprehension skill predicts differential outcomes of web-based and lecture courses. , 2002, Journal of experimental psychology. Applied.

[71]  M. Aruguete,et al.  Are Computer-Assisted Teaching Methods Effective? , 2004 .

[72]  Chen-Lin C. Kulik,et al.  Effectiveness of Computer-based College Teaching: A Meta-analysis of Findings , 1980 .

[73]  P. Warr,et al.  TRAINEE CHARACTERISTICS AND THE OUTCOMES OF OPEN LEARNING , 1995 .

[74]  Neal P. Curtin,et al.  Military Transformation: Progress and Challenges for DOD's Advanced Distributed Learning Programs , 2003 .

[75]  Winston Bennett,et al.  Conducting Meta-Analysis Using SAS , 2001 .

[76]  Randall S. Davies,et al.  Evaluation Comparison of Online and Classroom Instruction for HEPE 129--Fitness and Lifestyle Management Course. , 1998 .

[77]  S. Smith,et al.  The effectiveness of traditional instructional methods in an online learning environment , 1998 .

[78]  Xiao-Hua Zhou,et al.  Statistical Methods for Meta‐Analysis , 2008 .

[79]  Herbert J. Walberg,et al.  Learner-Control Effects: A Review of Reviews and a Meta-Analysis , 1996 .

[80]  P. Shefler.  The adult learner. , 1971, Washington State journal of nursing.

[81]  Tung Bui,et al.  Effect of Student Attitude to Course Format on Learning Performance: An Empirical Study in Web vs. Lecture Instruction , 2000 .

[82]  J. Mathieu,et al.  Applying Utility Concepts to a Training Program in Supervisory Skills: A Time-Based Approach , 1987 .

[83]  Sylvia E. White.  The Effectiveness of Web-Based Instruction: A Case Study. , 1999 .

[84]  Nanci A. Scheetz,et al.  Online versus Traditional Classroom Delivery of a Course in Manual Communication , 2004 .

[85]  James Daniel Lehman,et al.  Comparison of Performance and Attitude in Traditional and Computer Conferencing Classes. , 1991 .

[86]  A. Glenn,et al.  A Comparison of Distance Learning and Traditional Learning Environments. , 2001 .

[87]  Rebecca Kathryn Spiros.  Individual differences in motivation during distance training: The influence of goal orientation and self-efficacy on learning outcomes. , 2003 .

[88]  Christopher L. Aberson,et al.  Evaluation of an Interactive Tutorial for Teaching Hypothesis Testing Concepts , 2003 .

[89]  Y. Liao.  Effects of hypermedia on students' achievement: a meta-analysis , 1999 .

[90]  Bradley Barker.  A comparison research model for adult distributed training , 2002 .

[91]  Klaus Schmidt,et al.  Classroom Action Research: A Case Study Assessing Students' Perceptions and Learning Outcomes of Classroom Teaching versus On-line Teaching. , 2002 .

[92]  Mauri Collins,et al.  Effective Student Outcomes: A Comparison of Online and Face-to-Face Delivery Modes , 1999 .

[93]  A. P. Rovai.  Building classroom community at a distance: A case study , 2001 .

[94]  Joyce Marie Schmeeckle.  Online Training: An Evaluation of the Effectiveness and Efficiency of Training Law Enforcement Personnel over the Internet , 2003 .

[95]  Shauna Hughes Frisbie.  Sexual harassment: A comparison of online versus traditional training methods , 2001 .

[96]  Lanny Arvan,et al.  The SCALE Efficiency Projects , 1998 .

[97]  Gavriel Salomon,et al.  AI in Reverse: Computer Tools That Turn Cognitive , 1988 .

[98]  Curtis J. Bonk,et al.  Future Directions of Blended Learning in Higher Education and Workplace Learning Settings , 2005 .

[99]  James Burton Browning.  Analysis of concepts and skills acquisition differences between Web-delivered and classroom-delivered undergraduate instructional technology courses , 1999 .

[100]  J. B. Arbaugh.  Learner-Centered Theory and Practice in Distance Education: Cases From Higher Education. , 2005 .

[101]  E. Salas,et al.  The science of training: a decade of progress. , 2001, Annual review of psychology.

[102]  John P. Campbell,et al.  Personnel Training and Development , 1971 .

[103]  Kimberly Kay Taylor.  Evaluation of an online psychology class , 2001 .

[104]  David West,et al.  Cyber Dimensions: On-Line Education in a Management Science Course—Effectiveness and Performance Factors , 2000 .

[105]  Raymond A. Noe,et al.  Employee Training and Development , 2001 .

[106]  Irwin L. Goldstein,et al.  Training in organizations: Needs assessment, development, and evaluation , 1986 .

[107]  Mike Moore,et al.  Self-directed learning and distance education , 1986 .

[108]  Shu-Sheng Liaw.  Designing the Hypermedia-Based Learning Environment , 2001 .

[109]  Martin Tessmer,et al.  Planning and conducting formative evaluations , 1993 .

[110]  Ryan Sain,et al.  The Effect of a Threaded Discussion Component on Student Satisfaction and Performance , 2003 .

[111]  Starr Roxanne Hiltz,et al.  Correlates of Learning in a Virtual Classroom , 1993, Int. J. Man Mach. Stud..

[112]  Tamara L. Faux,et al.  A Comparison of Using the Internet versus Lectures to Teach Social Work History , 2000 .

[113]  Jesse M. Heines.  Evaluating the effect of a course Web site on student performance , 2000, J. Comput. High. Educ..

[114]  Robert A. Wisher,et al.  The Effectiveness of Web-Based Instruction: An Initial Inquiry. , 2002 .

[115]  Hsien-Chin Liou,et al.  The Impact of WWW Texts on EFL Learning , 1997 .

[116]  Clint McKinnis,et al.  Comparison of Student Outcomes and Preferences in a Traditional vs World Wide Web-Based Baccalaureate Nursing Research Course. LeasureAR, Davis L, Thievon SL (University of Oklahoma, Oklahoma City, Okla). JNurs Educ. 2000;39:149-154. , 2001 .

[117]  Robert B. Pankey.  Piloting Exercise Physiology in the Web-Based Environment , 1998 .

[118]  Michael P. Clements.  Decision-based Evaluation , 2005 .

[119]  Mariano Bernardez.  From E-Training to E-Performance: Putting Online Learning To Work. , 2003 .

[120]  Michael Z. Hackman,et al.  Instructional communication in the televised classroom: The effects of system design and teacher immediacy on student learning and satisfaction , 1990 .

[121]  Alfred P. Rovai,et al.  On-Line Course Effectiveness: An Analysis of Student Interactions and Perceptions of Learning , 2007 .

[122]  Frederick Burns King.  Asynchronous distance education courses employing web-based instruction : implications of individual study skills self-efficacy and self-regulated learning , 2001 .

[123]  M. Allen,et al.  Comparing Student Satisfaction With Distance Education to Traditional Classrooms in Higher Education: A Meta-Analysis , 2002 .

[124]  Robert M. Bernard,et al.  How Does Distance Education Compare With Classroom Instruction? A Meta-Analysis of the Empirical Literature , 2004 .

[125]  Yong Zhao,et al.  What Makes the Difference? A Practical Analysis of Research on the Effectiveness of Distance Education , 2005, Teachers College Record: The Voice of Scholarship in Education.

[126]  Johnette Caulfield.  Examining the effect of teaching method and learning style on work performance for practicing home care clinicians , 2001 .

[127]  P. Whitten,et al.  Re‐thinking instructional immediacy for web courses: A social cognitive exploration , 2000 .

[128]  Lee M. Stadtlander.  Virtual Instruction: Teaching an Online Graduate Seminar , 1998 .

[129]  Brad Mehlenbacher,et al.  Active and interactive learning online: a comparison of Web-based and conventional writing classes , 2000 .

[130]  JoAnn Greco,et al.  GOING THE DISTANCE FOR MBA CANDIDATES , 1999 .

[131]  Zoi-Helen Mylona.  Factors affecting enrollment satisfaction and persistence in a Web-based video-based and conventional instruction , 1998 .

[132]  Thomas Andre,et al.  Delayed retention effect: Attention, perseveration, or both? , 1989 .

[133]  Ellen M. Whitener,et al.  Confusion of confidence intervals and credibility intervals in meta-analysis. , 1990 .

[134]  Harvey Singh,et al.  Building Effective Blended Learning Programs , 2021, Challenges and Opportunities for the Global Implementation of E-Learning Frameworks.

[135]  K. N. Wexley,et al.  Personnel Training , 2002, Water-Related Death Investigation.

[136]  Dian R. Moorhouse.  Effect of Instructional Delivery Method on Student Achievement in a Master's of Business Administration Course at the Wayne Huizenga School of Business and Entrepreneurship. , 2001 .

[137]  B. Rounsaville,et al.  We don't train in vain: a dissemination trial of three strategies of training clinicians in cognitive-behavioral therapy. , 2005, Journal of consulting and clinical psychology.

[138]  Matthew Fleming,et al.  A Comparison of In-Class Quizzes vs. Online Quizzes on Student Exam Performance. , 2003 .

[139]  J. Webster,et al.  Teaching Effectiveness in Technology-Mediated Distance Learning , 1997 .

[140]  Dorothy E. Leidner,et al.  Research Commentary: Technology-Mediated Learning - A Call for Greater Depth and Breadth of Research , 2001, Inf. Syst. Res..

[141]  Christopher L. Aberson,et al.  Evaluation of an Interactive Tutorial for Teaching the Central Limit Theorem , 2000 .

[142]  Donald K. Woodward.  Virtual-Recitation: A World Wide Web Based Approach to Active Learning in Clinical Pharmacokinetics. , 1998 .

[143]  T. Newby,et al.  Instruction: Classroom lecture/discussion vs. Live televised instruction: A comparison of effects on student performance, attitude, and interaction , 1989 .

[144]  Scott A. Myers,et al.  Student perceptions of instructor immediacy in conventional and distributed learning classrooms , 1998 .

[145]  William H. Glick,et al.  Understanding Technology-Structure Relationships: Theory Development and Meta-Analytic Theory Testing , 1991 .

[146]  Dwight W. Allen,et al.  Education and Technology: The Changing Basics. , 1980 .

[147]  Alvin Y. Wang,et al.  Characteristics of students who enroll and succeed in psychology Web-based classes. , 2000 .

[148]  Tim H. Murphy,et al.  An Evaluation of a Distance Education Course Design for General Soils. , 2000 .

[149]  Robert D. Tennyson,et al.  Advisement and management strategies as design variables in computer-assisted instruction , 1980 .

[150]  Hiller A. Spires,et al.  Exploring the Academic Self within an Electronic Mail Environment , 2001 .

[151]  Michael Collins,et al.  Comparing Web, Correspondence and Lecture versions of a second-year non-major Biology course , 2000, Br. J. Educ. Technol..

[152]  M. Knowles.  The adult learner : a neglected species , 1979 .

[153]  Graham R. Gibbs,et al.  Learning how to learn using a virtual learning environment for philosophy , 1999, J. Comput. Assist. Learn..

[154]  Mohammad Naim Yaakub.  Meta-Analysis of the Effectiveness of Computer-Assisted Instruction in Technical Education and Training , 1998 .

[155]  P. Navarro,et al.  Performance and perceptions of distance learners in cyberspace , 2000 .

[156]  R. Clark.  Media will never influence learning , 1994 .

[157]  Mary K. Tallent-Runnels,et al.  Teaching Courses Online: A Review of the Research , 2006 .

[158]  Starr Roxanne Hiltz,et al.  Asynchronous learning networks as a virtual classroom , 1997, CACM.

[159]  Thomas Buchanan,et al.  The efficacy of a World-Wide Web mediated formative assessment , 2001, J. Comput. Assist. Learn..

[160]  Wendy J. Casper,et al.  Examining the factor structure of participant reactions to training: A multidimensional approach , 2000 .

[161]  R. A. Dumont,et al.  Teaching and learning in cyberspace , 1996 .

[162]  Matt R. Raven,et al.  A comparison of traditional and world wide web methodologies, computer anxiety and higher order thinking skills in the in-service training of mississippi 4-h extension agents , 2000 .

[163]  G. Glass,et al.  Meta-analysis in social research , 1981 .

[164]  Allison Rossett.  The ASTD e-Learning Handbook: Best Practices, Strategies and Case Studies for an Emerging Field , 2001 .

[165]  J. D. Fletcher.  Effectiveness and Cost of Interactive Videodisc Instruction in Defense Training and Education , 1990 .

[166]  D C Schaad,et al.  Evaluating the serial migration of an existing required course to the World Wide Web. , 1999, Academic medicine : journal of the Association of American Medical Colleges.

[167]  Harold F. O'Neil,et al.  Technology assessment in education and training , 1994 .

[168]  Winston Bennett,et al.  A META-ANALYSIS OF THE RELATIONS AMONG TRAINING CRITERIA , 1997 .

[169]  Ellen Lunts,et al.  What does the Literature Say about the Effectiveness of Learner Control in Computer-Assisted Instruction ? , 2002 .

[170]  Jeffrey V. Fredda.  Comparison of Selected Student Outcomes for Internet- and Campus-Based Instruction at the Wayne Huizenga Graduate School of Business and Entrepreneurship. , 2000 .

[171]  James M. Royer,et al.  Techniques and Procedures for Assessing Cognitive Skills , 1993 .

[172]  Margaret L. Rice,et al.  A Comparison of Student Outcomes & Satisfaction between Traditional & Web Based Course Offerings , 2002 .

[173]  Russell T. Hurlburt.  “Lectlets” Deliver Content at a Distance: Introductory Statistics as a Case Study , 2001 .

[174]  L. DiBartola,et al.  Do learning style and learning environment affect learning outcome? , 2001, Journal of allied health.

[175]  John P. Buerck,et al.  Learning Environments and Learning Styles: Non-traditional Student Enrollment and Success in an Internet-based Versus a Lecture-based Computer Science Course , 2003 .