The promised land of blended learning: Quizzes as a moderator

Abstract Blended learning, defined as a combination of face-to-face and online learning, is expected to lead to improved education. Besides, practical reasons, like increased access to education and resource management, are mentioned for its implementation. To examine whether the expectation of improved education is met, meta-analyses were conducted. They revealed that, on average, blended learning is somewhat more effective than more traditional learning. Additionally, students evaluated it as equally attractive, but seemed to perceive it as more demanding. In sum, blended learning is equal, or maybe even better, than more traditional learning. However, the effects on effectiveness, attractiveness and perceived demands differed much between studies. Moderator analyses found that quizzes positively affect the effectiveness and attractiveness of blended learning. Concluding, blended learning has potential to improve education, when thoughtfully designed, for example by the inclusion of frequent quizzes.

[1]  Curtis J. Bonk,et al.  Future Directions of Blended Learning in Higher Education and Workplace Learning Settings , 2005 .

[2]  Richard E. Mayer,et al.  Multimedia learning and games. , 2011 .

[3]  Frances A. May,et al.  Does the Method of Instruction Matter? An Experimental Examination of Information Literacy Instruction in the Online, Blended, and Face-to-Face Classrooms , 2010 .

[4]  David Kumrow,et al.  Evidence-based strategies of graduate students to achieve success in a hybrid Web-based course. , 2007, The Journal of nursing education.

[5]  Charles R. Graham,et al.  An analysis of high impact scholarship and publication trends in blended learning , 2012 .

[6]  P. Kirschner,et al.  Taking the Load Off a Learner's Mind: Instructional Design for Complex Learning , 2003 .

[7]  Jason W. Lancaster,et al.  'Tech' versus 'talk': a comparison study of two different lecture styles within a Master of Science nurse practitioner course. , 2012, Nurse education today.

[8]  Charles R. Graham,et al.  An analysis of research trends in dissertations and theses studying blended learning , 2013, Internet High. Educ..

[9]  Jeffrey D. Karpicke,et al.  Correcting a metacognitive error: feedback increases retention of low-confidence correct responses. , 2008, Journal of experimental psychology. Learning, memory, and cognition.

[10]  B. Means,et al.  The Effectiveness of Online and Blended Learning: A Meta-Analysis of the Empirical Literature , 2013, Teachers College Record: The Voice of Scholarship in Education.

[11]  Younghee Sung,et al.  Blended learning on medication administration for new nurses: integration of e-learning and face-to-face instruction in the classroom. , 2008, Nurse education today.

[12]  Charles R. Graham,et al.  A thematic analysis of the most highly cited scholarship in the first decade of blended learning research , 2014, Internet High. Educ..

[13]  K. Spitzer,et al.  Blended learning positively affects students’ satisfaction and the role of the tutor in the problem-based learning process: results of a mixed-method evaluation , 2009, Advances in health sciences education : theory and practice.

[14]  Jeffrey D. Karpicke,et al.  The Power of Testing Memory Basic Research and Implications for Educational Practice , 2006 .

[15]  Robin Newhouse,et al.  Reconceptualization of a doctoral EBP course from in-class to blended format: lessons learned from a successful transition. , 2013, Journal of professional nursing : official journal of the American Association of Colleges of Nursing.

[16]  I. E. Allen,et al.  Blending In The Extent and Promise of Blended Education in the United States , 2007 .

[17]  Ünal Çakıroğlu,et al.  Comparison Of Novice Programmers’ Performances: Blended Versus Face-To-Face , 2012 .

[18]  Glenn H. Bracht,et al.  The External Validity of Experiments1 , 1968 .

[19]  A. C. Butler,et al.  Feedback enhances the positive effects and reduces the negative effects of multiple-choice testing , 2008, Memory & cognition.

[20]  Li-Ling Hsu,et al.  Effects of a blended learning module on self-reported learning performances in baccalaureate nursing students. , 2011, Journal of advanced nursing.

[21]  Milan Taradi,et al.  Blending problem-based learning with Web technology positively impacts student learning outcomes in acid-base physiology. , 2005, Advances in physiology education.

[22]  Charles R. Graham,et al.  Blended Learning Models , 2009 .

[23]  Shanna Smith Jaggars,et al.  Effectiveness of Fully Online Courses for College Students: Response to a Department of Education Meta-Analysis , 2010 .

[24]  S. King,et al.  Integration of e-learning technologies in an interprofessional health science course , 2008, Medical teacher.

[25]  David Lester Neumann,et al.  The Effects of Using a Wiki on Student Engagement and Learning of Report Writing Skills in a University Statistics Course. , 2009 .

[26]  Homeyra Sadaghiani Using Multimedia Learning Modules in a Hybrid-Online Course in Electricity and Magnetism , 2011 .

[27]  Saskia Brand-Gruwel,et al.  Does a New Learning Environment Come Up to Students' Expectations? A Longitudinal Study , 2008 .

[28]  Mu'tasem Adileh Teaching Music as a University Elective Course through e-Learning , 2010 .

[29]  R. Clark Media will never influence learning , 1994 .

[30]  Maria Bartini An Empirical Comparison of Traditional and Web-Enhanced Classrooms , 2008 .

[31]  F. N. Dempster,et al.  The spacing effect: A case study in the failure to apply the results of psychological research. , 1988 .

[32]  Charles R. Graham Emerging Practice and Research in Blended Learning , 2012 .

[33]  Barbara Costello,et al.  Using Blackboard in Library Instruction: Addressing the Learning Styles of Generations X and Y , 2004 .

[34]  Robert A. Wisher,et al.  THE COMPARATIVE EFFECTIVENESS OF WEB-BASED AND CLASSROOM INSTRUCTION: , 2006 .

[35]  Ernst Z. Rothkopf,et al.  Contextual Enrichment and Distribution of Practice in the Classroom , 1984 .

[36]  Eva Martínez-Caro,et al.  Factors affecting students’ satisfaction in engineering disciplines: traditional vs. blended approaches , 2011 .

[37]  Anthony G. Picciano BLENDING WITH PURPOSE: THE MULTIMODAL MODEL , 2009, Online Learning.

[38]  Bünyamin Atici,et al.  Influence of the Online Learning Environments and Tools on the Student Achievement and Opinions. , 2010 .

[39]  Vinesh Chandra,et al.  The methodological nettle: ICT and student achievement , 2008, Br. J. Educ. Technol..

[40]  G. Edwards,et al.  Innovative Health Information Technology Training: Exploring Blended Learning , 2012, Computers, informatics, nursing : CIN.

[41]  Eunjung Oh,et al.  The present and future state of blended learning in workplace learning settings in the United States , 2008 .

[42]  Jean P Molleston,et al.  Methods and Effects of a Case-based Pediatric Gastroenterology Online Curriculum , 2013, Journal of pediatric gastroenterology and nutrition.

[43]  Jennifer George-Palilonis,et al.  Blended Learning in the Visual Communications Classroom: Student Reflections on a Multimedia Course , 2009 .

[44]  Mark W. Lipsey,et al.  Practical Meta-Analysis , 2000 .

[45]  Reginald O. York,et al.  COMPARING THREE MODES OF INSTRUCTION IN A GRADUATE SOCIAL WORK PROGRAM , 2008 .

[46]  P. Lachenbruch Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[47]  J. Pereira,et al.  Effectiveness of using blended learning strategies for teaching and learning human anatomy , 2007, Medical education.

[48]  Clement C. Chen,et al.  Blended Learning vs. Traditional Classroom Settings: Assessing Effectiveness and Student Perceptions in an MBA Accounting Course , 2007 .

[49]  James A. Kulik,et al.  Effects of Frequent Classroom Testing. , 1991 .

[50]  Vincent L Salyers Teaching Psychomotor Skills to Beginning Nursing Students Using a Web-Enhanced Approach: A Quasi-Experimental Study , 2007, International journal of nursing education scholarship.

[51]  Diane Salter,et al.  A "Hybrid" Bacteriology Course: The Professor's Design and Expectations; The Students' Performance and Assessment. , 2005, Microbiology education.

[52]  Charles R. Graham BLENDED LEARNING SYSTEMS: DEFINITION, CURRENT TRENDS, AND FUTURE DIRECTIONS , 2005 .

[53]  Martijn P. F. Berger,et al.  The effect of distributed practice on students’ conceptual understanding of statistics , 2011 .

[54]  J. Forte,et al.  To ITV or Not to ITV: A Comparison of Hybrid and Web-enhanced Approaches to Teaching a Macro-course in Human Behavior in the Social Environment , 2011 .

[55]  P. Winne,et al.  Feedback and Self-Regulated Learning: A Theoretical Synthesis , 1995 .

[56]  Vinesh Chandra,et al.  Re-thinking physics teaching with web-based learning , 2012, Comput. Educ..

[57]  Paul A. Kirschner,et al.  The Testing Effect for Learning Principles and Procedures from Texts , 2014 .

[58]  Richard F. Schmid,et al.  The effects of technology use in postsecondary education: A meta-analysis of classroom applications , 2014, Comput. Educ..

[59]  Özgen Korkmaz,et al.  The Impact of Blended Learning Model on Student Attitudes towards Geography Course and Their Critical Thinking Dispositions and Levels , 2009 .

[60]  K. Tsiklakis,et al.  Evaluation of a blended learning course for teaching oral radiology to undergraduate dental students. , 2012, European journal of dental education : official journal of the Association for Dental Education in Europe.

[61]  L. Hedges,et al.  Introduction to Meta‐Analysis , 2009, International Coaching Psychology Review.

[62]  B. Erovic,et al.  A new blended learning concept for medical students in otolaryngology. , 2012, Archives of otolaryngology--head & neck surgery.

[63]  Saskia Brand-Gruwel,et al.  Towards more powerful learning environments through combining the perspectives of designers, teachers, and students. , 2005, The British journal of educational psychology.

[64]  Hasan Akbayin,et al.  The Effect of Blended Learning Model on High School Students' Biology Achievement and on Their Attitudes towards the Internet. , 2012 .

[65]  R. Kozma Will media influence learning? Reframing the debate , 1994 .

[66]  Yu-Fen Yang,et al.  Blended learning for college students with English reading difficulties , 2012 .

[67]  Gary J. Senn Comparison of Face-To-Face and Hybrid Delivery of a Course that Requires Technology Skills Development , 2008 .

[68]  Corey Matthews,et al.  Participatory Action Research and City Youth: Methodological Insights from the Council of Youth Research , 2013, Teachers College Record: The Voice of Scholarship in Education.

[69]  Robert M. Bernard,et al.  A Meta-Analysis of Three Types of Interaction Treatments in Distance Education , 2009 .

[70]  L. Hedges Distribution Theory for Glass's Estimator of Effect size and Related Estimators , 1981 .

[71]  R. Kozma Learning with Media , 1991 .

[72]  Vincent L Salyers Web-Enhanced and Face-to-Face Classroom Instructional Methods: Effects on Course Outcomes and Student Satisfaction , 2005, International journal of nursing education scholarship.

[73]  Nikolaos Vernadakis,et al.  A Comparison of Student Satisfaction between Traditional and Blended Technology Course Offerings in Physical Education. , 2012 .

[74]  R. Clark Reconsidering Research on Learning from Media , 1983 .

[75]  Charles D. Dziuban,et al.  Blended Learning: Research Perspectives , 2007 .

[76]  Yuhao Chen,et al.  Effects of a vocabulary acquisition and assessment system on students' performance in a blended learning class for English subject , 2012, Comput. Educ..

[77]  D. Cook The failure of e-learning research to inform educational practice, and what we can do about it , 2009, Medical teacher.

[78]  Mariana Lapidus,et al.  Combined Use of Online Tutorials and Hands-On Group Exercises in Bibliographic Instruction for Pharmacy Students , 2012, Medical reference services quarterly.

[79]  Tom Cobb,et al.  Cognitive efficiency: Toward a revised theory of media , 1997 .

[80]  M. Arroyo-Morales,et al.  A blended learning approach to palpation and ultrasound imaging skills through supplementation of traditional classroom teaching with an e-learning package. , 2012, Manual therapy.

[81]  Jason Cole,et al.  Using Market Segmentation to Develop a Large Section, Web-enhanced Survey Course , 2006 .

[82]  Ömer Delialioglu,et al.  Design and development of a technology enhanced hybrid instruction based on MOLTA model: Its effectiveness in comparison to traditional instruction , 2008, Comput. Educ..

[83]  Nikolaos Vernadakis,et al.  Comparing hybrid learning with traditional approaches on learning the Microsoft Office Power Point 2003 program in tertiary education , 2011, Comput. Educ..

[84]  D. Altman,et al.  Measuring inconsistency in meta-analyses , 2003, BMJ : British Medical Journal.

[85]  Daniel Gutierrez,et al.  Comparing Student Performance, Attitudes And Preferences In An Introduction To Business Course: Online, Hybrid And Traditional Delivery Methods Who Makes The A Grade? , 2011 .

[86]  Nigel Stallard,et al.  Improving the Efficiency of Advanced Life Support Training , 2012, Annals of Internal Medicine.

[87]  John E. Merrill,et al.  Do Hybrid Lecture Formats Influence Laboratory Performance in Large, Pre-Professional Biology Courses? , 2005 .

[88]  Karen Swan,et al.  Examining the extent and nature of online learning in American K-12 Education: The research initiatives of the Alfred P. Sloan Foundation , 2012, Internet High. Educ..

[89]  Zeynep Koçoğlu,et al.  Blended learning: Investigating its potential in an English language teacher training program , 2011 .

[90]  Philip C. Abrami,et al.  What Forty Years of Research Says About the Impact of Technology on Learning , 2011 .

[91]  Samuel Riffell,et al.  Using web-based instruction to improve large undergraduate biology courses: An evaluation of a hybrid course format , 2005, Comput. Educ..

[92]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[93]  Philip C. Abrami,et al.  Research on Distance Education: In defense of field experiments , 2006 .

[94]  B L Hopkins,et al.  A comparison of students studying-behavior produced by daily, weekly, and three-week testing schedules. , 1971, Journal of applied behavior analysis.

[95]  Jon Lim,et al.  An Empirical Investigation of Student Achievement and Satisfaction in Different Learning Environments. , 2008 .

[96]  Richard F. Schmid,et al.  A meta-analysis of blended learning and technology use in higher education: from the general to the applied , 2014, Journal of Computing in Higher Education.