The failure of e-learning research to inform educational practice, and what we can do about it

When a new technology is introduced, earlier studies focus on demonstrations of efficacy, followed by studies comparing the new technology against the old. However, such studies do little to advance the new technology. Using an analogy with the automobile the author argues that e-learning is neither inherently superior nor inferior to traditional instruction; rather they are different and complementary. Each can effectively serve different purposes and functions suited to its strengths. A recent meta-analysis of internet-based instruction concluded that existing research provides reassurance that e-learning is better than nothing and similar (on average) to traditional instruction, but yields little guidance on how to effectively use e-learning. e-Learning research to-date has done little to inform educational practice, and further no-intervention-controlled studies or comparisons with traditional instructional methods are not needed. Instead, we need to clarify how and when to use e-learning through ‘basic science’ research and ‘field tests’ comparing one e-learning intervention to another.

[1]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[2]  R. Clark Reconsidering Research on Learning from Media , 1983 .

[3]  Stephen M. Alessi,et al.  Fidelity in the design of instructional simulations , 1988 .

[4]  C P Friedman,et al.  The research we should be doing , 1994, Academic medicine : journal of the Association of American Medical Colleges.

[5]  M. Albanese,et al.  Evaluation of Internet-based oncologic teaching for medical students. , 1998, Journal of cancer education : the official journal of the American Association for Cancer Education.

[6]  J. Kaczorowski,et al.  Problem-based small-group learning via the Internet among community family physicians: a randomized controlled trial. , 1999, M.D. computing : computers in medical practice.

[7]  G R Norman,et al.  The adult learner: a mythical species. , 1999, Academic medicine : journal of the Association of American Medical Colleges.

[8]  John M. Keller,et al.  Effectiveness of motivationally adaptive computer-assisted instruction on the dynamic aspects of motivation , 2001 .

[9]  Robert Patterson,et al.  Research Paper: Educational Instruction on a Hospital Information System for Medical Students During Their Surgical Rotations , 2001, J. Am. Medical Informatics Assoc..

[10]  Donald Clark Psychological myths in e-learning , 2002, Medical teacher.

[11]  G. Norman RCT = results confounded and trivial: the perils of grand educational experiments , 2003, Medical education.

[12]  Karen H Frith,et al.  The effect of communication on nursing student outcomes in a Web-based course. , 2003, The Journal of nursing education.

[13]  Carol Jollie,et al.  Web based learning , 2003, BMJ : British Medical Journal.

[14]  Slava Kalyuga The Cambridge Handbook of Multimedia Learning: Prior Knowledge Principle in Multimedia Learning , 2005 .

[15]  Richard E. Mayer,et al.  The Cambridge Handbook of Multimedia Learning: Cognitive Theory of Multimedia Learning , 2005 .

[16]  D. Cook The Research We Still Are Not Doing: An Agenda for the Study of Computer-Based Learning , 2005, Academic medicine : journal of the Association of American Medical Colleges.

[17]  J. Sweller Implications of Cognitive Load Theory for Multimedia Learning , 2005, The Cambridge Handbook of Multimedia Learning.

[18]  O Findl,et al.  Advantage of three dimensional animated teaching over traditional surgical videos for teaching ophthalmic surgery: a randomised study , 2005, British Journal of Ophthalmology.

[19]  Richard Mayer,et al.  Multimedia Learning , 2001, Visible Learning Guide to Student Achievement.

[20]  D. Cook Learning and Cognitive Styles in Web-Based Learning: Theory, Evidence, and Application , 2005, Academic medicine : journal of the Association of American Medical Colleges.

[21]  Sylvia Stracke,et al.  Comparative evaluation of multimedia driven, interactive, and case-based teaching in heart surgery. , 2006, The Annals of thoracic surgery.

[22]  S Barry Issenberg,et al.  The scope of simulation-based healthcare education. , 2006, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[23]  David A Cook,et al.  Impact of Self-Assessment Questions and Learning Styles in Web-Based Learning: A Randomized, Controlled, Crossover Trial , 2006, Academic medicine : journal of the Association of American Medical Colleges.

[24]  David Richard Moore,et al.  E-Learning and the Science of Instruction: Proven Guidelines for Consumers and Designers of Multimedia Learning , 2006 .

[25]  David A Cook,et al.  Association between funding and quality of published medical education research. , 2007, JAMA.

[26]  D. Cook,et al.  Instructional methods and cognitive and learning styles in web‐based learning: report of two randomised trials , 2007, Medical education.

[27]  V. Shute,et al.  Adaptive Technologies , 2007 .

[28]  Catriona M. Morrison,et al.  What is the Net Generation? The challenge for future medical education , 2007, Medical teacher.

[29]  Kelly Dore,et al.  The Power of the Plural: Effect of Conceptual Analogies on Successful Transfer , 2007, Academic medicine : journal of the Association of American Medical Colleges.

[30]  David A Cook,et al.  Quality of reporting of experimental studies in medical education: a systematic review , 2007, Medical education.

[31]  David A Cook,et al.  Web-based learning: pros, cons and controversies. , 2007, Clinical medicine.

[32]  L. Lingard Qualitative Research in the RIME Community: Critical Reflections and Future Directions* , 2007, Academic medicine : journal of the Association of American Medical Colleges.

[33]  Vicki R Leblanc,et al.  Teaching from the clinical reasoning literature: combined reasoning strategies help novice diagnosticians overcome misleading information , 2007, Medical education.

[34]  B Price Kerfoot,et al.  Randomized, controlled trial of spaced education to urology residents in the United States and Canada. , 2007, The Journal of urology.

[35]  Ronald M Harden,et al.  E-learning–caged bird or soaring eagle? , 2008, Medical teacher.

[36]  H. Schmidt,et al.  Description, justification and clarification: a framework for classifying the purposes of research in medical education , 2008, Medical education.

[37]  D. Cook,et al.  Internet-based learning in the health professions: a meta-analysis. , 2008, JAMA.

[38]  D. Cook,et al.  Adapting Web-based Instruction to Residents’ Knowledge Improves Learning Efficiency , 2008, Journal of General Internal Medicine.

[39]  David A Cook,et al.  Lack of interaction between sensing–intuitive learning styles and problem-first versus information-first instruction: a randomized crossover trial , 2009, Advances in health sciences education : theory and practice.

[40]  Philipp Dahm,et al.  Evidence‐based urology in practice: when to believe a subgroup analysis? , 2010, BJU international.

[41]  J. Michael Spector,et al.  Handbook of Research on Educational Communications and Technology, 3rd Edition , 2012 .

[42]  Victor M. Montori,et al.  Internet-Based Learning in the Health Professions , 2011 .