Effects of hypermedia on students' achievement: a meta-analysis

A meta-analysis was performed to synthesize existing research comparing the effects of hypermedia verse nonhypermedia instruction (e.g., CAI, text, traditional, videotape instruction) on students' achievement. Forty-six studies were located from three sources, and their quantitative data were transformed into Effect Size (ES). The overall grand mean of the study-weighted ES for all 46 studies was 0.41. The results suggest that hypermedia instruction is more effective when there is no instruction for the comparison group or when the comparison group used videotape instruction. However, CAI and text instructions are slightly more effective than hypermedia instruction. As a whole, the results of this analysis suggest that the effects of hypermedia instruction on students' achievement are mixed, depends on what type of instruction it compares to. In addition, four of the seventeen variables selected for this study (i.e., instrumentation, type of research design, type of delivery system, and comparison group) had a statistically significant impact on the mean ES. The results from this study suggest that the effects of using hypermedia in instruction are positive over non-hypermedia instruction as a whole. The results of this study also provide to classroom teachers an accumulated research-based evidence for using technology in instruction. Media comparison studies were the primary focus of most research on media in education from 1920s through the 1960s. Yet, during this period many researchers found problems in the nature of media comparison studies. Problems included faulty theoretical assumptions, deficient experimental designs, and lack of consistently significant findings (for details see Thompson, Simonson, & Hargrave, 1992). In 1983, Richard Clark evoked considerable controversy in the field of educational technology with the publication of his article, "Reconsidering Research on Learning From Media," in the Review of Educational Research. (Ross, 1994). After reviewing the results of reviews and meta-analyses of research comparing the learning advantage of various media, Clark (1983) claimed that there are no learning benefits to be gained from employing any specific medium to deliver instruction . According to Clark, the results of those studies that appear to favor one medium over another are not due to medium but due to the method or content that is introduced along with the medium. Clark (1983) concludes that "...media do not influence learning under any conditions" (p.445). Kozma (1994) challenged Clark's claims by refraining the question from "Do media influence learning?" to "Will media influence learning?" Komza analyzed the results of two significant and effective instructional environments (i.e., ThinkerTools, and The Jasper Woodbury Series) to identify causal mechanisms by which media may have influenced learning. He argued that "...Clark's separation of media from method creates an unnecessary and undesirable schism between the two. Medium and method should have a more integral relationship. Both are part of the instructional design" (p.16). Clark and Kozma may be both right, based on their own definitions of "media" and "method." However, from an

[1]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[2]  G. Andrews,et al.  Meta-analysis of the effects of stuttering treatment. , 1980, The Journal of speech and hearing disorders.

[3]  G. Glass,et al.  Meta-analysis in social research , 1981 .

[4]  Gregg B. Jackson,et al.  Meta-Analysis: Cumulating Research Findings Across Studies , 1982 .

[5]  R. Clark Reconsidering Research on Learning from Media , 1983 .

[6]  H. Waxman,et al.  Adaptive Education and Student Outcomes: A Quantitative Synthesis. 1985/11. , 1985 .

[7]  Stanley R. Trollip,et al.  Computer-Based Instruction: Methods and Development , 1985 .

[8]  Chen-Lin C. Kulik,et al.  Effectiveness of Computer-Based Education in Secondary Schools. , 1985 .

[9]  Loretta L. Jones,et al.  Production and evaluation of interactive videodisc lessons in laboratory instruction , 1986 .

[10]  S. Barker Comparison of effectiveness of interactive videodisc versus lecture-demonstration instruction. , 1988, Physical therapy.

[11]  Effect of a CVIS instructional program regarding therapeutic communication on student learning and anxiety. , 1988, The Journal of nursing education.

[12]  C. E. Branch,et al.  The validation of an interactive videodisc as an alternative to traditional teaching techniques: auscultation of the heart , 1989 .

[13]  P. Lachenbruch Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[14]  Andrew Trotter Schools Gear Up for "Hypermedia"--A Quantum Leap in Electronic Learning. , 1989 .

[15]  Randall B. Boone,et al.  Hypertext Computer Study Guides and the Social Studies Achievement of Students with Learning Disabilities, Remedial Students, and Regular Education Students , 1990, Journal of learning disabilities.

[16]  Sandra Regina Levin The Effects of Interactive Video Enhanced Earthquake Lessons on Achievement of Seventh Grade Earth Science Students. , 1991 .

[17]  George W. Bright,et al.  Effects of Computer Programming on Cognitive Outcomes: A Meta-Analysis , 1991 .

[18]  Michael F. Young,et al.  Multimedia Football Viewing: Embedded Rules, Practice, and Video Context in IVD Procedural Learning. , 1991 .

[19]  Anthony S. Pyzdrowski,et al.  The Effects of Teaching a Hypothetical Computer Architecture with Computer Simulators. , 1992 .

[20]  W. H. Leonard A Comparison of Student Performance Following Instruction by Interactive Videodisc Versus Conventional Laboratory. , 1992 .

[21]  Dorothy G. Standish The Use of CD-ROM Based Books To Improve Reading Comprehension in Second Grade Students. , 1992 .

[22]  Alan Bain,et al.  An Evaluation of the Application of Interactive Video for Teaching Social Problem-Solving to Early Adolescents , 1992 .

[23]  Carol Ann Goodson Intelligent music listening: an interactive hypermedia program for basic music listening skills , 1992 .

[24]  Kyle Higgins,et al.  Hypermedia Basal Readers: Three Years of School-Based Research , 1993 .

[25]  Comparison of a Videodisc System with a Conventional Film File for Medical Student Teaching , 1993, Investigative radiology.

[26]  Mable B. Kinzie,et al.  The effects of an interactive dissection simulation on the performance and achievement of high school biology students , 1993 .

[27]  A. Chen The use of interactive multimedia systems to improve the learning of classroom practices , 1993 .

[28]  Alison Hartman,et al.  The Impact of an Interactive Multimedia System on the Quality of Learning in Educational Psychology , 1993 .

[29]  Diane M. Gayeski Multimedia for learning : development, application, evaluation , 1993 .

[30]  Min Liu,et al.  The Effect of Hypermedia Assisted Instruction on Second Language Learning , 1993 .

[31]  Ann M. Quade An Assessment of the Effectiveness of a Hypertext Instructional Delivery System when Compared to a Traditional CAI Tutorial. , 1993 .

[32]  Richard A. Schwier,et al.  Interactive Multimedia Instruction , 1993 .

[33]  M P D'Alessandro,et al.  The Instructional Effectiveness of a Radiology Multimedia Textbook (HyperLung) versus a Standard Lecture , 1993, Investigative radiology.

[34]  Kuo-Hua Wang Middle School Students' Decision-Making on Solid Waste Management in Taiwan. , 1994 .

[35]  G. Hess Strategies for Integrating Computer-Based Training in College Music Theory Courses. , 1994 .

[36]  David M. Moore,et al.  The parable of the expensive ballpoint pen (revisited): implications for hypermedia , 1994 .

[37]  R. Kozma Will media influence learning? Reframing the debate , 1994 .

[38]  William G. W. Barnes Constructing Knowledge from an Ill-Structured Domain: Testing a Multimedia Hamlet. , 1994 .

[39]  John A. Gretes,et al.  The effect of interactive CD-ROM/digitized audio courseware on reading among low-literate adults , 1994 .

[40]  Steven M. Ross,et al.  Delivery trucks or groceries? More food for thought on whether media (will, may, can't) influence learning , 1994 .

[41]  Jay W. Rojewski,et al.  Effects of a Hypertext Computer Program on Academic Performance in a Special Education Course for Nonmajors , 1994 .

[42]  Leah P. McCoy Decisions in Inferential Statistics with HyperCard , 1994 .

[43]  Richard C. Overbaugh The efficacy of interactive video for teaching basic classroom management skills to pre-service teachers , 1995 .

[44]  J. Burton,et al.  Hypermedia concepts and research: an overview , 1995 .

[45]  Maria Alexandra Toro,et al.  The effects of HyperCard authoring on computer-related attitudes and Spanish language acquisition , 1995 .

[46]  Margaret A. Moore-Hart The effects of multicultural links on reading and writing performance and cultural awareness of fourth and fifth graders , 1995 .

[47]  Cynthia Mayfield-Stewart Evaluation of Multimedia Instruction on Learning and Transfer , 1995 .

[48]  Connie Hargrave,et al.  Educational technology: A review of the research , 1996 .

[49]  Kyle Higgins,et al.  Hypermedia pre-reading lessons: learner-centered software for kindergarten , 1996 .

[50]  David J. Ayersman,et al.  Reviewing the Research on Hypermedia-Based Learning , 1996 .

[51]  Kathryn I. Matthew The impact of CD-ROM storybooks on children's reading comprehension and reading attitude , 1996 .

[52]  Sheila W. Chauvin,et al.  Comparing Student Learning Outcomes in Hypermedia and Analog Assisted Lectures (HAL & AAL). , 1998 .