The Efficacy of Computer Assisted Instruction (CAI): A Meta-Analysis

There has been a long-standing dispute about the efficacy of computer assisted instruction (CAI) with regard to the interpretation of effect size estimates in reviews using techniques of meta-analysis. It has been claimed that the data used to calculate these estimates come from studies which are methodologically flawed. The aim of this study was to provide an updated meta-analysis on the learning effect of (CAI) over a broad range of study features with particular attention focused on the effectiveness debate. Using standard procedures, the results and estimates were similar to previous reviews and showed a learning benefit for CAI. The mean effect size for CAI was (.24) for the years 1987–1992, with more recent studies showing an average of (.33). Although moderate, these estimates tended to raise the average student from at least the 50th and 60th percentile. However, studies which controlled for teacher and materials, and were of longer duration, and studies using pencil and paper equivalents of CAI showed no learning advantage over traditional forms of instruction. It is suggested that what accounts for the typical learning advantage of CAI in this meta-analysis and others is the better quality instruction provided by CAI materials. These materials seem versatile enough to be used effectively over a broad range of subjects and educational settings. While the materials did not seem to improve substantially over the past two decades as reflected by effect sizes, these estimates did not include the newer multimedia technology. It is concluded that educational approaches should be judged by a number of criteria including achievement gains and when this is done CAI may far surpass other forms of instruction.

[1]  Rosemary Lore,et al.  Language Development Component, Secondary Reading Program 1988-89. Final Evaluation Report. , 1989 .

[2]  Gail E. Hawisher The Effects of Word Processing on the Revision Strategies of College Freshmen , 1987 .

[3]  Mary L. DeRemer The computer gender gap in elementary school , 1990 .

[4]  L. Fuchs,et al.  A Conservative Approach to Special Education Reform: Mainstreaming Through Transenvironmental Programming and Curriculum-Based Measurement , 1993 .

[5]  Keith E. Stanovich,et al.  Early Spelling Acquisition: Writing Beats the Computer , 1990 .

[6]  Herbert J. Walberg,et al.  Comparative Effects of Computer-Assisted Instruction: A Synthesis of Reviews , 1987 .

[7]  D. Savage,et al.  A comparison of computer-assisted instruction and tutorials in hematology and oncology. , 1987, Journal of medical education.

[8]  Bruce Dalby,et al.  A Computer-Based Training Program for Developing Harmonic Intonation Discrimination Skill , 1992 .

[9]  Sandra Regina Levin The Effects of Interactive Video Enhanced Earthquake Lessons on Achievement of Seventh Grade Earth Science Students. , 1991 .

[10]  Heidi M. Anderson-Harper Developing, Implementing and Evaluating Microcomputer Instruction in a Nonprescription Drug Course. , 1988 .

[11]  David Alan Gilman A Comparison of Achievement in Writing To Read and Traditional Instruction at the East Gibson School Corporation. , 1988 .

[12]  Frances Jane Spivey Computer Assisted Instruction vs. Direct Teaching Model of Teaching Reading to Incarcerated Adults. , 1992 .

[13]  Margaret Miller,et al.  The Effects of Writing on Reading Abilities: A Comparison of First Grade Writing Programs with and without Computer Technology. , 1987 .

[14]  Jeffrey Gorrell,et al.  Effects of Computer-Simulated Behavior Analysis on Pre-Service Teachers' Problem Solving , 1989 .

[15]  Elaine M. McLaughlin,et al.  Young children's comprehension and recall of computer screen displayed text , 1987 .

[16]  Kathleen M. Hannafin,et al.  The Effect of Computerized Tests on the Performance and Attitudes of College Students , 1989 .

[17]  Oscar Retterer World Conference on Educational Multimedia and Hypermedia , 1995, LINK.

[18]  Robert N. Ronau,et al.  Microcomputer versus Paper-and-Pencil Testing of Student Errors in Ratio and Proportion , 1988 .

[19]  J. Kulik,et al.  Effects of Computer-Based Teaching on Secondary School Students. , 1983 .

[20]  David M. Podell,et al.  The Effects of CAI on Word Recognition in Mildly Mentally Handicapped and Nonhandicapped Learners , 1991 .

[21]  Henry J. Becker Effects of Computer Use on Mathematics Achievement. Findings from a Nationwide Field Experiment in Grades Five to Eight. Classes: Rationale, Study Design, and Aggregate Effect Sizes. Report No. 51. , 1990 .

[22]  Bhushan Kapoor,et al.  Role of the Individual in the Effectiveness of CAI , 1990 .

[23]  Richard E. Clark,et al.  Confounding in Educational Computing Research , 1985 .

[24]  K. Lawson,et al.  Using a Computer-Simulation Program and a Traditional Approach to Teach Pharmacy Financial Management. , 1991 .

[25]  Betty Collis,et al.  Writing to Read: An Evaluation of a Canadian Installation of a Computer-Supported Initial Language Environment , 1990 .

[26]  George Brant,et al.  Which Comes First the Simulation or the Lecture? , 1991 .

[27]  R. Clark,et al.  Dangers in the evaluation of instructional media , 1992, Academic medicine : journal of the Association of American Medical Colleges.

[28]  Steven V. Horton,et al.  Teaching Geography to High School Students with Academic Deficits: Effects of a Computerized Map Tutorial , 1988 .

[29]  James Daniel Lehman,et al.  Comparison of Performance and Attitude in Traditional and Computer Conferencing Classes. , 1991 .

[30]  Patricia D. Morrell,et al.  The Effects of Computer Assisted Instruction on Student Achievement in High School Biology , 1992 .

[31]  Richard E. Clark,et al.  When researchers swim upstream: reflections on an unpopular argument about learning from media , 1991 .

[32]  M. Cowles,et al.  Automated Psychological Testing: Method of Administration, Need for Approval, and Measures of Anxiety , 1989 .

[33]  Mark E. Ware,et al.  Computer-Assisted Statistical Analysis: A Teaching Innovation? , 1989 .

[34]  G. Phillip Cartwright,et al.  Effectiveness of Computer-Assisted Special Education Administration Simulations , 1986 .

[35]  H Niemann,et al.  Computer-assisted attention retraining in head-injured individuals: a controlled efficacy study of an outpatient program. , 1990, Journal of consulting and clinical psychology.

[36]  P Fletcher,et al.  Computer-Administered Versus Written Tests--Advantages and Disadvantages , 1987 .

[37]  Mark Grabe An Evaluation of Computer Assisted Study in Controlled and Free Access Settings. , 1989 .

[38]  E K Shultz,et al.  PlanAlyzer, an interactive computer‐assisted program to teach clinical problem solving in diagnosing anemia and coronary artery disease , 1992, Academic medicine : journal of the Association of American Medical Colleges.

[39]  Robert D. Childers Implementation of the Writing To Read Instructional System in 13 Rural Elementary Schools in Southern West Virginia. 1988-89 Annual Report. , 1989 .

[40]  Patricia E. Simmons,et al.  The Effects of CAI and Hands-On Activities on Elementary Students' Attitudes and Weather Knowledge , 1992 .

[41]  T. Lovitt,et al.  Teaching Social Studies to High School Students with Academic Handicaps in a Mainstreamed Setting , 1989, Journal of learning disabilities.

[42]  James B. Olsen,et al.  Comparisons of Paper-Administered, Computer-Administered and Computerized Adaptive Achievement Tests , 1989 .

[43]  Tjeerd Plomp,et al.  The effectiveness of remedial computer use of mathematics in a University setting (Botswana) , 1991 .

[44]  Lee Kiser Interaction of spatial visualization with computer-enhanced and traditional presentations of linear absolute-value inequalities , 1990 .

[45]  David W. McMullen,et al.  Drills vs. Games--Any Differences? A Pilot Study. , 1987 .

[46]  Chen-Lin C. Kulik,et al.  The concept of meta-analysis , 1989 .

[47]  Thomas H. Rowley,et al.  Evaluation of CBI in Accounting Education. , 1990 .

[48]  Richard N. Claus Laser Learning Project (LLP): 1989-90. , 1990 .

[49]  Joanne R. Nurss,et al.  PALS Evaluation Project. , 1989 .

[50]  Ronald D. Owston Effects of Word Processing on Student Writing in a High Computer Access Environment. Technical Report 91-3. , 1991 .

[51]  K. Richard Knoll Delivering Continuing Education to the Pharmacist: Correspondence Course versus Computer-Assisted Instruction. , 1988 .

[52]  Byung-Soon Choi,et al.  The Effectiveness of Using Computer Simulated Experiments on Junior High Students' Understanding of the Volume Displacement Concept , 1987 .

[53]  R. Stephenson A and V , 1962, The British journal of ophthalmology.

[54]  Robert L. Mayes,et al.  The Effects of Using Software Tools on Mathematical Problem Solving in Secondary Schools. School Science and Mathematics. , 1992 .

[55]  Ernest Balajthy,et al.  An investigation of learner‐control variables in vocabulary learning using traditional instruction and two forms of computer‐based instruction , 1988 .

[56]  P. Been,et al.  Computer-based learning for on-line data base search , 1989 .

[57]  Robert C. Reardon,et al.  A Comparison of Paper‐and‐Pencil and Computer Versions of the Self‐Directed Search , 1988 .

[58]  William C. Juchau Assessment and Development of Student Problem-Solving Skills Using Computer-Managed and Computer-Assisted Instruction. , 1988 .

[59]  Mary-Margaret Kerns,et al.  The effectiveness of computer-assisted instruction in teaching tennis rules and strategies , 1989 .

[60]  Robert K. Leigh,et al.  Comparison of computer-assisted instruction and print drill performance: A research note , 1987 .

[61]  Hugh L. Tammi A. Judith F. Beykirch,et al.  Iconicity and Sign Vocabulary Acquisition , 1990, American annals of the deaf.

[62]  Ed Chamberlain,et al.  Language Development Component, Secondary Developmental Reading Program 1987-88. Final Evaluation Report. , 1983 .

[63]  James D. Klein,et al.  A comparison of a microcomputer progressive state drill and flashcards for learning paired associates , 1988 .

[64]  David Messer,et al.  Factors affecting microcomputer use and programming ability of secondary school children , 1987 .

[65]  Ely Kozminsky,et al.  The effect of computer games practice on the development of visual perception skills in kindergarten children , 1990 .

[66]  Shelley B. Wepner,et al.  College Students' Reading Efficiency with Computer-Presented Text. , 1987 .

[67]  John E. Sasser The effect of using computer tutorials as homework assignments on the mathematics achievements of elementary education majors , 1991 .

[68]  Larry E. Boh,et al.  Evaluation of an Integrated Audio Cassette and Computer Based Patient Simulation Learning Program. , 1990 .

[69]  R. Clark Evidence for confounding in computer-based instruction studies: Analyzing the meta-analyses , 1985 .

[70]  Scott D. Johnson Application of Cognitive Theory to the Design, Development, and Implementation of a Computer-Based Troubleshooting Tutor. , 1992 .

[71]  George W. Bright Time-on-Task in Computer and Non-Computer Estimation Games. , 1988 .

[72]  Jeanette R. Palmiter,et al.  Effects of Computer Algebra Systems on Concept and Skill Acquisition in Calculus. , 1991 .

[73]  Milton Teichman,et al.  Initial effects of word processing on writing quality and writing anxiety of freshman writers , 1989, Comput. Humanit..

[74]  Christine Arroyo What Is the Effect of Extensive Use of Computers on the Reading Achievement Scores of Seventh Grade Students , 1992 .

[75]  James Daniel Lehman Integrating Computers in the Biology Education of Elementary Teaching Majors. , 1988 .

[76]  V. Lonnie Lawson Using a Computer-Assisted Instruction Program to Replace the Traditional Library Tour: An Experimental Study. , 1989 .

[77]  Nurit Zehavi,et al.  Evaluation of the Effectiveness of Mathematics Software in Shaping Students' Intuitions , 1988 .

[78]  J. Neapolitan A Test of Simple Computer-Assisted Instructional Software. , 1989 .

[79]  James Daniel Lehman,et al.  Computer Assisted Instruction for Problem Solving by Dimensional Analysis , 1988 .

[80]  Carol L. Stuessy,et al.  Advantages of Micro-Based Labs: Electronic Data Acquisition, Computerized Graphing, or Both?. , 1989 .

[81]  Gary L. Reglin Effects of a Computer Assisted Remediation Program on Basic Skills Mathematics Achievement, Academic Self-Concept, and Locus of Control of Students in a Selected Dropout Retrieval Program in an Urban Setting. , 1988 .

[82]  Jane D. Steelman,et al.  Writing Achievement of Middle Level Students Using Computers To Write a Newspaper. , 1991 .

[83]  David B. Malouf Evaluation of Instructional Model Applied to Functional Math. Project on Effective Computer Instruction for Effective Special Education, Prince George's County Public Schools. , 1990 .

[84]  Phillip J. Heeler,et al.  A Study of the Use of Interactive Videodisc Technology To Present Aural Tests to College Music Appreciation Students. , 1990 .

[85]  A. Mancey A CAL experiment in a developing country , 1989 .

[86]  Douglas Carnine,et al.  Improving CAI Effectiveness with Attention to Instructional Design in Teaching Story Problems to Mildly Handicapped Students , 1990 .

[87]  Robert D. Childers Implementation of the Writing To Read Program in 13 Rural Elementary Schools in Southern West Virginia: A Two-Year Evaluation. Final Report. , 1990 .

[88]  Steven V. Horton,et al.  A computer-based vocabulary program for three categories of student , 1988 .

[89]  R. Clark Reconsidering Research on Learning from Media , 1983 .

[90]  Ambrose A. Clegg Using Microcomputers in Teaching Economics in the Community College. , 1988 .

[91]  David E. Hawley,et al.  Costs, Effects, and Utility of Microcomputer Assisted Instruction in the Classroom , 1990 .

[92]  Robert L. Bangert-Drowns,et al.  The Word Processor as an Instructional Tool: A Meta-Analysis of Word Processing in Writing Instruction , 1993 .

[93]  Chen-Lin C. Kulik,et al.  Effectiveness of computer-based instruction: An updated analysis. , 1991 .

[94]  Charles S. White Developing Information-Processing Skills through Structured Activities with a Computerized File-Management Program , 1987 .

[95]  R H Stevens,et al.  Evaluating preclinical medical students by using computer‐based problem‐solving examinations , 1989, Academic medicine : journal of the Association of American Medical Colleges.

[96]  Chen-Lin C. Kulik,et al.  Meta-Analysis in Education. , 1989 .

[97]  Rosemary Lore,et al.  Language Development Component, Compensatory Language Experiences and Reading Program. Final Evaluation Report. , 1983 .

[98]  Robert V. Price,et al.  A Project To Measure the Treatment Effects of the Use of Interactive Video on the Teaching of the Language Experience Approach to Reading Instruction. Research Report. , 1987 .

[99]  Michael F. Young,et al.  Multimedia Football Viewing: Embedded Rules, Practice, and Video Context in IVD Procedural Learning. , 1991 .

[100]  G. Glass Primary, Secondary, and Meta-Analysis of Research1 , 1976 .

[101]  Hugh L. Tammi A. Judith F. Beykirch,et al.  Isolated Sign Vocabulary Acquisition By Hearing Adults: CAI vs. Videotaped Presentation , 1989, American annals of the deaf.

[102]  C. Taylor,et al.  Computer-Assisted Behavioral Health Counseling for High School Students , 1989 .

[103]  Marley W. Watkins,et al.  Computerized Drill-and-Practice and Academic Attitudes of Learning Disabled Students , 1989 .

[104]  William Robert Weber,et al.  A computer-based program of word study: effects on reading and spelling , 1988 .

[105]  Ann Hill Duin,et al.  Computer-assisted instructional displays: effect on students' computing behaviors, prewriting, and attitudes , 1988 .

[106]  Chen-Lin C. Kulik,et al.  Review of recent research literature on computer-based instruction , 1987 .

[107]  Richard Lehrer,et al.  Problem Solving, Metacognition and Composition: The Effects of Interactive Software for First-Grade Children , 1987 .

[108]  Barbara S. Chaparro,et al.  STAR: A Computerized Tutorial in General Psychology. , 1989 .

[109]  Richard J. Riding,et al.  The Effect on Reasoning, Reading and Number Performance of Computer-Presented Critical Thinking Activities in Five-Year-Old Children. , 1987 .

[110]  Russell T. Osguthorpe,et al.  The Effects of Computerized Picture-Word Processing on Kindergartners' Language Development , 1990 .

[111]  Gavriel Salomon,et al.  Enhancing Writing-Related Metacognitions Through a Computerized Writing Partner , 1991 .

[112]  C P Friedman,et al.  Influence of a computer database and problem exercises on students' knowledge of bacteriology , 1992, Academic medicine : journal of the Association of American Medical Colleges.

[113]  C. Thomas Holmes,et al.  The cost-effective of an interactive video system for science instruction , 1989 .

[114]  T J. Garrett Computer-Assisted Instruction in Aids Infection Control for Physicians , 1990 .