A meta-analysis of the impact of technology on learning effectiveness of elementary students

Abstract The existing studies suggest that if technology is interwoven comprehensively into pedagogy, it can act as a powerful tool for effective learning of the elementary students. This study conducted the meta-analysis by integrating the quantitative findings of 122 peer-reviewed academic papers that measured the impact of technology on learning effectiveness of elementary students. The results confirmed that the technology has a medium effect on learning effectiveness of elementary students. Further, this study analysed the effect sizes of moderating variables such as domain subject, application type, intervention duration, and learning environment. Finally, the impact of technology at different levels of moderating variables has been discussed and the implications for theory and practice are provided.

[1]  Henderien Steenbeek,et al.  Learning through movement: A comparison of learning fraction skills on a digital playful learning environment with a sedentary computer-task , 2014 .

[2]  Mario J. López,et al.  Instructional effectiveness of a computer-supported program for teaching reading comprehension strategies , 2012, Comput. Educ..

[3]  Kai-Hsiang Yang,et al.  The WebQuest model effects on mathematics curriculum learning in elementary school students , 2014, Comput. Educ..

[4]  R. Leonhart,et al.  [Estimating effect sizes in clinical trials]. , 2004, Die Rehabilitation.

[5]  Cem Oktay Güzeller,et al.  The Effect of Computer Use in Science and Technology Lesson on Success and Attitude Towards , 2011 .

[6]  Chien-Min Chen,et al.  Developing spatial visualization and mental rotation with a digital puzzle game at primary school level , 2016, Comput. Hum. Behav..

[7]  Ina Blau,et al.  Scaffolding game-based learning: Impact on learning achievements, perceived learning, and game experiences , 2014, Comput. Educ..

[8]  Hasan Bakirci,et al.  The effects of simulation technique and worksheets on formal operational stage in science and technology lessons , 2011 .

[9]  Gwo-Jen Hwang,et al.  A knowledge engineering approach to developing mindtools for context-aware ubiquitous learning , 2010, Comput. Educ..

[10]  Elliot Soloway,et al.  1: 1 Mobile Inquiry Learning Experience for Primary Science Students: a Study of Learning Effectiveness , 2011, J. Comput. Assist. Learn..

[11]  Yu-Shan Chang,et al.  Student technological creativity using online problem-solving activities , 2013 .

[12]  Mark Warschauer,et al.  Laptops and Fourth-Grade Literacy: Assisting the Jump over the Fourth-Grade Slump. , 2010 .

[13]  Yong Gao,et al.  Impact of an active educational video game on children's motivation, science knowledge, and physical activity , 2015, Journal of sport and health science.

[14]  Edwin P. Christmann,et al.  A Meta-Analytic Comparison of the Effects of Computer-Assisted Instruction on Elementary Students' , 2003 .

[15]  Gwo-Jen Hwang,et al.  A concept map approach to developing collaborative Mindtools for context-aware ubiquitous learning , 2011, Br. J. Educ. Technol..

[16]  Yong Zhao,et al.  Bridging the Gap: Technology Trends and Use of Technology in Schools , 2013, J. Educ. Technol. Soc..

[17]  Alexander Robitzsch,et al.  Effects of mathematics computer games on special education students' multiplicative reasoning ability , 2016, Br. J. Educ. Technol..

[18]  Bruce J. Avolio,et al.  A meta-analytic review of leadership impact research: Experimental and quasi-experimental studies , 2009 .

[19]  Chiung-Hui Chiu,et al.  Employing a structured interface to advance primary students' communicative competence in a text-based computer mediated environment , 2013, Comput. Educ..

[20]  Habib Gowhary,et al.  The Effect of Rosetta Stone Computer Software on Vocabulary Learning of Iranian Elementary EFL Learners , 2015 .

[21]  Tania B. Huedo-Medina,et al.  Assessing heterogeneity in meta-analysis: Q statistic or I2 index? , 2006, Psychological methods.

[22]  Yasemin Koçak Usluel,et al.  The effect of digital storytelling on visual memory and writing skills , 2016, Comput. Educ..

[23]  T. van Amelsvoort Bridging the Gap , 2014, Tijdschrift voor psychiatrie.

[24]  Yao-Ting Sung,et al.  Improving children's reading comprehension and use of strategies through computer-based strategy training , 2008, Comput. Hum. Behav..

[25]  Robert E. Slavin,et al.  Effective Programs in Elementary Mathematics: A Best-Evidence Synthesis , 2007 .

[26]  Gregory S. Ching Implications of an experimental information technology curriculum for elementary students , 2009, Comput. Educ..

[27]  Wu-Yuin Hwang,et al.  Users’ familiar situational contexts facilitate the practice of EFL in elementary schools with mobile devices , 2013 .

[28]  Adem Karahoca,et al.  Evaluation of web based learning on student achievement in primary school computer courses , 2010 .

[29]  Wu-Yuin Hwang,et al.  Improving English as a foreign language writing in elementary schools using mobile devices in familiar situational contexts , 2014 .

[30]  Alan C. K. Cheung,et al.  The Effectiveness of Educational Technology Applications for Enhancing Mathematics Achievement in K-12 Classrooms: A Meta-Analysis. Best Evidence Encyclopedia (BEE). , 2011 .

[31]  Christi A. Harter,et al.  The effects of spatial contiguity within computer-based instruction of group personalized two-step mathematics word problems , 2008, Comput. Hum. Behav..

[32]  Gwo-Jen Hwang,et al.  A Heuristic Algorithm for planning personalized learning paths for context-aware ubiquitous learning , 2010, Comput. Educ..

[33]  Jale Bintaş,et al.  The effect of computer aided instruction on students’ success in solving LCM and GCF problems , 2009 .

[34]  Jintavee Khlaisang,et al.  Development of a Model of Thai Literature Hypermedia Electronic Books with Social Media Based on the Reader-response Theory to Enhance Reading Comprehension of Elementary School Students☆ , 2015 .

[35]  Chi-Cheng Chang,et al.  Prezi versus PowerPoint: The effects of varied digital presentation tools on students' learning performance , 2015, Comput. Educ..

[36]  William R. King,et al.  A meta-analysis of the technology acceptance model , 2006, Inf. Manag..

[37]  Miguel Nussbaum,et al.  A constructivist mobile learning environment supported by a wireless handheld network , 2004, J. Comput. Assist. Learn..

[38]  Gwo-Jen Hwang,et al.  An Evaluation of the Learning Effectiveness of Concept Map- Based Science Book Reading via Mobile Devices , 2013, J. Educ. Technol. Soc..

[39]  G. Aksoy,et al.  The Effects of Animation Technique on the 7th Grade Science and Technology Course , 2012 .

[40]  L. Hedges,et al.  Introduction to Meta‐Analysis , 2009, International Coaching Psychology Review.

[41]  Yao-Ting Sung,et al.  Learning multiplication through computer-assisted learning activities , 2008, Comput. Hum. Behav..

[42]  Gwo-Jen Hwang,et al.  A knowledge acquisition approach to developing Mindtools for organizing and sharing differentiating knowledge in a ubiquitous learning environment , 2011, Comput. Educ..

[43]  Mark Warschauer,et al.  Participation, interaction, and academic achievement in an online discussion environment , 2015, Comput. Educ..

[44]  M. Rosenberg,et al.  THE FILE‐DRAWER PROBLEM REVISITED: A GENERAL WEIGHTED METHOD FOR CALCULATING FAIL‐SAFE NUMBERS IN META‐ANALYSIS , 2005, Evolution; international journal of organic evolution.

[45]  Kadir Bilen,et al.  The Effect of Web-based Instruction with Educational Animation Content at Sensory Organs Subject on Students’ Academic Achievement and Attitudes , 2014 .

[46]  Chorng-Shiuh Koong,et al.  The applicability of interactive item templates in varied knowledge types , 2011, Comput. Educ..

[47]  Alice W. Ryan Meta-Analysis of Achievement Effects of Microcomputer Applications in Elementary Schools , 1991 .

[48]  Miguel Nussbaum,et al.  Computer supported collaborative learning using wirelessly interconnected handheld computers , 2004, Comput. Educ..

[49]  Ritu Dangwal,et al.  Hole-in-the-Wall learning stations and academic performance among rural children in India , 2014 .

[50]  Olga Pilli,et al.  The effects of computer-assisted instruction on the achievement, attitudes and retention of fourth grade mathematics students in North Cyprus , 2013, Comput. Educ..

[51]  Jie-Chi Yang,et al.  A Desktop Virtual Reality Earth Motion System in Astronomy Education , 2007, J. Educ. Technol. Soc..

[52]  Shian-Shyong Tseng,et al.  A Knowledge-based Approach to Retrieving Teaching Materials for Context-aware Learning , 2009, J. Educ. Technol. Soc..

[53]  Gwo-Jen Hwang,et al.  An interactive peer-assessment criteria development approach to improving students' art design performance using handheld devices , 2015, Comput. Educ..

[54]  Tom Postmes,et al.  Laptop usage affects abstract reasoning of children in the developing world , 2012, Comput. Educ..

[55]  Chin-Chung Tsai,et al.  Development of a personalized educational computer game based on students’ learning styles , 2012, Educational Technology Research and Development.

[56]  Chien-Sing Lee,et al.  Developing a pedagogical-technical framework to improve creative writing , 2012 .

[57]  Gwo-Jen Hwang,et al.  Seamless Connection between Learning and Assessment- Applying Progressive Learning Tasks in Mobile Ecology Inquiry , 2013, J. Educ. Technol. Soc..

[58]  Tan-Hsu Tan,et al.  RFID-based Ubiquitous Learning Environment for Outdoor Learning , 2007, Seventh IEEE International Conference on Advanced Learning Technologies (ICALT 2007).

[59]  Khalili Ahmad,et al.  The Effectiveness of Computer Applications , 1994 .

[60]  Sherry Y. Chen,et al.  The influences of an interactive group-based videogame: Cognitive styles vs. prior ability , 2015, Comput. Educ..

[61]  Yao-Ting Sung,et al.  Computer-assisted learning for mathematical problem solving , 2006, Comput. Educ..

[62]  P. Lachenbruch Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[63]  Siu Cheung Kong,et al.  A cognitive tool for teaching the addition/subtraction of common fractions: a model of affordances , 2005, Comput. Educ..

[64]  S. Thompson,et al.  Quantifying heterogeneity in a meta‐analysis , 2002, Statistics in medicine.

[65]  J. Voogt,et al.  A comparative analysis of international frameworks for 21st century competences: Implications for national curriculum policies , 2012 .

[66]  Mark W. Lipsey,et al.  Practical Meta-Analysis , 2000 .

[67]  Chung-Ho Su,et al.  A Mobile Game-based Insect Learning System for Improving the Learning Achievements , 2013 .

[68]  Cenk Kesan,et al.  The Effect of Learning Geometry Topics of 7th Grade in Primary Education with Dynamic Geometer's Sketchpad Geometry Software to Success and Retention. , 2013 .

[69]  Jacobijn Sandberg,et al.  Mobile English learning: An evidence-based study with fifth graders , 2011, Comput. Educ..

[70]  Jie-Chi Yang,et al.  Affordances of mobile technologies for experiential learning: the interplay of technology and pedagogical practices , 2007, J. Comput. Assist. Learn..

[71]  Mark Warschauer,et al.  Digital Writing and Diversity: The Effects of School Laptop Programs on Literacy Processes and Outcomes , 2013 .

[72]  Yao-Ting Sung,et al.  Mobile-Device-Supported Problem-Based Computational Estimation Instruction for Elementary School Students , 2010, J. Educ. Technol. Soc..

[73]  Richard Niemiec,et al.  The Effects of Computer Based Instruction in Elementary Schools: A Quantitative Synthesis. , 1987 .

[74]  Mariano Alcañiz Raya,et al.  Learning in serious virtual worlds: Evaluation of learning effectiveness and appeal to students in the E-Junior project , 2010, Comput. Educ..

[75]  Claire M. Fletcher-Flinn,et al.  The Efficacy of Computer Assisted Instruction (CAI): A Meta-Analysis , 1995 .

[76]  D. Eden Replication, Meta-Analysis, Scientific Progress, and AMJ's Publication Policy , 2002 .

[77]  Philip C. Abrami,et al.  Improving literacy and metacognition with electronic portfolios: Teaching and learning with ePEARL , 2010, Comput. Educ..

[78]  Fengfeng Ke,et al.  A case study of computer gaming for math: Engaged learning from gameplay? , 2008, Comput. Educ..

[79]  Robert E. Slavin,et al.  Effective Reading Programs for the Elementary Grades: A Best-Evidence Synthesis , 2009 .

[80]  Tracy Kwei-Liang Ho,et al.  A web-based painting tool for enhancing student attitudes toward learning art creation , 2015, Comput. Educ..

[81]  Yuan-Chen Liu,et al.  Construction of an online learning system for decimal numbers through the use of cognitive conflict strategy , 2008, Comput. Educ..

[82]  Gwo-Jen Hwang,et al.  A Project-based Digital Storytelling Approach for Improving Students' Learning Motivation, Problem-Solving Competence and Learning Achievement , 2012, J. Educ. Technol. Soc..

[83]  Der-Ching Yang,et al.  Assessment of Animated Self-Directed Learning Activities Modules for Children's Number Sense Development , 2013, J. Educ. Technol. Soc..

[84]  Necati Taşkm,et al.  The affect of computer supported simulation applications on the academic achievements and attainments of the seventh grade students on teaching of science , 2010 .

[85]  Gwo-Jen Hwang,et al.  A formative assessment-based mobile learning approach to improving the learning attitudes and achievements of students , 2011, Comput. Educ..

[86]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[87]  Maggie B. McGatha,et al.  Methods of Instructional Improvement in Algebra , 2010 .

[88]  Ludo Verhoeven,et al.  Benefits of computer-presented speed training for poor readers , 2005, Annals of dyslexia.

[89]  Yuen-kuang Cliff Liao,et al.  Effects of computer-assisted instruction on students' achievement in Taiwan: A meta-analysis , 2007, Comput. Educ..

[90]  Karin Archer,et al.  Examining the effectiveness of technology use in classrooms: A tertiary meta-analysis , 2014, Comput. Educ..

[91]  Yao-Ting Sung,et al.  Developing geometry thinking through multimedia learning activities , 2007, Comput. Hum. Behav..

[92]  Jacob Cohen,et al.  A power primer. , 1992, Psychological bulletin.

[93]  Bette Chambers,et al.  A case of technology-enhanced formative assessment and achievement in primary grammar: How is quality assurance of formative assessment assured? , 2014 .

[94]  Eric Zhi-Feng Liu,et al.  Game-Based Remedial Instruction in Mastery Learning for Upper-Primary School Students , 2013, J. Educ. Technol. Soc..

[95]  Nian-Shing Chen,et al.  Empowering personalized learning with an interactive e-book learning system for elementary school students , 2012, Educational Technology Research and Development.

[96]  Lydotta M. Taylor,et al.  Learning with versus without technology in elementary and secondary school , 2007, Comput. Hum. Behav..

[97]  Pao-Ta Yu,et al.  Develop and Evaluate the Effects of Multimodal Presentation System on Elementary Student Learning Effectiveness: Within Classroom English Learning Activity , 2015 .

[98]  Koun-Tem Sun,et al.  A study on learning effect among different learning styles in a Web-based lab of science for elementary school students , 2008, Comput. Educ..

[99]  Chen-Lin C. Kulik,et al.  Effectiveness of computer-based instruction: An updated analysis. , 1991 .

[100]  Ozlem Cakir,et al.  A comparative analysis of the effects of computer and paper-based personalization on student achievement , 2010, Comput. Educ..

[101]  Miguel Nussbaum,et al.  Scaffolding group explanation and feedback with handheld technology: impact on students’ mathematics learning , 2010 .

[102]  S. Morris Estimating Effect Sizes From Pretest-Posttest-Control Group Designs , 2008 .

[103]  Worarit Kobsiripat,et al.  Effects of the Media to Promote the Scratch Programming Capabilities Creativity of Elementary School Students , 2015 .

[104]  Yao-Ting Sung,et al.  Let us read together: Development and evaluation of a computer-assisted reciprocal early English reading system , 2009, Comput. Educ..

[105]  Michelle Riconscente,et al.  Results From a Controlled Study of the iPad Fractions Game Motion Math , 2013, Games Cult..

[106]  Filiz Kalelioglu,et al.  A new way of teaching programming skills to K-12 students: Code.org , 2015, Comput. Hum. Behav..

[107]  Y. Liao Effects of hypermedia on students' achievement: a meta-analysis , 1999 .

[108]  B. A. Conway,et al.  The effects of laforin, malin, Stbd1, and Ptg deficiencies on heart glycogen levels in Pompe disease mouse models , 2015 .

[109]  Sămărescu Nicoleta How Can Technology Improve Math Learning Process , 2011 .

[110]  Eliane Segers,et al.  Learning in a sheltered Internet environment: The use of WebQuests , 2009 .

[111]  Maria del Carmen Juan Lizandra,et al.  Mobile learning vs. traditional classroom lessons: a comparative study , 2015, J. Comput. Assist. Learn..

[112]  Alaba Olaoluwakotansibe Agbatogun,et al.  Exploring the Efficacy of Student Response System in a Sub-Saharan African Country: A Sociocultural Perspective , 2012, J. Inf. Technol. Educ. Res..

[113]  Philip C. Abrami,et al.  Promoting reading comprehension with the use of technology , 2014, Comput. Educ..

[114]  Rose Tirotta The Effect of Text Messaging on Formal Writing in English , 2015 .

[115]  Chen-Lin C. Kulik,et al.  Effectiveness of Computer-Based Education in Secondary Schools. , 1985 .

[116]  Ju-Ling Shih,et al.  An investigation-based learning model for using digital libraries to support mobile learning activities , 2011, Electron. Libr..

[117]  Jacobijn Sandberg,et al.  The added value of a gaming context and intelligent adaptation for a mobile learning application for vocabulary learning , 2014, Comput. Educ..

[118]  Iolie Nicolaidou,et al.  E-portfolios supporting primary students' writing performance and peer feedback , 2013, Comput. Educ..

[119]  Henry Jay Becker,et al.  Computer-Based Integrated Learning Systems in the Elementary and Middle Grades: A Critical Review and Synthesis of Evaluation Reports , 1992 .

[120]  Mehmet Bulut,et al.  THE EFFECT OF USING COMPUTER ANIMATIONS AND ACTIVITIES ABOUT TEACHING PATTERNS IN PRIMARY MATHEMATICS , 2011 .

[121]  Christine Fox,et al.  National Educational Technology Trends: 2012. State Leadership Empowers Educators, Transforms Teaching and Learning. , 2012 .

[122]  Gonzalo Ruiz,et al.  Improving attention behaviour in primary and secondary school children with a Computer Assisted Instruction procedure , 2003 .

[123]  Wilma C. M. Resing,et al.  Computerized Dynamic Testing: A Study of the Potential of an Approach Using Sensor Technology , 2011, Journal of Cognitive Education and Psychology.

[124]  Qing Li,et al.  A Meta-analysis of the Effects of Computer Technology on School Students’ Mathematics Learning , 2010 .

[125]  Pieter Reitsma,et al.  What type of computer-assisted exercise supports young less skilled spellers in resolving problems in open and closed syllable words? , 2008, Annals of dyslexia.

[126]  Anna Potocki,et al.  Effects of computer-assisted comprehension training in less skilled comprehenders in second grade: A one-year follow-up study , 2013, Comput. Educ..

[127]  Keith Topping,et al.  International on-line reciprocal peer tutoring to promote modern language development in primary schools , 2009, Comput. Educ..

[128]  Yao-Ting Sung,et al.  The effect of online summary assessment and feedback system on the summary writing on 6th graders: The LSA-based technique , 2016, Comput. Educ..

[129]  Gwo-Jen Hwang,et al.  Effects of the inquiry-based mobile learning model on the cognitive load and learning achievement of students , 2013, Interact. Learn. Environ..

[130]  Paul Kim,et al.  Socioeconomic strata, mobile technology, and education: a comparative analysis , 2011 .

[131]  Irit Bar-Natan,et al.  Writing development of Arab and Jewish students using cooperative learning (CL) and computer-mediated communication (CMC) , 2002, Comput. Educ..

[132]  Hülya Hamurcu,et al.  Effects of computer aided concept cartoons on learning outcomes , 2009 .

[133]  Clare Wood,et al.  The effect of text messaging on 9- and 10-year-old children's reading, spelling and phonological processing skills , 2011, J. Comput. Assist. Learn..

[134]  Gwo-Jen Hwang,et al.  A contextual game-based learning approach to improving students' inquiry-based learning performance in social studies courses , 2015, Comput. Educ..

[135]  Yen-Ting Lin,et al.  Effectiveness of a Mobile Plant Learning System in a science curriculum in Taiwanese elementary education , 2010, Comput. Educ..

[136]  Gwo-Jen Hwang,et al.  A cognitive component analysis approach for developing game-based spatial learning tools , 2012, Comput. Educ..

[137]  Maria del Carmen Juan Lizandra,et al.  The effects of computer-based games and collaboration in large groups vs. collaboration in pairs or traditional methods , 2015, Comput. Educ..

[138]  Tzung-Shi Chen,et al.  The study on integrating WebQuest with mobile learning for environmental education , 2011, Comput. Educ..

[139]  Miguel Nussbaum,et al.  Methodology for evaluating a novel education technology: a case study of handheld video games in Chile , 2006, Comput. Educ..

[140]  R. Rosenthal Meta-analytic procedures for social research , 1984 .

[141]  Teresa Roselli,et al.  Can a Hypermedia Cooperative e-Learning Environment Stimulate Constructive Collaboration? , 2006, J. Educ. Technol. Soc..

[142]  Willem D. de Kock Speech versus text supported hints in learning to solve word problems , 2016, Comput. Hum. Behav..

[143]  Cher Ping Lim,et al.  Scaffolding online historical inquiry tasks: A case study of two secondary school classrooms , 2008, Comput. Educ..

[144]  Jang-Ping Sheu,et al.  Realizing Outdoor Independent Learning with a Butterfly-Watching Mobile Learning System , 2005 .

[145]  Tzu-Chien Liu,et al.  The effects of integrating mobile devices with teaching and learning on students' learning performance: A meta-analysis and research synthesis , 2016, Comput. Educ..

[146]  Dea van Lierop,et al.  ABRACADABRA in the hands of teachers: The effectiveness of a web-based literacy intervention in grade 1 language arts programs , 2010, Comput. Educ..

[147]  Auzar Auzar,et al.  The Use of Computers in Teaching Approach to Improve Reading Skills among Primary School Pupils , 2013 .

[148]  B. Turan,et al.  Smart Board in Mathematics Education, the Use of Cartoon Characters İmpact on Student Success , 2014 .

[149]  C.-Y. Lin,et al.  Development of children's creativity and manual skills within digital game-based learning environment , 2014, J. Comput. Assist. Learn..

[150]  Hanho Jeong,et al.  A comparison of the influence of electronic books and paper books on reading comprehension, eye fatigue, and perception , 2012, Electron. Libr..

[151]  K. Dalacosta,et al.  Multimedia application with animated cartoons for teaching science in elementary education , 2009, Comput. Educ..

[152]  Yuen-kuang Cliff Liao,et al.  Effects of Hypermedia Versus Traditional Instruction on Students’ Achievement , 1998 .

[153]  Chih-Fang Huang,et al.  Learning effectiveness of applying automated music composition software in the high grades of elementary school , 2015, Comput. Educ..

[154]  Remziye Ergül,et al.  The investion effect of using WebQuest on logical thinking ability in science education , 2010 .

[155]  Lars Bollen,et al.  Collaborative drawing on a shared digital canvas in elementary science education: The effects of script and task awareness support , 2013, Int. J. Comput. Support. Collab. Learn..

[156]  Tan-Hsu Tan,et al.  Outdoor Natural Science Learning with an RFID-Supported Immersive Ubiquitous Learning Environment , 2009, J. Educ. Technol. Soc..

[157]  Oğuz Serin,et al.  The Effects of the Computer-Based Instruction on the Achievement and Problem Solving Skills of the Science and Technology Students. , 2011 .

[158]  S. Higgins,et al.  Collaborative learning with multi-touch technology: Developing adaptive expertise , 2013 .

[159]  David W. Brooks,et al.  The Impact of Virtual Manipulatives on First Grade Geometry Instruction and Learning , 2006 .

[160]  Selcan Kilis,et al.  Informatics Education in Turkey: National ICT Curriculum and Teacher Training at Elementary Level , 2013 .

[161]  Nian-Shing Chen,et al.  Effects of an integrated concept mapping and web-based problem-solving approach on students' learning achievements, perceptions and cognitive loads , 2014, Comput. Educ..