A Systematic Review of One-to-One Access to Laptop Computing in K-12 Classrooms: An Investigation of Factors That Influence Program Impact

In 2005, Nicholas Negroponte stepped onto the stage at TED and challenged the audience: “What would happen if we gave every student a laptop computer?” Ten years later, and twenty-five years after the first laptop program, this dissertation attempts to answer that question using two systematic review procedures, case survey analysis and mixed effects meta-analysis. Literature searches and review resulted in 162 primary studies being included in the case survey of which 88 studies yielding 231 effect sizes and representing approximately 116,150 participants, were selected for the meta-analysis. The case survey analysis revealed that typically, programs were co-educational, involving public middle schools, and conducted at the board or district levels. Program theories, whether stated or inferred clustered around three main themes: technology-enhanced environments, technology-enhanced instruction, and computers as mind tools or learning tools. Program goals were numerous and varied, but centered on technology use and proficiency, achievement, questions of technology equity, and improved instruction. The meta-analysis revealed that one-to-one computing had an impact on five of the six outcomes tested: technology use (mean effect size 0.53), technology proficiency (0.29), student achievement (0.23), student engagement (0.15), and student satisfaction (0.26). Attendance was not significant (0.00). The general effects were moderated in expected and unexpected ways – technology use was moderated by program theory and year, technology proficiency was moderated by technology use and duration, and achievement was moderated by program size, participant age, program year, technology integration, duration, and teacher-centered instruction. Explanations were proposed for these findings, and new directions for future research outlined.

[1]  George Siemens Connectivism: A Learning Theory for the Digital Age , 2004 .

[2]  Michael Russell,et al.  An AlphaSmart for each student: Do teaching and learning change with full access to word processors? , 2003 .

[3]  Robert E. Slavin,et al.  Perspectives on Evidence-Based Research in Education—What Works? Issues in Synthesizing Educational Program Evaluations , 2008 .

[4]  Paul DiMaggio,et al.  Digital Inequality: From Unequal Access to Differentiated Use , 2004 .

[5]  Philip C. Abrami,et al.  Affecting policy and practice: issues involved in developing an Argument Catalogue , 2006 .

[6]  J. Maxwell Understanding and Validity in Qualitative Research , 1992 .

[7]  Rachel Bolstad Digital Opportunities Pilot Project (2001-2003) Evaluation of Notebook Valley , 2005 .

[8]  Robert M. Bernard,et al.  Detecting bias in meta-analyses of distance education research: big pictures we can rely on , 2014 .

[9]  AN EVALUATION OF THE SOUTH CAROLINA JUVENILE ARBITRATION PROGRAM , 2011 .

[10]  R. Clark Media will never influence learning , 1994 .

[11]  On standards of evidence. , 2011, Epidemiology.

[12]  L. Hedges,et al.  Statistical Methods for Meta-Analysis , 1987 .

[13]  R. Rosenthal The file drawer problem and tolerance for null results , 1979 .

[14]  R. G. Duncan,et al.  Beyond the fringe: Building and evaluating scientific knowledge systems , 2009 .

[15]  John Cradler,et al.  Computers and Classrooms: The Status of Technology in U.S. Schools. Policy Information Report. , 1997 .

[16]  Kelly S. Shapley,et al.  Evaluation of the Texas Technology Immersion Pilot: Outcomes for the Third Year (2006-07). , 2008 .

[17]  E. Rogers,et al.  Diffusion of innovations , 1964, Encyclopedia of Sport Management.

[18]  P. Abrami Understanding and Promoting Complex Learning Using Technology , 2001 .

[19]  Yigal Rosen,et al.  Intertwining Digital Content and a One-To-One Laptop Environment in Teaching and Learning , 2012 .

[20]  Insook Lee,et al.  How are Mac Mobile Laptop Computers Working within a Regular Classroom , 2007 .

[21]  Deanna Kuhn,et al.  Is Direct Instruction an Answer to the Right Question? , 2007 .

[22]  Bob Johnstone,et al.  Never Mind the Laptops: Kids, Computers, and Transformation of Learning. , 2004 .

[23]  Michael Trimmel,et al.  Cognitive, social, motivational and health aspects of students in laptop classrooms , 2004, J. Comput. Assist. Learn..

[25]  Tracey C. Burns,et al.  Information and Communication Technologies in Elementary and Secondary Education: A State of the Art Review , 2002 .

[26]  Bridget Young Synthesising Qualitative and Quantitative Evidence within a Systematic Review , 2008 .

[27]  Paul Maderthaner Laptop classrooms as ‚catalysts of change'? A review of international research on the effects of laptop classrooms , 2007 .

[28]  F. Manganello Constructivist Instruction: Success or Failure? , 2010 .

[29]  Chrystalla Mouza Learning with laptops: the impact of one-to-one computing on student attitudes and classroom perceptions , 2006 .

[30]  J. Popay,et al.  Synthesing Qualitative and Quantitative Health Evidence , 2013 .

[31]  Nicholas Vonortas,et al.  A Report Card for One Laptop Per Child Closing the Digital Divide via ICTs and Education: Successes and Failures , 2007 .

[32]  Sugata Mitra,et al.  Children and the Internet: experiments with minimally invasive education in India , 2001, Br. J. Educ. Technol..

[33]  A. Doria Home , 2016, The Jerrie Mock Story.

[34]  Yong Zhao,et al.  What Does One-To-One Computing Bring To Schools? , 2006 .

[35]  C. Hmelo‐Silver,et al.  Scaffolding and Achievement in Problem-Based and Inquiry Learning: A Response to Kirschner, Sweller, and Clark (2006) , 2007 .

[36]  Douglas N. Harris,et al.  Toward Policy-Relevant Benchmarks for Interpreting Effect Sizes: Combining Effects With Costs , 2009 .

[37]  Ronald K. Goodenow Book reviewTeachers and machines: The classroom use of technology since 1920: Larry Cuban. Teachers College Press, 1986, 134pp. , 1988 .

[38]  Kelly Shapley,et al.  Evaluation of the Texas Technology Immersion Pilot: An Analysis of the Baseline Conditions and First-Year Implementation of Technology Immersion in Middle Schools. Executive Summary. , 2006 .

[39]  Sandy Oliver,et al.  Integrating qualitative research with trials in systematic reviews , 2004, BMJ : British Medical Journal.

[40]  Matt Dunleavy,et al.  The Impact of 1:1 Laptop Use on Middle School Math and Science Standardized Test Scores , 2007 .

[41]  Wolfgang Viechtbauer,et al.  Conducting Meta-Analyses in R with the metafor Package , 2010 .

[42]  Richard F. Schmid,et al.  An exploration of bias in meta-analysis: the case of technology integration research in higher education , 2014, J. Comput. High. Educ..

[43]  Georgette M. Michko,et al.  A Meta-Analysis of the Effectiveness of Teaching and Learning With Technology on Student Outcomes December 2003 , 2003 .

[44]  K. Hunt STANDARDS OF EVIDENCE , 2007 .

[45]  Fethi A. Inan,et al.  Laptops in the K-12 classrooms: Exploring factors impacting instructional use , 2010, Comput. Educ..

[46]  A. Neill Summerhill, A Radical Approach to Child Rearing , 1961, Pediatrics.

[47]  Charlene O'Hanlon 1-to-1 Computing: A Measure of Success , 2007 .

[48]  Andrew Zucker Developing a Research Agenda for Ubiquitous Computing in Schools , 2004 .

[49]  Rebecca Rees,et al.  Young people and physical activity: a systematic review matching their views to effective interventions. , 2006, Health education research.

[50]  B. McCombs What Do We Know About Learners and Learning? The Learner-Centered Framework: Bringing the Educational System into Balance , 2001 .

[51]  C. Breese,et al.  Promise in Impermanence: Children Writing with Unlimited Access to Word Processors. , 1996 .

[52]  Christina Parker,et al.  Laptops and Literacy: Learning in the Wireless Classroom , 2007 .

[53]  Fethi A. Inan,et al.  Does technology integration “work” when key barriers are removed? , 2008 .

[54]  Mark Warschauer,et al.  Reconceptualizing the Digital Divide , 2002, First Monday.

[55]  Patricia J. Rogers,et al.  Theory-Based Evaluation: Reflections Ten Years On , 2007 .

[56]  Kelly Shapley,et al.  Evaluating the Implementation Fidelity of Technology Immersion and Its Relationship with Student Achievement , 2010 .

[57]  George D. Kuh,et al.  Do Computers Enhance or Detract from Student Learning? , 2001 .

[58]  David Rutledge,et al.  Three Years of the New Mexico Laptop Learning Initiative (NMLLI): Stumbling Toward Innovation , 2007 .

[59]  Ragnar Andreas Audunson,et al.  Technology and Social Inclusion. Rethinking the Digital Divide , 2006, J. Documentation.

[60]  Sandy Oliver,et al.  Applying systematic review methods to studies of people’s views: an example from public health research , 2004, Journal of Epidemiology and Community Health.

[61]  S. Rozelle,et al.  Roots of Tomorrow's Digital Divide: Documenting Computer Use and Internet Access in China's Elementary Schools Today , 2013 .

[62]  James A. Kulik,et al.  Effects of Using Instructional Technology in Colleges and Universities: What Controlled Evaluation Studies Say , 2003 .

[63]  Nancy L. Leech,et al.  A Proposed Fourth Measure of Significance: The Role of Economic Significance in Educational Research , 2004 .

[64]  Nancy Jane Dalgarno,et al.  COMPULSORY LAPTOP PROGRAMS: TEACHERS' RESPONSES TO THE ADOPTION AND IMPLEMENTATION PROCESS , 2009 .

[65]  Neil Selwyn,et al.  Reconsidering Political and Popular Understandings of the Digital Divide , 2004, New Media Soc..

[66]  Ben Shneiderman,et al.  Technology in Education: The Fight for the Future. , 1998 .

[67]  J. Sweller,et al.  Why Minimally Guided Teaching Techniques Do Not Work: A Reply to Commentaries , 2007 .

[68]  Greetje van der Werf,et al.  Economic Viewpoints in Educational Effectiveness: Cost-effectiveness Analysis of an Educational Improvement Project , 2000 .

[69]  Paul W. Eastwick,et al.  Leveling the Playing Field , 2015, Psychological science.

[70]  O. Debande,et al.  Information and Communication Technologies: A Tool Empowering and Developing the Horizon of the Learner. , 2004 .

[71]  J. Popay,et al.  Systematically reviewing qualitative and quantitative evidence to inform management and policy-making in the health field , 2005, Journal of health services research & policy.

[72]  Jennifer King Rice,et al.  Cost Analysis in Education: Paradox and Possibility , 1997 .

[73]  Brian Rowan,et al.  Organizational Strategies for Promoting Instructional Change: Implementation Dynamics in Schools Working With Comprehensive School Reform Providers , 2007 .

[74]  Gary R. Morrison,et al.  Technology as a Change Agent in the Classroom , 2009 .

[75]  Ludger Woessmann,et al.  Computers and Student Learning: Bivariate and Multivariate Evidence on the Availability and Use of Computers at Home and at School , 2004, SSRN Electronic Journal.

[76]  Mark Warschauer,et al.  Ubiquitous computing, equity, and k-12 schools: can one-to-one laptop programs level the playing field? , 2007 .

[77]  Sally Boyd LITERATURE REVIEW FOR THE EVALUATION OF THE DIGITAL OPPORTUNITIES PROJECTS , 2002 .

[78]  Catherine Wambach From Revolutionary to Evolutionary: 10 Years of 1-to-1 Computing: Laptop Initiatives Are Now a Decade Old. Once a Point of Controversy, They Have Become the Cornerstone of Every District's Technology Hopes , 2006 .

[79]  M. Prensky Digital Natives, Digital Immigrants Part 1 , 2001 .

[80]  Susan M. Land,et al.  The foundations and assumptions of technology-enhanced student-centered learning environments , 1997 .

[81]  Fethi A. Inan,et al.  Factors affecting technology integration in K-12 classrooms: a path model , 2010 .

[82]  E. Hargittai The Digital Divide and What to Do About It , 2003 .

[83]  David H. Jonassen,et al.  Computers as mindtools for engaging learners in critical thinking , 1998 .

[84]  Kelly S. Shapley,et al.  Evaluation of the Texas Technology Immersion Pilot: Third-Year (2006-07) Traits of Higher Technology Immersion Schools and Teachers. , 2008 .

[85]  Chen-Lin C. Kulik,et al.  Meta-Analysis in Education. , 1989 .

[86]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[87]  Feng Li,et al.  An Introduction to Metaanalysis , 2005 .

[88]  Diana Laurillard,et al.  Rethinking University Teaching: A Framework for the Effective Use of Educational Technology , 1993 .

[89]  Peggy A. Ertmer,et al.  Teacher beliefs and technology integration practices: A critical relationship , 2012, Comput. Educ..

[90]  Graham McMahon,et al.  Critical Thinking and ICT Integration in a Western Australian Secondary School , 2009, J. Educ. Technol. Soc..

[91]  Eugenio Severin and Christine Capota One-to-One Laptop Programs in Latin America and the Caribbean , 2011 .

[92]  Kelly S. Shapley,et al.  Evaluation of the Texas Technology Immersion Pilot: Final Outcomes for a Four-Year Study (2004-05 to 2007-08). , 2009 .

[93]  Johannes Strobel,et al.  When is PBL More Effective? A Meta-synthesis of Meta-analyses Comparing PBL to Conventional Classrooms , 2009 .

[94]  Robert M. Bernard,et al.  A Meta-Analysis of Three Types of Interaction Treatments in Distance Education , 2009 .

[95]  S. Papert The children's machine: rethinking school in the age of the computer , 1993 .

[96]  Ann L. Brown,et al.  How people learn: Brain, mind, experience, and school. , 1999 .

[97]  Robert M. Bernard,et al.  Developments and trends in synthesizing diverse forms of evidence: beyond comparisons between distance education and classroom instruction , 2010 .

[98]  Kelly Shapley,et al.  Evaluation of the Texas Technology Immersion Pilot: An Analysis of Second-Year (2005-06) Implementation. , 2007 .

[99]  C. Weiss How Can Theory-Based Evaluation Make Greater Headway? , 1997 .

[100]  Starr Roxanne Hiltz,et al.  Learning Networks: A Field Guide to Teaching and Learning Online , 1995 .

[101]  William R. Penuel,et al.  Implementation and Effects Of One-to-One Computing Initiatives , 2006 .

[102]  Y. Lou,et al.  Small Group and Individual Learning with Technology: A Meta-Analysis , 2001 .

[103]  Kevin Oliver,et al.  Changes in Student Technology Use and Skill in the First Year of a 1-to-1 Computing Program , 2008 .

[104]  Heike Schaumburg The Impact of Mobile Computers in the Classroom--Results From an Ongoing Video Study. , 2001 .

[105]  M. Warschauer,et al.  New Technology and Digital Worlds: Analyzing Evidence of Equity in Access, Use, and Outcomes , 2010 .

[106]  Jacob L. Vigdor,et al.  Scaling the Digital Divide: Home Computer Technology and Student Achievement , 2010 .

[107]  Kelly Shapley,et al.  Evaluation of the Texas Technology Immersion Pilot: First-Year Results. , 2006 .

[108]  Linda Mabry,et al.  LAPTOPS FOR HIGH-RISK STUDENTS: EMPOWERMENT AND PERSONALIZATION IN A STANDARDS-BASED LEARNING ENVIRONMENT , 2006 .

[109]  David A. Wiley,et al.  Open Content and Open Educational Resources: Enabling universal education , 2008 .

[110]  M. Ames Can One Laptop per Child Save the World's Poor? , 2011 .

[111]  M. Warschauer,et al.  Learning with Laptops: A Multi-Method Case Study , 2008 .

[112]  Anne Wade,et al.  Volume 32(3) Fall / automne 2006 A Review of e-Learning in Canada: A Rough Sketch of the Evidence, Gaps and Promising Directions , 2008 .

[113]  Eva Lantos Rezmovic,et al.  Measuring the Degree of Program Implementation , 1983 .

[114]  Shiang-Kwei Wang,et al.  THE IMPACT OF PORTABLE TECHNOLOGIES ON TEACHING AND LEARNING: YEAR FOUR REPORT , 2003 .

[115]  D. Sharpe,et al.  Of apples and oranges, file drawers and garbage: why validity issues in meta-analysis will not go away. , 1997, Clinical psychology review.

[116]  P Gangadharan,et al.  Statistical considerations. , 1973, Indian journal of cancer.

[117]  Robert E. Slavin,et al.  Effective Programs in Elementary Mathematics: A Best-Evidence Synthesis , 2007 .

[118]  Richard F. Schmid,et al.  The effects of technology use in postsecondary education: A meta-analysis of classroom applications , 2014, Comput. Educ..

[119]  Tom Cobb,et al.  Cognitive efficiency: Toward a revised theory of media , 1997 .

[120]  Thomas M. Santella,et al.  Drug delivery systems improve Pharmaceutical profile and facilitate medication adherence , 2005, Advances in therapy.

[121]  Gaea Leinhardt,et al.  Modeling and Measuring Educational Treatment in Evaluation , 1980 .

[122]  Jing Lei The Digital Pencil: One-to-One Computing for Children , 2007 .

[123]  P. Abrami,et al.  Implementing Computer Technologies: Teachers' Perceptions and Practices , 2006 .

[124]  Steven M. Ross,et al.  When each one has one: The influences on teaching strategies and student achievement of using laptops in the classroom , 2003 .

[125]  Kevin Oliver,et al.  Student‐reported differences in technology use and skills after the implementation of one‐to‐one computing , 2008 .

[126]  M. Sandelowski,et al.  Using qualitative metasummary to synthesize qualitative and quantitative descriptive findings. , 2007, Research in nursing & health.

[127]  Eszter Hargittai,et al.  Second-Level Digital Divide: Differences in People's Online Skills , 2002, First Monday.

[128]  Amie Goldberg,et al.  The Effect of Computers on Student Writing: A Meta-analysis of Studies from 1992 to 2002 , 2003 .

[129]  Richard F. Schmid,et al.  A Human-Computer Partnership , 2008 .

[130]  P. Twining Oversold and underused: computers in the classroom , 2002 .

[131]  R. Orwin A fail-safe N for effect size in meta-analysis. , 1983 .

[132]  Carol L. O'Donnell Defining, Conceptualizing, and Measuring Fidelity of Implementation and Its Relationship to Outcomes in K–12 Curriculum Intervention Research , 2008 .

[133]  R. Padilla,et al.  Using Qualitative Research to Assess Advising , 2017 .

[134]  I. Cuthill,et al.  Effect size, confidence interval and statistical significance: a practical guide for biologists , 2007, Biological reviews of the Cambridge Philosophical Society.

[135]  Arun Kulkarni,et al.  'Hole-In-The-Wall' Computer Kiosks Foster Mathematics Achievement - A Comparative Study , 2007, J. Educ. Technol. Soc..

[136]  Ritu Dangwal,et al.  Acquisition of Computing Literacy on Shared Public Computers: Children and the "Hole in the Wall" , 2005 .

[137]  Heike Schaumburg Fostering Girls' Computer Literacy through Laptop Learning: Can Mobile Computers Help To Level Out the Gender Difference?. , 2001 .

[138]  Kelly S. Shapley,et al.  Evaluation of the Texas Technology Immersion Pilot: Findings from the Second Year. , 2007 .

[139]  Mark E. Weston,et al.  The End of Techno-Critique: The Naked Truth about 1:1 Laptop Initiatives and Educational Change , 2010 .

[140]  Andrew Zucker,et al.  Lessons Learned About Providing Laptops for All Students. , 2004 .

[141]  Clare D. Klunk Collaborating Online: Learning Together in Community , 2005 .

[142]  Philip C. Abrami,et al.  Introducing laptops to children: An examination of ubiquitous computing in Grade 3 reading, language, and mathematics , 2008 .

[143]  Michael Russell,et al.  Technology and Assessment Study Collaborative , 2002 .

[144]  Seymour Papert,et al.  Mindstorms: Children, Computers, and Powerful Ideas , 1981 .

[145]  Jane M. Healy,et al.  Failure to Connect: How Computers Affect Our Children''s Minds-for , 1998 .

[146]  Richard E. Clark,et al.  Why Minimal Guidance During Instruction Does Not Work: An Analysis of the Failure of Constructivist, Discovery, Problem-Based, Experiential, and Inquiry-Based Teaching , 2006 .

[147]  H. Levin,et al.  Cost-Effectiveness Analysis: Methods and Applications , 2000 .

[148]  Lynn Lyons Morris,et al.  Theory-based evaluation☆ , 1996 .

[149]  Stephen W. Raudenbush,et al.  Analyzing effect sizes: Random-effects models. , 2009 .

[150]  Philip C. Abrami,et al.  Research on Distance Education: In defense of field experiments , 2006 .

[151]  M. Borenstein,et al.  Publication Bias in Meta-Analysis , 2006 .

[152]  H Roberts,et al.  Evidence, hierarchies, and typologies: horses for courses , 2003, Journal of epidemiology and community health.

[153]  J. Schacter The Impact of Education Technology on Student Achievement: What the Most Current Research Has To Say. , 1999 .

[154]  Matt Dunleavy,et al.  What added value does a 1: 1 student to laptop ratio bring to technology-supported teaching and learning? , 2007, J. Comput. Assist. Learn..

[155]  G. Glass Primary, Secondary, and Meta-Analysis of Research1 , 1976 .

[156]  Laura M. O’Dwyer,et al.  Special Edition: Educational Outcomes and Research from 1:1 Computing Settings , 2010 .

[157]  Rosemary J. Redfield,et al.  Does the medium change the message? The impact of a web-based genetics course on university students' perspectives on learning and teaching , 2002, Comput. Educ..

[158]  Sofie M. M. Loyens,et al.  Problem-Based Learning is Compatible with Human Cognitive Architecture: Commentary on Kirschner, Sweller, and Clark (2006) , 2007 .

[159]  Mark Warschauer,et al.  Promoting academic literacy with technology: successful laptop programs in K-12 schools , 2004 .

[160]  M. Carter Visible learning: a synthesis of over 800 meta‐analyses relating to achievement , 2009 .

[161]  R. Clark Reconsidering Research on Learning from Media , 1983 .

[162]  William R. Shadish,et al.  Combining estimates of effect size. , 1994 .

[163]  Thomas J. Shuell,et al.  Students' Perceptions of Technology Use in College Courses , 2001 .

[164]  David L. Silvernail,et al.  The Impact of Maine's One-to-One Laptop Program on Middle School Teachers and Students , 2004 .

[165]  Robert L. Bangert-Drowns,et al.  The Word Processor as an Instructional Tool: A Meta-Analysis of Word Processing in Writing Instruction , 1993 .

[166]  Kenneth L. Kraemer,et al.  One Laptop per Child: Vision vs. Reality , 2022 .

[167]  David H. Jonassen,et al.  Engaging and Supporting Problem Solving in Online Learning , 2002 .

[168]  R. Mayer Should there be a three-strikes rule against pure discovery learning? The case for guided methods of instruction. , 2004, The American psychologist.

[169]  James Cengiz Gulek,et al.  Learning With Technology: The Impact of Laptop Use on Student Achievement , 2005 .

[170]  Geoffrey D. Borman,et al.  Comprehensive School Reform and Achievement: A Meta-Analysis , 2003 .

[171]  Sandy Oliver,et al.  Promoting physical activity amongst children outside of physical education classes: A systematic review integrating intervention studies and qualitative studies , 2005 .

[172]  Robert M. Bernard Things I Have Learned about Meta-­Analysis since 1990: Reducing Bias in Search of "The Big Picture" , 2014 .

[173]  Paul DiMaggio,et al.  From the 'Digital Divide' to 'Digital Inequality': Studying Internet Use as Penetration Increases , 2001 .

[174]  Kelly Shapley,et al.  Effects of Technology Immersion on Middle School Students’ Learning Opportunities and Achievement , 2011 .

[175]  R. Kozma Will media influence learning? Reframing the debate , 1994 .

[176]  Sugata Mitra,et al.  Minimally Invasive Education for mass computer literacy , 2000 .

[177]  Mark Warschauer,et al.  Information Literacy in the Laptop Classroom , 2007, Teachers College Record: The Voice of Scholarship in Education.

[178]  Marlene Scardamalia,et al.  Computer Support for Knowledge-Building Communities , 1994 .