Improving Education Outcomes in Developing Countries: Evidence, Knowledge Gaps, and Policy Implications

Abstract Improvements in empirical research standards for credible identification of the causal impact of education policies on education outcomes have led to a significant increase in the body of evidence available on improving education outcomes in developing countries. This chapter aims to synthesize this evidence, interpret their results, and discuss the reasons why some interventions appear to be effective and others do not, with the ultimate goal of drawing implications for both research and policy. Interpreting the evidence for generalizable lessons is challenging because of variation across contexts, duration and quality of studies, and the details of specific interventions studied. Nevertheless, some broad patterns do emerge. Demand-side interventions that increase the immediate returns to (or reduce household costs of) school enrollment, or that increase students’ returns to effort, are broadly effective at increasing time in school and learning outcomes, but vary considerably in cost-effectiveness. Many expensive “standard” school inputs are often not very effective at improving outcomes, though some specific inputs (which are often less expensive) are. Interventions that focus on improved pedagogy (especially supplemental instruction to children lagging behind grade level competencies) are particularly effective, and so are interventions that improve school governance and teacher accountability. Our broad policy message is that the evidence points to several promising ways in which the efficiency of education spending in developing countries can be improved by pivoting public expenditure from less cost-effective to more cost-effective ways of achieving the same objectives. We conclude by documenting areas where more research is needed, and offer suggestions on the public goods and standards needed to make it easier for decentralized and uncoordinated research studies to be compared across contexts.

[1]  Sebastian Galiani,et al.  The Heterogeneous Impact of Conditional Cash Transfers , 2013 .

[2]  Adrienne M. Lucas,et al.  Effects of School Quality on Student Achievement: Discontinuity Evidence from Kenya , 2014 .

[3]  Sheetal Sekhri Public Provision and Protection of Natural Resources: Groundwater Irrigation in Rural India , 2011 .

[4]  H. Alderman,et al.  Educational and Child Labour Impacts of Two Food-for-Education Schemes: Evidence from a Randomised Trial in Rural Burkina Faso , 2012 .

[5]  Leigh L. Linden,et al.  Improving the Design of Conditional Transfer Programs: Evidence from a Randomized Education Experiment in Colombia † , 2011 .

[6]  M. Kremer,et al.  The Two-Margin Problem in Insurance Markets , 2004, Review of Economics and Statistics.

[7]  Julian P. Cristia,et al.  Does Technology in Schools Affect Repetition, Dropout and Enrollment? Evidence from Peru , 2014 .

[8]  Diether W. Beuermann,et al.  Home Computers and Child Outcomes: Short-Term Impacts from a Randomized Experiment in Peru , 2012 .

[9]  Cristián Bellei,et al.  Does lengthening the school day increase students’ academic achievement? Results from a natural experiment in Chile , 2009 .

[10]  S. Rozelle,et al.  Can Information and Counseling Help Students from Poor Rural Areas Go to High School? Evidence from China , 2013 .

[11]  Karthik Muralidharan,et al.  Contract Teachers: Experimental Evidence from India , 2013 .

[12]  Frederico Finan,et al.  Local Electoral Incentives and Decentralized Program Performance , 2010, Review of Economics and Statistics.

[13]  M. Kremer,et al.  Worms: Education and Health Externalities in Kenya , 2001 .

[14]  F. Finan,et al.  Corrupting Learning: Evidence from Missing Federal Education Funds in Brazil , 2012, SSRN Electronic Journal.

[15]  K. Muralidharan A New Approach to Public Sector Hiring in India for Improved Service Delivery , 2015 .

[16]  Sudhanshu Handa,et al.  Raising primary school enrolment in developing countries: The relative importance of supply and demand , 2002 .

[17]  K. Orkin Young Lives Working Paper 119. The Effect of Lengthening the School Day on Children's Achievement in Ethiopia , 2013 .

[18]  T. Schultz SCHOOL SUBSIDIES FOR THE POOR: EVALUATING THE MEXICAN PROGRESA POVERTY PROGRAM , 2012 .

[19]  Karthik Muralidharan,et al.  Missing in action: teacher and health worker absence in developing countries. , 2006, The journal of economic perspectives : a journal of the American Economic Association.

[20]  S. Rozelle,et al.  Encouraging classroom peer interactions: Evidence from Chinese migrant schools , 2014 .

[21]  Jee‐Peng Tan,et al.  Managing for Results in Primary Education in Madagascar: Evaluating the Impact of Selected Workflow Interventions , 2010 .

[22]  N. Bloom,et al.  Does Management Matter in Schools? , 2014, SSRN Electronic Journal.

[23]  K. Basu,et al.  "Chasing the Syllabus: Measuring Learning Trajectories in Developing Countries with Longitudinal Data and Item Response Theory" (with Yendrick Zieleniak) "Double for Nothing? The Effects of Unconditional Teacher Salary Increases in Indonesia" (with , 2015 .

[24]  Karthik Muralidharan,et al.  Double for Nothing? Experimental Evidence on the Impact of an Unconditional Teacher Salary Increase on Student Performance in Indonesia , 2015 .

[25]  M. Kremer,et al.  Public-Private Schools in Rural India , 2009 .

[26]  Laura B. Rawlings,et al.  An impact evaluation of education, health, and water supply investments by the Bolivian social investment fund , 2002 .

[27]  Karthik Muralidharan,et al.  Preliminary and Incomplete: Please do not cite or circulate without authors’ permission The Aggregate Effect of School Choice: Evidence from a two-stage experiment in India , 2012 .

[28]  Steven D. Levitt,et al.  The Effect of School Choice on Participants: Evidence from Randomized Lotteries , 2006 .

[29]  Owen Ozier Exploiting Externalities to Estimate the Long-Term Effects of Early Childhood Deworming , 2014, American Economic Journal: Applied Economics.

[30]  Junko Onishi,et al.  Should Aid Reward Performance? Evidence from a Field Experiment on Health and Education in Indonesia , 2012, American economic journal. Applied economics.

[31]  Katharine M. Conn Identifying Effective Education Interventions in Sub-Saharan Africa: A Meta-Analysis of Rigorous Impact Evaluations. , 2014 .

[32]  James Berry,et al.  The impact of mother literacy and participation programs on child learning: Evidence from a randomized evaluation in India , 2015 .

[33]  M. Urquiola,et al.  Identifying Class Size Effects in Developing Countries: Evidence from Rural Bolivia , 2006, Review of Economics and Statistics.

[34]  P. McEwan The Impact of Chile's School Feeding Program on Education Outcomes. , 2013 .

[35]  Leigh L. Linden Complement or substitute? The effect of technology on student achievement in India , 2008 .

[36]  P. Glewwe,et al.  A Better Vision for Development: Eyeglasses and Academic Performance in Rural Primary Schools in China , 2016 .

[37]  K. Muralidharan WORKING DRAFT : COMMENTS WELCOME Long-Term Effects of Teacher Performance Pay : Experimental Evidence from India , 2011 .

[38]  Karthik Muralidharan,et al.  Field Experiments in Education in Developing Countries , 2017 .

[39]  B. Barham,et al.  Women's Power, Conditional Cash Transfers, and Schooling in Nicaragua , 2007 .

[40]  Tomás Rau,et al.  Tournament Incentives for Teachers: Evidence from a Scaled-Up Intervention in Chile , 2012, Economic Development and Cultural Change.

[41]  L. Santibañez,et al.  School based management effects: Resources or governance change? Evidence from Mexico , 2014 .

[42]  Leigh L. Linden,et al.  School Libraries and Language Skills in Indian Primary Schools: A Randomized Evaluation of the Akshara Library Program , 2012 .

[43]  K. Michaelowa,et al.  Teacher shortages, teacher contracts and their effect on education in Africa , 2007, SSRN Electronic Journal.

[44]  Petra E. Todd,et al.  Assessing the Impact of a School Subsidy Program in Mexico: Using a Social Experiment to Validate a Dynamic Behavioral Model of Child Schooling and Fertility. , 2006, The American economic review.

[45]  R. Reinikka,et al.  Local Capture: Evidence from a Central Government Transfer Program in Uganda , 2004 .

[46]  Robert T. Jensen,et al.  The (Perceived) Returns to Education and the Demand for Schooling , 2010 .

[47]  K. Muralidharan Priorities for Primary Education Policy in India’s 12th Five-year Plan , 2013 .

[48]  Moussa P. Blimpo Team Incentives for Education in Developing Countries A Randomized Field Experiment in Benin , 2014 .

[49]  Priyanka Pandey,et al.  Community Participation in Public Schools: The Impact of Information Campaigns in Three Indian States , 2008 .

[50]  Eric Zitzewitz,et al.  Retrospective vs. Prospective Analyses of School Inputs: The Case of Flip Charts in Kenya , 2004 .

[51]  S. Rozelle,et al.  Do You Get What You Pay for with School-Based Health Programs? Evidence from a Child Nutrition Experiment in Rural China , 2013 .

[52]  Martin Carnoy,et al.  Cuba’s Academic Advantage: Why Students in Cuba Do Better in School , 2007 .

[53]  G. Baker Incentive Contracts and Performance Measurement , 1992, Journal of Political Economy.

[54]  S. Rozelle,et al.  Giving Kids a Head Start: The Impact and Mechanisms of Early Commitment of Financial Aid on Poor Students in Rural China , 2014 .

[55]  Petra E. Todd,et al.  Schooling Impacts of Conditional Cash Transfers on Young Children: Evidence from Mexico , 2009, Economic Development and Cultural Change.

[56]  R. Lalonde Evaluating the Econometric Evaluations of Training Programs with Experimental Data , 1984 .

[57]  Cecilia Adrogué,et al.  Do In-School Feeding Programs Have an Impact on Academic Performance? The Case of Public Schools in Argentina , 2013 .

[58]  Pay for Percentile , 2012 .

[59]  Hongliang Zhang The Mirage of Elite Schools: Evidence from Lottery-based School Admissions in China , 2013 .

[60]  Leigh L. Linden,et al.  The Use and Misuse of Computers in Education: Evidence from a Randomized Experiment in Colombia. Impact Evaluation Series No. 29. Policy Research Working Paper 4836. , 2009 .

[61]  S. Rozelle,et al.  Does computer-assisted learning improve learning outcomes? Evidence from a randomized experiment in migrant schools in Beijing , 2015 .

[62]  Amanda Beatty,et al.  Improving Educational Quality Through Enhancing Community Participation: Results from a Randomized Field Experiment in Indonesia , 2011 .

[63]  Angus Deaton Instruments, Randomization, and Learning about Development , 2010 .

[64]  The Medium-Term Effects of Scholarships in a Low-Income Country , 2014 .

[65]  Dean Karlan,et al.  Six Randomized Evaluations of Microcredit: Introduction and Further Steps † , 2015 .

[66]  Petra E. Todd,et al.  Are conditional cash transfers effective in urban areas? Evidence from Mexico , 2011, Education economics.

[67]  G. Mwabu,et al.  Scaling Up What Works: Experimental Evidence on External Validity in Kenyan Education , 2013 .

[68]  Mark R. Rosenzweig,et al.  Traditional Institutions Meet the Modern World: Caste, Gender and Schooling Choice in a Globalizing Economy , 2003 .

[69]  Jee‐Peng Tan,et al.  Student Outcomes in Philippine Elementary Schools: An Evaluation of Four Experiments , 1999 .

[70]  H. Oosterbeek,et al.  Can Provision of Free School Uniforms Harm Attendance? Evidence from Ecuador , 2010 .

[71]  C. Meghir,et al.  Education choices in Mexico: using a structural model and a randomized experiment to evaluate Progresa , 2010 .

[72]  J. Tooley The Beautiful Tree: A Personal Journey Into How the World's Poorest People Are Educating Themselves , 2009 .

[73]  Aimee Chin,et al.  Can redistributing teachers across schools raise educational attainment? Evidence from Operation Blackboard in India , 2005 .

[74]  Rukmini,et al.  Departnnent of Economics Working Paper Series Pitfalls of Participatory Programs : Evidence from a Randomized Evaluation in Education in India , 2011 .

[75]  Peter F. Orazem,et al.  Design, Evaluation, and Sustainability of Private Schools for the Poor: The Pakistan Urban and Rural Fellowship School Experiments , 2003 .

[76]  Home Computers and Child Outcomes: Short-Term Impacts from a Randomized Experiment in Peru , 2013 .

[77]  Niall Keleher,et al.  Conditional Cash Transfers: Reducing Present and Future Poverty , 2009 .

[78]  Petra E. Todd,et al.  On the Specification and Estimation of the Production Function for Cognitive Achievement , 2003 .

[79]  J. Svensson,et al.  POWER TO THE PEOPLE: EVIDENCE FROM A RANDOMIZED FIELD EXPERIMENT ON COMMUNITY-BASED MONITORING IN UGANDA∗ , 2008 .

[80]  Rebecca Lynn Thornton,et al.  Menstruation, Sanitary Products, and School Attendance: Evidence from a Randomized Evaluation , 2011 .

[81]  J. Baez,et al.  Assessing the Long-Term Effects of Conditional Cash Transfers on Human Capital: Evidence from Colombia , 2011, SSRN Electronic Journal.

[82]  J. Betts The Economics of Tracking in Education , 2011 .

[83]  K. Muralidharan,et al.  Cycling to School: Increasing Secondary School Enrollment for Girls in India , 2013, SSRN Electronic Journal.

[84]  M. Kremer,et al.  Worms at Work: Long-run Impacts of a Child Health Investment , 2015, The quarterly journal of economics.

[85]  Christopher A. Neilson,et al.  Early Life Health Interventions and Academic Achievement , 2012, The American economic review.

[86]  J. Angrist,et al.  The Elite Illusion: Achievement Effects at Boston and New York Exam Schools. NBER Working Paper No. 17264. , 2011 .

[87]  R. Murnane,et al.  Improving Educational Outcomes in Developing Countries: Lessons from Rigorous Evaluations , 2014 .

[88]  Leigh L. Linden,et al.  The Effects of 'Girl-Friendly' Schools: Evidence from the Bright School Construction Program in Burkina Faso , 2012, SSRN Electronic Journal.

[89]  R. Martorell,et al.  Nutrition and Educational Performance in Rural China’s Elementary Schools: Results of a Randomized Control Trial in Shaanxi Province , 2012, Economic Development and Cultural Change.

[90]  Sarah Baird,et al.  Cash or Condition? Evidence from a Cash Transfer Experiment , 2010 .

[91]  Victor Lavy Performance Pay and Teachers' Effort, Productivity and Grading Ethics , 2004 .

[92]  K. Chay,et al.  The Central Role of Noise in Evaluating Interventions that Use Test Scores to Rank Schools , 2003 .

[93]  P. Glewwe,et al.  The impacts of school management reforms in Madagascar: do the impacts vary by teacher type? , 2011 .

[94]  C. Kirabo Jackson,et al.  Single-Sex Schools, Student Achievement, and Course Selection: Evidence from Rule-Based Student Assignments in Trinidad and Tobago , 2011 .

[95]  M. Rosenzweig,et al.  Human Capital Investment and the Gender Division of Labor in a Brawn-Based Economy. , 2012, The American economic review.

[96]  Evan Borkum Can Eliminating School Fees in Poor Districts Boost Enrollment? Evidence from South Africa , 2012, Economic Development and Cultural Change.

[97]  P. Glewwe,et al.  Many Children Left Behind? Textbooks and Test Scores in Kenya , 2007 .

[98]  Petra E. Todd,et al.  Do Conditional Cash Transfers for Schooling Generate Lasting Benefits?: A Five-Year Followup of PROGRESA/Oportunidades , 2012 .

[99]  Catherine M. Jere,et al.  Disrupting patterns of educational inequality and disadvantage in Malawi , 2011 .

[100]  P. Glewwe,et al.  The Impact of Child Health and Nutrition on Education in Less Developed Countries , 2008 .

[101]  G. Jin,et al.  Does Health Insurance Coverage Lead to Better Health and Educational Outcomes? Evidence from Rural China , 2010, Journal of health economics.

[102]  E. Hanushek,et al.  The Knowledge Capital of Nations: Education and the Economics of Growth , 2015 .

[103]  Esther Duflo,et al.  School Governance, Teacher Incentives, and Pupil-Teacher Ratios: Experimental Evidence from Kenyan Primary Schools , 2012 .

[104]  Leigh L. Linden,et al.  The Use and Misuse of Computers in Education : Evidence from a Randomized Experiment in Colombia , 2009 .

[105]  Y. Ben-Porath The Production of Human Capital and the Life Cycle of Earnings , 1967, Journal of Political Economy.

[106]  Karthik Muralidharan,et al.  TEACHER ABSENCE IN INDIA: A SNAPSHOT , 2005 .

[107]  Willa Friedman,et al.  Education as Liberation? , 2011, Economica.

[108]  E. Chirwa,et al.  Girl Power: Cash Transfers and Adolescent Welfare. Evidence from a Cluster-Randomized Experiment in Malawi , 2013 .

[109]  K. Muralidharan,et al.  Contract Teachers: Experimental Evidence from India. NBER Working Paper No. 19440. , 2013 .

[110]  K. Macours,et al.  More Schooling and More Learning?: Effects of a Three-Year Conditional Cash Transfer Program in Nicaragua after 10 Years , 2013 .

[111]  E. Fitzsimons,et al.  Children’s Schooling and Work in the Presence of a Conditional Cash Transfer Program in Rural Colombia , 2010, Economic Development and Cultural Change.

[112]  D. Elbourne,et al.  The Support to Rural India's Public Education System (STRIPES) Trial: A Cluster Randomised Controlled Trial of Supplementary Teaching, Learning Material and Material Support , 2013, PloS one.

[113]  Anna Popova,et al.  What Really Works to Improve Learning in Developing Countries? An Analysis of Divergent Findings in Systematic Reviews , 2015 .

[114]  R. Govmda,et al.  Para-teachers in India: A Review , 2005 .

[115]  Felipe Barrera-Osorio,et al.  Incentivizing Schooling for Learning: Evidence on the Impact of Alternative Targeting Approaches , 2013, The Journal of Human Resources.

[116]  E. Duflo Schooling and Labor Market Consequences of School Construction in Indonesia: Evidence from an Unusual Policy Experiment , 2000 .

[117]  P. Glewwe,et al.  Schools, Teachers, and Education Outcomes in Developing Countries Second Draft of Chapter for Handbook on the Economics of Education , 2005 .

[118]  G. Becker,et al.  Investment in Human Capital: A Theoretical Analysis , 1962, Journal of Political Economy.

[119]  Futoshi Yamauchi An alternative estimate of school-based management impacts on students’ achievements: evidence from the Philippines , 2014 .

[120]  Karthik Muralidharan,et al.  *The Impact of Diagnostic Feedback to Teachers on Student Learning: Experimental Evidence from India , 2010 .

[121]  Victor Lavy Evaluating the Effect of Teachers' Performance Incentives on Pupil Achievement , 2001 .

[122]  M. Urquiola,et al.  Class-Size Caps, Sorting, and the Regression-Discontinuity Design , 2009 .

[123]  S. Rozelle,et al.  School Dropouts and Conditional Cash Transfers: Evidence from a Randomised Controlled Trial in Rural China's Junior High Schools , 2011 .

[124]  Dani Rodrik,et al.  The New Development Economics: We Shall Experiment, but How Shall We Learn? , 2008 .

[125]  Michael Kremer,et al.  The Challenge of Education and Learning in the Developing World , 2013, Science.

[126]  Leigh L. Linden,et al.  Bringing Education to Afghan Girls: A Randomized Controlled Trial of Village-Based Schools , 2013 .

[127]  Angus Deaton,et al.  The Great Escape: health, Wealth, and the Origins , 2013 .

[128]  M. Kremer,et al.  The O-Ring Theory of Economic Development , 1993 .

[129]  L. Pritchett,et al.  Context Matters for Size: Why External Validity Claims and Development Practice do not Mix , 2014 .

[130]  Joshua D. Angrist,et al.  Long-Term Educational Consequences of Secondary School Vouchers: Evidence from Administrative Records in Colombia , 2006 .

[131]  Cristian Pop-Eleches,et al.  Going to a Better School: Effects and Behavioral Responses , 2011 .

[132]  D. Gilligan,et al.  The Impact of Food for Education Programs on School Participation in Northern Uganda , 2012, Economic Development and Cultural Change.

[133]  John N. Friedman,et al.  How Does Your Kindergarten Classroom Affect Your Earnings? Evidence from Project Star , 2010, The quarterly journal of economics.

[134]  Bernardo Lara,et al.  The Effectiveness of Private Voucher Education , 2011 .

[135]  Chang-Tai Hsieh,et al.  The effects of generalized school choice on achievement and stratification: Evidence from Chile's voucher program , 2006 .

[136]  P. Glewwe,et al.  The impact of the Bolsa Escola/Familia conditional cash transfer program on enrollment, dropout rates and grade promotion in Brazil , 2012 .

[137]  Paul R. Milgrom,et al.  Multitask Principal–Agent Analyses: Incentive Contracts, Asset Ownership, and Job Design , 1991 .

[138]  N. Chaudhury,et al.  Conditional Cash Transfers and Female Schooling: The Impact of the Female School Stipend Program on Public School Enrollments in Punjab, Pakistan , 2006 .

[139]  Dean Yang,et al.  Channeling Remittances to Education: A Field Experiment Among Migrants from El Salvador , 2014, American economic journal. Applied economics.

[140]  Linxiu Zhang,et al.  Computers and the academic performance of elementary school-aged girls in China's poor communities , 2013, Comput. Educ..

[141]  Esther Duflo,et al.  Peer Effects, Teacher Incentives, and the Impact of Tracking: Evidence from a Randomized Evaluation in Kenya , 2008 .

[142]  Karthik Muralidharan,et al.  School Inputs, Household Substitution, and Test Scores , 2011 .

[143]  Priyanka Pandey,et al.  How do government and private schools differ? Findings from two large Indian states , 2009 .

[144]  Leigh L. Linden,et al.  Improving Reading Skills by Encouraging Children to Read in School: , 2014, The Journal of Human Resources.

[145]  Stephen P. Ryan,et al.  Incentives Work: Getting Teachers to Come to School , 2012 .

[146]  Jee‐Peng Tan The transformative effect of managing for results in primary education in Madagascar , 2010 .

[147]  P. McEwan Improving Learning in Primary Schools of Developing Countries , 2015 .

[148]  Shari Krishnaratne,et al.  Quality education for all children? What works in education in developing countries , 2014 .

[149]  H. Patrinos,et al.  Empowering Parents to Improve Education : Evidence from Rural Mexico , 2006 .

[150]  Tristan Zajonc,et al.  Do Value-Added Estimates Add Value? Accounting for Learning Dynamics , 2009 .

[151]  Edward Miguel,et al.  Worms: Identifying Impacts on Education and Health in the Presence of Treatment Externalities, Guide to Replication of Miguel and Kremer (2004) , 2014 .