Evaluating advocacy: an exploration of evidence and tools to understand what works and why

[1]  Daniel Roduner.  Logical Framework Approach and Outcome Mapping A Constructive Attempt of Synthesis , 2008 .

[2]  F. Bonino,et al.  Addressing causation in humanitarian evaluation: A discussion on designs, approaches and examples , 2015 .

[3]  Paul J. Gertler,et al.  Promoting Handwashing Behavior in Peru: The Effect of Large-Scale Mass-Media and Community Level Interventions , 2012 .

[4]  Roland G. Fryer.  Information and Student Achievement: Evidence from a Cellular Phone Experiment , 2013 .

[5]  Jakob Svensson,et al.  Fighting Corruption to Improve Schooling: Evidence from a Newspaper Campaign in Uganda , 2005 .

[6]  Jeffrey T. Checkel.  It’s the Process Stupid! Process Tracing in the Study of European and International Politics , 2005 .

[7]  H. Allcott,et al.  Social Norms and Energy Conservation , 2011 .

[8]  E. Duflo,et al.  Impacts of School-Based HIV Education on Reported Behavior and Knowledge of Adolescent Girls, Evidence from Cameroon , 2012 .

[9]  Daniel Phillips,et al.  Addressing attribution of cause and effect in small n impact evaluations: towards an integrated framework , 2012 .

[10]  S. Rozelle,et al.  The Limits of Health and Nutrition Education: Evidence from Three Randomized-Controlled Trials in Rural China , 2012 .

[11]  F. Espinoza-Gomez,et al.  Educational campaign versus malathion spraying for the control of Aedes aegypti in Colima, Mexico , 2002, Journal of epidemiology and community health.

[12]  S. Kalichman,et al.  Effectiveness of a video-based motivational skills-building HIV risk-reduction intervention for female military personnel. , 2011, Social science & medicine.

[13]  Dean S. Karlan,et al.  Does Corruption Information Inspire the Fight or Quash the Hope? A Field Experiment in Mexico on Voter Turnout, Choice, and Party Identification , 2014, The Journal of Politics.

[14]  Paul Wang,et al.  Evaluations with impact: decision-focused impact evaluation as a practical policymaking tool , 2015 .

[15]  John Mayne,et al.  Addressing Attribution through Contribution Analysis: Using Performance Measures Sensibly , 2001, Canadian Journal of Program Evaluation.

[16]  Dean S. Karlan,et al.  (Ineffective) Messages to Encourage Recycling: Evidence from a Randomized Evaluation in Peru , 2013 .

[17]  Dean S. Karlan,et al.  The Effect of Effectiveness: Donor Response to Aid Effectiveness in a Direct Mail Fundraising Experiment , 2014 .

[18]  Annette N. Brown,et al.  Is impact evaluation still on the rise? The new trends in 2010–2015 , 2018, Journal of Development Effectiveness.

[19]  F. Carden,et al.  Learning from complexity: The International Development Research Centre's experience with Outcome Mapping , 2002 .

[20]  J. Chapman,et al.  Monitoring and Evaluating Advocacy: A Scoping Study , 2001 .

[21]  O. Attanasio,et al.  Behind the scenes: managing and conducting large scale impact evaluations in Colombia , 2012 .

[22]  David Collier,et al.  Understanding Process Tracing , 2011, PS: Political Science & Politics.

[23]  Fred Carden,et al.  Outcome mapping : building learning and reflection into development programs [Arabic version] , 2002 .

[24]  Taryn Dinkelman,et al.  Investing in Schooling In Chile: The Role of Information about Financial Aid for Higher Education , 2011, Review of Economics and Statistics.

[25]  Shawn Cole,et al.  The Value of Advice: Evidence from Mobile Phone-Based Agricultural Extension , 2013 .

[26]  Christine Poulos,et al.  Promoting Latrine Use : Midline Findings from a Randomized Evaluation of a Community Mobilization Campaign in Bhadrak , Orissa , 2007 .

[27]  A. Tiwari,et al.  Effect of an advocacy intervention on mental health in Chinese women survivors of intimate partner violence: A randomized controlled trial , 2011 .

[28]  C. Paden.  Civil Rights Advocacy on Behalf of the Poor , 2011 .

[29]  Zunyou Wu,et al.  Evaluation of a needle social marketing strategy to control HIV among injecting drug users in China , 2007, AIDS.

[30]  H. Jones.  A guide to monitoring and evaluating policy influence Background Note February , 2011 .

[31]  Hannah L Bowen.  Impact of a mass media campaign on bed net use in Cameroon , 2013, Malaria Journal.

[32]  Alexander L. George,et al.  Process Tracing , 2008 .

[33]  Leonard A. Steverson.  Rethinking Social Inquiry: Diverse Tools, Shared Standards , 2005 .

[34]  J. Mayne.  Contribution Analysis: Addressing Cause and Eff ect , 2017 .

[35]  Edward A. Smith,et al.  Substance Use and Sexual Risk Prevention in Cape Town, South Africa: An Evaluation of the HealthWise Program , 2008, Prevention Science.

[36]  M. Székely.  Promoting Commitment to Evaluate , 2013 .

[37]  Andrew Bennett,et al.  Process Tracing: a Bayesian Perspective , 2008 .

[38]  Birte Snilstveit,et al.  3ie evidence gap maps: a starting point for strategic evidence production and use , 2017 .

[39]  S. Pattinson,et al.  Learning to fly. , 1998 .

[40]  Terry Smutylo,et al.  Outcome Mapping: A method for tracking behavioural changes in development programs , 2005 .

[41]  Thomas J. Coates,et al.  Results of the NIMH Collaborative HIV/Sexually Transmitted Disease Prevention Trial of a Community Popular Opinion Leader Intervention , 2010, Journal of acquired immune deficiency syndromes.

[42]  Annette Boaz,et al.  Assessing the impact of research on policy: A review of the literature for a project on bridging research and policy through outcome evaluation , 2008 .

[43]  J. Higgins,et al.  Personal financial incentives for changing habitual health-related behaviors: A systematic review and meta-analysis , 2015, Preventive medicine.

[44]  Paul M. Kellstedt,et al.  The Fundamentals of Political Science Research , 2008 .

[45]  J. Puri,et al.  Examining the evidence on the effectiveness of India’s rural employment guarantee act. , 2017 .

[46]  R. Thornton,et al.  Scaling up male circumcision service provision: Results from a randomised evaluation in Malawi , 2014 .

[47]  The principles and practices of nutrition advocacy: evidence, experience and the way forward for stunting reduction. , 2013, Maternal & child nutrition.

[48]  Kaia Ambrose,et al.  Conceptual fusion of the logical framework approach and outcome mapping , 2009 .

[49]  Daniel Start and Ingie Hovland.  Tools for Policy Impact: A Handbook for Researchers , 2004 .

[50]  D. Green,et al.  The Effects of Voter ID Notification on Voter Turnout : Results from a Large-Scale Field Experiment , 2014 .

[51]  J. Chipps,et al.  The use of mobile phones to deliver acceptance and commitment therapy in the prevention of mother–child HIV transmission in Nigeria , 2015, Journal of telemedicine and telecare.

[52]  H. White,et al.  Quasi-Experimental Design and Methods , 2014 .

[53]  Sandra Mathison,et al.  Encyclopedia of Evaluation , 2004 .

[54]  Rasmus Brun Pedersen,et al.  Process-Tracing Methods: Foundations and Guidelines , 2013 .

[55]  P. Gertler,et al.  The Effect of India's Total Sanitation Campaign on Defecation Behaviors and Child Health in Rural Madhya Pradesh: A Cluster Randomized Controlled Trial , 2014, PLoS medicine.

[56]  J. Puri,et al.  Chapter 21 The Wicked Cases of Education and Climate Change-The Promise and Challenge of Theory-Based Impact Evaluations , 2017 .

[57]  Thomas Fujiwara,et al.  Can Informed Public Deliberation Overcome Clientelism? Experimental Evidence from Benin , 2013 .

[58]  Ahmed Ibrahim Fathelrahman,et al.  Impact of the New Malaysian Cigarette Pack Warnings on Smokers’ Awareness of Health Risks and Interest in Quitting Smoking , 2010, International journal of environmental research and public health.

[59]  E. Lindquist.  Discerning policy influence : framework for a strategic evaluation of IDRC - supported research , 2001 .

[60]  M. Humphreys,et al.  Policing politicians: Citizen empowerment and political accountability in Uganda -Preliminary analysis (IGC Working Paper) , 2013 .

[61]  Priyanka Pandey,et al.  Community Participation in Public Schools: The Impact of Information Campaigns in Three Indian States , 2008 .

[62]  I. Hovland,et al.  The PRSP Initiative: Multilateral Policy Change and the Role of Research , 2003 .

[63]  Eduardo Nuñez,et al.  From impact evaluations to paradigm shift: a case study of the Buenos Aires Ciudadanía Porteña conditional cash transfer programme , 2013 .

[64]  Frederico Finan,et al.  Exposing Corrupt Politicians: The Effects of Brazil's Publicly Released Audits on Electoral Outcomes , 2005 .

[65]  R. Rimal,et al.  Effects of a mass media intervention on HIV-related stigma: 'Radio Diaries' program in Malawi. , 2011, Health education research.

[66]  M. Petticrew,et al.  Alternatives to randomisation in the evaluation of public health interventions: design challenges and solutions , 2009, Journal of Epidemiology & Community Health.

[67]  Claudius Wagemann,et al.  Qualitative Comparative Analysis (QCA) , 2014 .

[68]  V. Fuster,et al.  Targeting preschool children to promote cardiovascular health: cluster randomized trial. , 2013, The American journal of medicine.

[69]  D. Green,et al.  Spanish-Language Radio Advertisements and Latino Voter Turnout in the 2006 Congressional Elections , 2011 .

[70]  Alan Hudson.  Advocacy by UK-Based Development NGOs , 2002 .

[71]  A. Kazemi,et al.  A randomized trial to promote health belief and to reduce environmental tobacco smoke exposure in pregnant women. , 2012, Health education research.

[72]  M. Frölich,et al.  HIV/AIDS Knowledge and behaviour: Have information campaigns reduced HIV infection? The case of Kenya , 2009 .

[73]  M. Scriven.  A Summative Evaluation of RCT Methodology: & An Alternative Approach to Causal Research , 2008, Journal of MultiDisciplinary Evaluation.

[74]  J. Reisman,et al.  A Guide to Measuring Advocacy and Policy , 2007 .

[75]  Philip Oreopoulos,et al.  Information and College Access: Evidence from a Randomized Field Experiment , 2012 .

[76]  Robert A C Ruiter,et al.  The effects of a systematically developed photo-novella on knowledge, attitudes, communication and behavioural intentions with respect to sexually transmitted infections among secondary school learners in South Africa. , 2005, Health promotion international.

[77]  Shari Krishnaratne,et al.  Quality education for all children? What works in education in developing countries , 2014 .

[78]  R. David,et al.  Learning for change: The art of assessing the impact of advocacy work , 2002 .

[79]  E. Paluck.  Reducing intergroup prejudice and conflict using the media: a field experiment in Rwanda. , 2009, Journal of personality and social psychology.

[80]  Quy-Toan Do,et al.  Handwashing Behavior Change at Scale: Evidence from a Randomized Evaluation in Vietnam , 2012 .

[81]  J. Whelan.  Advocacy Evaluation: Review and Opportunities , 2009 .

[82]  John Young,et al.  Monitoring and evaluation of policy influence and advocacy , 2014 .

[83]  D. Meekers,et al.  Estimating Causal Effects from Family Planning Health Communication Campaigns Using Panel Data: The “Your Health, Your Wealth” Campaign in Egypt , 2012, PloS one.

[84]  Barney Cohen,et al.  Behavioral Health Interventions: What Works and Why? , 2004 .

[85]  Jonathan Stacks,et al.  Developmental Evaluation , 2011, Health promotion practice.

[86]  Debates: The Impact of Voter Knowlegde Initiaties in Sierra Leone , 2015 .

[87]  Julian C. Jamison,et al.  Mixed Method Evaluation of a Passive Mhealth Sexual Information Texting Service in Uganda , 2013 .

[88]  Jeffrey T. Checkel.  Tracing Causal Mechanisms , 2006 .

[89]  Tigran Nikoghosyan,et al.  United Nations Children’s Fund (UNICEF) , 2018, Yearbook of International Cooperation on Environment and Development 1998–99.

[90]  A. Banerjee,et al.  An impact evaluation of information disclosure on elected representatives’ performance: Evidence from rural and urban India , 2015 .

[91]  Yashodhan Ghorpade,et al.  What Methods May Be Used in Impact Evaluations of Humanitarian Assistance? , 2014, SSRN Electronic Journal.

[92]  Andrew Bennett,et al.  Process tracing : from metaphor to analytic tool , 2014 .

[93]  Gabrielle Durepos,et al.  Encyclopedia of case study research , 2010 .

[94]  Eric W. Djimeu,et al.  Power calculation for causal inference in social science: sample size and minimum detectable effect determination , 2016 .

[95]  Christopher W. Larimer,et al.  Social Pressure and Voter Turnout: Evidence from a Large-Scale Field Experiment , 2008, American Political Science Review.

[96]  Karl E. Weick,et al.  Utilization-focused evaluation. , 1979 .

[97]  Emir Kamenica,et al.  Information and Subsidies: Complements or Substitutes? , 2013 .

[98]  Howard White,et al.  Quasi-Experimental Design and Methods: Methodological Briefs - Impact Evaluation No. 8 , 2014 .

[99]  Bradley Shrimpton,et al.  Contribution analysis , 2007 .

[100]  D. Meekers,et al.  BMC Public Health BioMed Central , 2005 .

[101]  R. Pande.  Can Informed Voters Enforce Better Governance? Experiments in Low-Income Democracies , 2011 .

[102]  Karl Hughes,et al.  Can we obtain the required rigour without randomisation ? Oxfam GB ’ s non-experimental Global Performance Framework , 2011 .

[103]  S. Teles,et al.  The Elusive Craft of Evaluating Advocacy , 2011 .

[104]  S. Rozelle,et al.  Conducting influential impact evaluations in China: the experience of the Rural Education Action Project , 2011 .

[105]  D. Kahneman,et al.  Anomalies: The Endowment Effect, Loss Aversion, and Status Quo Bias , 1991 .

[106]  Lori S. Bennear,et al.  Impact of a Randomized Controlled Trial in Arsenic Risk Communication on Household Water-Source Choices in Bangladesh. , 2013, Journal of environmental economics and management.

[107]  S. Kalichman,et al.  Randomized Trial of a Community-based Alcohol-related HIV Risk-reduction Intervention for Men and Women in Cape Town South Africa , 2008, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[108]  Jessica Dart,et al.  A Dialogical, Story-Based Evaluation Tool: The Most Significant Change Technique , 2003 .

[109]  Purnima Menon,et al.  The politics of reducing malnutrition: building commitment and accelerating progress , 2013, The Lancet.

[110]  Scott Rozelle,et al.  Effectiveness of provider incentives for anaemia reduction in rural China: a cluster randomised trial , 2012, BMJ : British Medical Journal.

[111]  John Mayne,et al.  Contribution analysis: An approach to exploring cause and effect , 2008 .

[112]  H. Murtomaa,et al.  School-based education to improve oral cleanliness and gingival health in adolescents in Tehran, Iran. , 2009, International journal of paediatric dentistry.

[113]  Gala Díaz Langou,et al.  Sound expectations: from impact evaluations to policy change , 2012 .

[114]  Kelika A. Konda,et al.  Effect of a Community Popular Opinion Leader HIV/STI Intervention on Stigma in Urban, Coastal Peru , 2010, AIDS and Behavior.

[115]  B. Befani,et al.  Process Tracing and Contribution Analysis: A Combined Approach to Generative Causal Inference for Impact Evaluation , 2014 .

[116]  M. Raab,et al.  Review of evaluation approaches and methods for interventions related to violence against women and girls (VAWG) , 2014 .

[117]  Do Phone Calls Increase Voter Turnout? An Update , 2005 .

[118]  M. Patton.  Advocacy Impact Evaluation , 2008, Journal of MultiDisciplinary Evaluation.

[119]  A. George,et al.  Case Studies and Theory Development in the Social Sciences , 2005 .

[120]  Gala Díaz Langou.  Validating one of the world’s largest conditional cash transfer programmes. A case study on how an impact evaluation of Brazil’s Bolsa Família Programme helped silence its critics and improve policy , 2013 .

[121]  Darinka Vásquez Jordán,et al.  After Action Review , 2012 .

[122]  J. Mill.  A system of logic, ratiocinative and inductive : being a connected view of the principles of evidence, and the methods of scientific investigation. , 2011 .

[123]  M. Kremer,et al.  The Two-Margin Problem in Insurance Markets , 2004, Review of Economics and Statistics.

[124]  M. McConnell.  Between Intention and Action: An Experiment on Individual Savings , 2012 .

[125]  R. Thornton,et al.  Responding to Risk: Circumcision, Information, and HIV Prevention , 2016, Review of Economics and Statistics.

[126]  Abhijit Banerjee,et al.  Do Informed Voters Make Better Choices? Experimental Evidence from Urban India , 2010 .

[127]  Julia Coffman,et al.  LESSONS IN EVALUATING COMMUNICATIONS CAMPAIGNS FIVE CASE STUDIES , 2003 .

[128]  K. Gans,et al.  Two-year effects of a school-based prevention programme on adolescent cigarette smoking in Guangzhou, China: a cluster randomized trial. , 2010, International journal of epidemiology.