Assessing the performance of targeting mechanisms

A policy intervention entails a distribution of social resources to a target population in order to solve a particular problem they face. In that context, targeting is designed to assign treatment according to some eligibility criterion. While effective targeting is not an end in itself, it is central to both fairness and cost-effectiveness in policymaking. Decision makers and other stakeholders would therefore like to know the extent to which targeting respects eligibility. Answering this key question is essentially an exercise in associational inference. This paper proposes an evaluative framework for assessing targeting outcomes. The framework focuses on measuring, judging and explaining targeting performance. Among indicators of performance considered, the conditional probability of assignment emerges as a local measure which is more informative than global indicators. The paper advocates for the use of chance-corrected measures of interobserver agreement to judge the extent of agreement between assignment mechanisms, and demonstrates the use of bivariate probit regression analysis to identify proximate determinants of targeting outcomes. The proposed framework is applied to the evaluation of the targeting of cash transfers in the context of the Social Safety Nets Pilot Project (SSNPP) in Northern Cameroon.

[1]  Laura B. Rawlings,et al.  Impact Evaluation in Practice, Second Edition , 2016 .

[2]  Joy A. Frechtling Logic Modeling Methods in Program Evaluation , 2007 .

[3]  D. Hand,et al.  The Wellbeing of Nations: Meaning, Motive and Measurement , 2014 .

[4]  E. Skoufias,et al.  An evaluation of the selection of beneficiary households in the education , 1999 .

[5]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[6]  Martin Ravallion,et al.  Evaluating three stylised interventions , 2009 .

[7]  B. Mills,et al.  Reaching the Poor: Cash Transfer Program Targeting in Cameroon , 2016 .

[8]  L. Cameron An Analysis of the Role of Social Safety Net Scholarships in Reducing School Drop-Out During the Indonesian Economic Crisis , 2000 .

[9]  Angus Deaton Rice Prices and Income Distribution in Thailand: A Non-parametric Analysis , 1989 .

[10]  Nobuo Yoshida,et al.  Targeting the Poorest: An assessment of the proxy means test methodology , 2011 .

[11]  B. Mills,et al.  Generating a System for Targeting Unconditional Cash Transfers in Cameroon , 2015 .

[12]  Sohan Kumar Karna,et al.  Analyzing Health Equity Using Household Survey Data: A Guide to Techniques and Their Implementation , 2009 .

[13]  Caitlin Brown,et al.  Smart Hedging against Carbon Leakage , 2015, Economic Policy.

[14]  M. Ravallion How Relevant is Targeting to the Success of an Antipoverty Program? , 2007 .

[15]  W. Greene,et al.  计量经济分析 = Econometric analysis , 2009 .

[16]  Alan C. Acock,et al.  A Gentle Introduction to Stata , 2005 .

[17]  R. Sabates‐Wheeler,et al.  Targeting Social Transfer Programmes: Comparing Design and Implementation Errors Across Alternative Mechanisms , 2014 .

[18]  F. Soares,et al.  Targeting effectiveness of social cash transfer programmes in three African countries , 2012 .

[19]  Ibrahim Ahamada,et al.  Non-Parametric Econometrics , 2011 .

[20]  John Hoddinott,et al.  Targeting outcomes redux , 2004 .

[21]  R. Sabates‐Wheeler,et al.  The targeting effectiveness of social transfers , 2017 .

[22]  David P. Coady,et al.  Targeting of Transfers in Developing Countries: Review of Lessons and Experience , 2004 .

[23]  C. Ninno,et al.  For Protection and Promotion: The Design and Implementation of Effective Safety Nets , 2008 .

[24]  A. Sen,et al.  The Political Economy of Targeting , 2006 .

[25]  A. Viera,et al.  Understanding interobserver agreement: the kappa statistic. , 2005, Family medicine.

[26]  J. Pearl Causal inference in statistics: An overview , 2009 .

[27]  J. Kmenta Mostly Harmless Econometrics: An Empiricist's Companion , 2010 .

[28]  H. Peyton Young,et al.  Equity - in theory and practice , 1994 .