Adaptive Experimental Design Using the Propensity Score

Many social experiments are run in multiple waves or replicate earlier social experiments. In principle, the sampling design can be modified in later stages or replications to allow for more efficient estimation of causal effects. We consider the design of a two-stage experiment for estimating an average treatment effect when covariate information is available for experimental subjects. We use data from the first stage to choose a conditional treatment assignment rule for units in the second stage of the experiment. This amounts to choosing the propensity score, the conditional probability of treatment given covariates. We propose to select the propensity score to minimize the asymptotic variance bound for estimating the average treatment effect. Our procedure can be implemented simply using standard statistical software and has attractive large-sample properties.

[1]  Todd C. Neumann,et al.  Learning But Not Earning? The Value of Job Corps Training for Hispanics , 2005, SSRN Electronic Journal.

[2]  D. Karlan,et al.  Credit Elasticities in Less-Developed Economies: Implications for Microfinance , 2007 .

[3]  G. Imbens,et al.  Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score , 2000 .

[4]  J. Hahn On the Role of the Propensity Score in Efficient Semiparametric Estimation of Average Treatment Effects , 1998 .

[5]  P. Gertler,et al.  Investing Cash Transfers to Raise Long Term Living Standards , 2006 .

[6]  W. Newey,et al.  Large sample estimation and hypothesis testing , 1986 .

[7]  Dean S. Karlan,et al.  Does Price Matter in Charitable Giving? Evidence from a Large-Scale Natural Field Experiment , 2006 .

[8]  G. Chamberlain Asymptotic efficiency in semi-parametric models with censoring , 1986 .

[9]  Charles F. Manski,et al.  Designing Programs for Heterogeneous Populations: The Value of Covariate Information , 2001 .

[10]  Joshua D. Angrist,et al.  Identification of Causal Effects Using Instrumental Variables , 1993 .

[11]  P. V. Sukhatme Contribution to the Theory of the Representative Method , 1935 .

[12]  D. Rubin,et al.  The central role of the propensity score in observational studies for causal effects , 1983 .

[13]  D. Green,et al.  Get Out the Vote!: How to Increase Voter Turnout , 2004 .

[14]  J. Angrist,et al.  Identification and Estimation of Local Average Treatment Effects , 1995 .

[15]  J. Angrist,et al.  Identification and Estimation of Local Average Treatment Effects , 1994 .

[16]  K. Chaloner,et al.  Bayesian Experimental Design: A Review , 1995 .

[17]  Charles F. Manski,et al.  Alternative Estimators and Sample Designs for Discrete Choice Analysis , 1981 .

[18]  J. Neyman On the Two Different Aspects of the Representative Method: the Method of Stratified Sampling and the Method of Purposive Selection , 1934 .

[19]  Herbert Solomon,et al.  Optimal Design of Sampling from Finite Populations: A Critical Review and Indication of New Research Areas , 1970 .

[20]  John N. Tsitsiklis,et al.  Dynamic Catalog Mailing Policies , 2006, Manag. Sci..