The Case for Randomized Field Trials in Economic and Policy Research

Social experiments have been used in research since the 1960s, yet the technique of controlled experimentation still arouses controversy among social scientists. The crucial element that distinguishes a controlled experiment from other forms of research is random assignment of treatment to the observational units of study. Because treatment differences in the sample occur as a result of random chance, the effects of the treatment on behavior can be measured with high reliability. This paper examines the advantages and disadvantages of experiments in comparison with other research techniques and describes the circumstances where randomized trials should be preferred over other methods.

[1]  James J. Heckman,et al.  Longitudinal Analysis of Labor Market Data , 1985 .

[2]  E B Keeler,et al.  Does free care improve adults' health? Results from a randomized controlled trial. , 1983, The New England journal of medicine.

[3]  Rory A. Fisher,et al.  Statistical Methods for Research Workers. , 1927 .

[4]  J. Heckman.  The Common Structure of Statistical Models of Truncation, Sample Selection and Limited Dependent Variables and a Simple Estimator for Such Models , 1976 .

[5]  E. Keeler,et al.  Health insurance and the demand for medical care: evidence from a randomized experiment. , 1987, The American economic review.

[6]  James J. Heckman,et al.  Randomization and Social Policy Evaluation , 1991 .

[7]  William R. Shadish,et al.  Evaluation studies : review annual , 1976 .

[8]  J. Hausman,et al.  The Effect of Taxation on Labor Supply: Evaluating the Gary Negative Income Tax Experiment , 1978, Journal of Political Economy.

[9]  B. Berry,et al.  : Housing Vouchers for the Poor: Lessons from a National Experiment , 1982 .

[10]  Gary Burtless,et al.  Are Targeted Wage Subsidies Harmful? Evidence from a Wage Voucher Experiment , 1985 .

[11]  Burt S. Barnow,et al.  The Impact of CETA Programs on Earnings: A Review of the Literature , 1987 .

[12]  Julian Le Grand,et al.  Alicia H. Munnell, ed. Lessons from the Income Maintenance Experiments. Boston: Federal Reserve Bank of Boston Conference Series Number 30 , 1988, Journal of Public Policy.

[13]  D. Aigner,et al.  The Residential Electricity Time-of-Use Pricing Experiments: What Have We Learned? , 1985 .

[14]  Alice M. Rivlin,et al.  How Can Experiments Be More Useful , 1974 .

[15]  Capron,et al.  Ethical And Legal Issues Of Social Experimentation , 1975 .

[16]  M. C. Keeley,et al.  The Estimation of Labor Supply Models Using Experimental Data , 1978 .

[17]  Howard S. Bloom,et al.  The National JTPA Study: Title II-A Impacts on Earnings and Employment at 18 Months. Executive Summary. , 1992 .

[18]  D. Campbell,et al.  EXPERIMENTAL AND QUASI-EXPERIMENT Al DESIGNS FOR RESEARCH , 2012 .

[19]  Lung-fei Lee,et al.  Recursive Models with Qualitative Endogenous Variables , 1976 .

[20]  Orley Ashenfelter,et al.  Using the Longitudinal Structure of Earnings to Estimate the Effect of Training Programs , 1984 .

[21]  Charles F. Manski,et al.  Evaluating Welfare and Training Programs. , 1994 .

[22]  J. Heckman,et al.  Longitudinal Analysis of Labor Market Data: Alternative methods for evaluating the impact of interventions , 1985 .

[23]  Charles F. Manski,et al.  Micro Experimenst and Macro Effects , 1992 .

[24]  Gary Burtless,et al.  Are Classical Experiments Needed for Manpower Policy , 1986 .

[25]  James J. Heckman,et al.  Choosing Among Alternative Nonexperimental Methods for Estimating the Impact of Social Programs: the Case of Manpower Training , 1989 .

[26]  Rebecca A. Maynard,et al.  The Adequacy of Comparison Group Designs for Evaluations of Employment-Related Programs , 1987 .

[27]  Edward E. Leamer,et al.  Let's Take the Con Out of Econometrics , 1983 .

[28]  R. Lalonde.  Evaluating the Econometric Evaluations of Training Programs with Experimental Data , 1984 .

[29]  Anthony Downs,et al.  Do housing allowances work , 1982 .

[30]  Clarence N. Stone,et al.  Housing vouchers for the poor : lessons from a national experiment , 1982 .

[31]  Edward Pauly,et al.  From Welfare to Work. , 1993 .

[32]  M. Kendall.  Statistical Methods for Research Workers , 1937, Nature.

[33]  Douglas W. Caves,et al.  Econometric analysis of residential time-of-use electricity pricing experiments , 1980 .