Natural and Quasi- Experiments in Economics

Using research designs patterned after randomized experiments, many recent economic studies examine outcome measures for treatment groups and comparison groups that are not randomly assigned. By using variation in explanatory variables generated by changes in state laws, government draft mechanisms, or other means, these studies obtain variation that is readily examined and is plausibly exogenous. This paper describes the advantages of these studies and suggests how they can be improved. It also provides aids in judging the validity of inferences they draw. Design complications such as multiple treatment and comparison groups and multiple pre- or post-intervention observations are advocated.

[1]  Needed Research on the Mediation of Labor Disputes , 1952 .

[2]  D. Campbell.  Factors relevant to the validity of experiments in social settings. , 1957, Psychological bulletin.

[3]  L. Julián.  THE PRICE ELASTICITY OF LIQUOR IN THE U.S. AND A SIMPLE METHOD OF DETERMINATION , 1966 .

[4]  D. Campbell.  Reforms as experiments , 1969 .

[5]  Barbara A. Bailar,et al.  The Effects of Rotation Group Bias on Estimates from Panel Surveys , 1975 .

[6]  O. Ashenfelter,et al.  Estimating the Effect of Training Programs on Earnings , 1976 .

[7]  Donald B. Rubin,et al.  Bayesian Inference for Causal Effects: The Role of Randomization , 1978 .

[8]  Jerry A. Hausman,et al.  Attrition Bias in Experimental and Panel Data: The Gary Income Maintenance Experiment , 1979 .

[9]  T. Cook,et al.  Quasi-experimentation: Design & analysis issues for field settings , 1979 .

[10]  Paul Hudson.  Studies in the Economics of Search , 1979 .

[11]  M R Rosenzweig,et al.  Testing the quantity-quality fertility model: the use of twins as a natural experiment. , 1980, Econometrica : journal of the Econometric Society.

[12]  P. Cook,et al.  The Effect of Liquor Taxes on Heavy Drinking , 1982 .

[13]  Orley Ashenfelter,et al.  Using the Longitudinal Structure of Earnings to Estimate the Effect of Training Programs , 1984 .

[14]  Gary Solon,et al.  Work Incentive Effects of Taxing Unemployment Benefits , 1985 .

[15]  J. Heckman,et al.  Longitudinal Analysis of Labor Market Data: Alternative methods for evaluating the impact of interventions , 1985 .

[16]  [The Role of a Second Control Group in an Observational Study]: Comment: The Use of Multiple Control Groups in Designed Experiments , 1987 .

[17]  P. Rosenbaum.  The Role of a Second Control Group in an Observational Study , 1987 .

[18]  Bruce D. Meyer.  Unemployment Insurance and Unemployment Spells , 1988 .

[19]  A. Pakes,et al.  Empirical Implications of Alternative Models of Firm Dynamics , 1989 .

[20]  C. Manski.  Anatomy of the Selection Problem , 1989 .

[21]  David Card.  The Impact of the Mariel Boatlift on the Miami Labor Market , 1989 .

[22]  Bruce D. Meyer.  A Quasi-Experimental Approach to the Effects of Unemployment Insurance , 1989 .

[23]  James C. Cox,et al.  Unemployment Insurance and Job Search , 1990 .

[24]  Controlled Experiments and the Unemployment Insurance System , 1990 .

[25]  A. Krueger,et al.  Workers' Compensation Insurance and the Duration of Workplace Injuries , 1990 .

[26]  Joshua D. Angrist,et al.  Lifetime Earnings and the Vietnam Era Draft Lottery: Evidence from Social Security Administrative Records , 1990 .

[27]  J. Angrist,et al.  Does Compulsory School Attendance Affect Schooling and Earnings? , 1990 .

[28]  T. Cook.  Chapter V: Clarifying the Warrant for Generalized Causal Inferences in Quasi-Experimentation , 1991, Teachers College Record: The Voice of Scholarship in Education.

[29]  J. Hunt,et al.  The Impact of the 1962 Repatriates from Algeria on the French Labor Market , 1992 .

[30]  Lawrence F. Katz,et al.  The Effect of the Minimum Wage on the Fast-Food Industry , 1992 .

[31]  G. Kalton,et al.  The Future of the Survey of Income and Program Participation: Panel to Evaluate the Survey of Income and Program Participation , 1992 .

[32]  David Card,et al.  Using Regional Variation in Wages to Measure the Effects of the Federal Minimum Wage , 1992 .

[33]  J. Grogger,et al.  The socioeconomic consequences of teenage childbearing: findings from a natural experiment. , 1993, Family planning perspectives.

[34]  Brigitte C. Madrian.  Employment-Based Health Insurance and Job Mobility: Is There Evidence of Job-Lock? , 1993 .

[35]  David Card,et al.  Minimum Wages and Employment: A Case Study of the Fast Food Industry in New Jersey and Pennsylvania , 1993 .

[36]  R. Glenn Hubbard,et al.  A Reconsideration of Investment Behavior Using Tax Reforms as Natural Experiments , 1994 .

[37]  A. Case,et al.  Unnatural Experiments? Estimating the Incidence of Endogenous Policies , 1994 .

[38]  W. Shadish,et al.  Social Experiments: Some Developments over the Past Fifteen Years , 1994 .

[39]  Bruce D. Meyer,et al.  "Unemployment Insurance Benefits and Takeup Rates" , 1994 .

[40]  Joshua Angrist,et al.  Why Do World War II Veterans Earn More than Nonveterans? , 1989, Journal of Labor Economics.

[41]  William P. Curington.  Compensation for Permanent Impairment and the Duration of Work Absence Evidence from Four Natural Experiments , 1994 .

[42]  J. Gruber.  The incidence of mandated maternity benefits. , 1994, The American economic review.

[43]  J. Currie,et al.  Saving Babies: The Efficacy and Cost of Recent Expansions of Medicaid Eligibility for Pregnant Women , 1994 .

[44]  Nada O. Eissa.  Taxation and Labor Supply of Married Women: The Tax Reform Act of 1986 as a Natural Experiment , 1995 .

[45]  Bruce D. Meyer,et al.  Workers' compensation and injury duration: evidence from a natural experiment. , 1995, The American economic review.

[46]  Charles F. Manski,et al.  Learning About Social Programs from Experiments with Random Assignment of Treatments , 1995 .

[47]  Aaron Yelowitz,et al.  Institute for Research on Poverty Discussion Paper no. 1084-96 The Medicaid Notch, Labor Supply, and Welfare Participation: Evidence from Eligibility Expansions , 1996 .

[48]  G. Imbens,et al.  Evaluating the Cost of Conscription in The Netherlands , 1995 .

[49]  Bruce D. Meyer.  Lessons from the U.S. Unemployment Insurance Experiments , 1995 .

[50]  M. Hanratty.  Canadian National Health Insurance and Infant Health , 1996 .

[51]  Owen A. Lamont.  Cash Flow and Investment: Evidence from Internal Capital Markets , 1996 .