Validating Benefit and Cost Estimates: The Case of Airbag Regulation

Preregulation estimates of benefits and costs are rarely validated after regulations are implemented. This article performs such a validation for the mandatory automobile airbag requirement. We found that the original 1984 model used to estimate benefits became invalid when 1997 values were input into that 1984 model. However, using a published 1997 cost‐effectiveness model, we demonstrate, by replacing the model inputs with the values from 1984, that the 1997 cost‐effectiveness ratios, based on real‐world crash data and tear‐down cost data, are less attractive than what would have been originally anticipated. The three most important errors in the 1984 input values are identified: the overestimation of airbag effectiveness, the overestimation of baseline fatality/injury rates, and the underestimation of manual safety belt use. This case study, which suggests that airbags are a reasonable investment in safety, shows that the regulatory analysis tools do not always produce findings that are biased against health, safety, and environmental regulation. Future validation studies of health, safety, and environmental regulation should focus on validation of benefit and risk estimates, areas where we found significant error, as well as on cost estimates.

[1]  J. Newhouse,et al.  Medical care costs: how much welfare loss? , 1992, The journal of economic perspectives : a journal of the American Economic Association.

[2]  L Evans,et al.  Double pair comparison--a new method to determine how occupant characteristics affect fatality risk in traffic crashes. , 1986, Accident; analysis and prevention.

[3]  B. F. Bohan Auto Safety: Assessing America's Performance , 1989 .

[4]  C J Kahane,et al.  FATALITY REDUCTION BY AIR BAGS: ANALYSES OF ACCIDENT DATA THROUGH EARLY 1996. NHTSA TECHNICAL REPORT , 1996 .

[5]  S. Campbell,et al.  A prospective, observational study of a chest pain observation unit in a British hospital , 2002, Emergency medicine journal : EMJ.

[6]  N. Binkin,et al.  The High Cost and Low Efficacy of Weekly Viral Cultures for Pregnant Women with Recurrent Genital Herpes , 1989, Medical decision making : an international journal of the Society for Medical Decision Making.

[7]  S. Lloyd Stratospheric ozone depletion , 1993, The Lancet.

[8]  J. Graham,et al.  Reducing Risks to Children in Vehicles With Passenger Airbags , 1998, Pediatrics.

[9]  L J Blincoe,et al.  The economic cost of motor vehicle crashes, 1990 , 1992 .

[10]  M. Gold Cost-effectiveness in health and medicine , 2016 .

[11]  J. Graham Injuries from traffic crashes: meeting the challenge. , 1993, Annual review of public health.

[12]  John D. Graham,et al.  Validating analytical judgments: the case of the airbag's lifesaving effectiveness , 1999 .

[13]  A. Lund,et al.  Reductions in deaths in frontal crashes among right front passengers in vehicles equipped with passenger air bags. , 1997, JAMA.

[14]  A. Hinman,et al.  Pertussis and pertussis vaccine: further analysis of benefits, risks and costs. , 1985, Developments in biological standardization.

[15]  B. Clinton,et al.  Executive Order 12866: Regulatory Planning and Review , 1993 .

[16]  Winston Harrington,et al.  On the Accuracy of Regulatory Cost Estimates , 2000 .

[17]  S. Tolchin,et al.  Dismantling America: The Rush to Deregulate , 1984 .

[18]  John D. Graham,et al.  Going beyond the single number: Using probabilistic risk assessment to improve risk management , 1996 .

[19]  Robert N. Stavins,et al.  What Can We Learn from the Grand Policy Experiment? Lessons from SO2 Allowance Trading , 1998 .

[20]  H. Grabowski,et al.  Auto Safety Regulation: An Analysis of Market Failure , 1981 .

[21]  Richard D. Morgenstern,et al.  Economic Analyses at EPA: Assessing Regulatory Impact , 1997 .

[22]  Robert W. Hahn,et al.  Assessing the Quality of Regulatory Impact Analyses , 2000 .

[23]  L Evans,et al.  The effectiveness of safety belts in preventing fatalities. , 1986, Accident; analysis and prevention.

[24]  M. Weinstein,et al.  The cost-effectiveness of air bags by seating position. , 1997, JAMA.

[25]  M. Weinstein,et al.  Evaluating the cost-effectiveness of clinical and public health measures. , 1998, Annual review of public health.

[26]  Stephen Luchter,et al.  The economic costs to society of motor vehicle accidents , 1983 .

[27]  W. Viscusi,et al.  Rational Risk Policy , 1998 .

[28]  S. Hadden The Dilemma of Toxic Substance Regulation: How Overregulation Causes Underregulation , 1988 .

[29]  John D. Graham,et al.  A Probabilistic Analysis of the Passive–Restraint Question , 1984 .