Measuring the Sensitivity of Parameter Estimates to Estimation Moments

We propose a local measure of the relationship between parameter estimates and the moments of the data they depend on. Our measure can be computed at negligible cost even for complex structural models. We argue that reporting this measure can increase the transparency of structural estimates, making it easier for readers to predict the way violations of identifying assumptions would affect the results. When the key assumptions are orthogonality between error terms and excluded instruments, we show that our measure provides a natural extension of the omitted variables bias formula for nonlinear models. We illustrate with applications to published articles in several fields of economics.

[1]  Peter E. Rossi,et al.  Plausibly Exogenous , 2008, Review of Economics and Statistics.

[2]  J. List,et al.  Testing for Altruism and Social Pressure in Charitable Giving , 2009, The quarterly journal of economics.

[3]  J. List,et al.  Toward an Understanding of Learning by Doing: Evidence from an Automobile Assembly Plant , 2013, Journal of Political Economy.

[4]  Aviv Nevo.  Mergers with differentiated products: the case of the ready-to-eat cereal industry , 2000 .

[5]  Lawrence J. Christiano,et al.  Nominal Rigidities and the Dynamic Effects of a Shock to Monetary Policy , 2001, Journal of Political Economy.

[6]  A. Gelman.  Scaling regression inputs by dividing by two standard deviations , 2008, Statistics in medicine.

[7]  Edward E. Leamer,et al.  Let's Take the Con Out of Econometrics , 1983 .

[8]  Boris Nikolov,et al.  Agency Conflicts and Cash: Estimates from a Dynamic Model , 2014 .

[9]  J. Bring.  How to Standardize Regression Coefficients , 1994 .

[10]  Ulrich K. Müller.  Measuring prior sensitivity and prior informativeness in large Bayesian models , 2012 .

[11]  Aviv Nevo,et al.  Identification With Imperfect Instruments , 2008, Review of Economics and Statistics.

[12]  Michaela Draganska,et al.  Beyond plain vanilla: Modeling joint product assortment and pricing decisions , 2008 .

[13]  Jae-on Kim,et al.  Standardization in Causal Analysis , 1981 .

[14]  Andrew Gelman,et al.  Why High-Order Polynomials Should Not Be Used in Regression Discontinuity Designs , 2014 .

[15]  J. Parker,et al.  Consumption Over the Life Cycle , 1999 .

[16]  Steven T. Berry,et al.  Automobile Prices in Market Equilibrium , 1995 .

[17]  Rosa L. Matzkin.  Nonparametric Identification in Structural Economic Models , 2013 .

[18]  Alessandra Voena.  Yours , Mine and Ours : Do Divorce Laws Affect the Intertemporal Behavior of Married Couples ? ∗ , 2010 .

[19]  Joshua D. Angrist,et al.  The Credibility Revolution in Empirical Economics: How Better Research Design is Taking the Con Out of Econometrics , 2010, SSRN Electronic Journal.

[20]  Anthony A. Smith,et al.  Estimating Nonlinear Time-Series Models Using Simulated Vector Autoregressions , 1993 .

[21]  Mehmet Caner,et al.  Are 'Nearly Exogenous' Instruments Reliable? , 2006 .

[22]  Amil Petrin.  Quantifying the Benefits of New Products: The Case of the Minivan , 2001, Journal of Political Economy.

[23]  A. V. D. Vaart,et al.  Asymptotic Statistics: Frontmatter , 1998 .

[24]  Gregory S. Crawford,et al.  The Welfare Effects of Bundling in Multichannel Television Markets , 2012 .

[25]  James J Heckman,et al.  Building Bridges between Structural and Program Evaluation Approaches to Evaluating Policy , 2010, Journal of economic literature.

[26]  Steven Berry,et al.  Differentiated Products Demand Systems from a Combination of Micro and Macro Data: The New Car Market , 1998, Journal of Political Economy.

[27]  Patrik Guggenberger.  ON THE ASYMPTOTIC SIZE DISTORTION OF TESTS WHEN INSTRUMENTS LOCALLY VIOLATE THE EXOGENEITY ASSUMPTION , 2011, Econometric Theory.

[28]  M. Keane.  Structural vs. atheoretic approaches to econometrics , 2010 .

[29]  Matthew Gentzkow,et al.  Competition and Ideological Diversity: Historical Evidence from Us Newspapers , 2012 .

[30]  Mark Aguiar,et al.  Lifecycle Prices and Production , 2005 .

[31]  G. Kaplan,et al.  Moving Back Home: Insurance Against Labor Market Risk1 , 2008 .

[32]  Y. Kitamura,et al.  Robustness, Infinitesimal Neighborhoods, and Moment Restrictions , 2009 .

[33]  Lawrence J. Christiano,et al.  Nominal Rigidities and the Dynamic Effects of a Shock to Monetary Policy , 2005 .

[34]  Boris Nikolov,et al.  Agency Conflicts and Cash: Estimates from a Dynamic Model , 2013 .

[35]  Ilya M. Sobol,et al.  Sensitivity Estimates for Nonlinear Mathematical Models , 1993 .

[36]  Christopher R. Taber,et al.  An Evaluation of Instrumental Variable Strategies for Estimating the Effects of Catholic Schooling , 2002, The Journal of Human Resources.

[37]  W. Newey,et al.  Large sample estimation and hypothesis testing , 1986 .

[38]  Steven Berry,et al.  Voluntary Export Restraints on Automobiles: Evaluating a Trade Policy , 1999 .

[39]  Paul Schrimpf,et al.  THE RESPONSE OF DRUG EXPENDITURE TO NON-LINEAR CONTRACT DESIGN: EVIDENCE FROM MEDICARE PART D. , 2015, The quarterly journal of economics.

[40]  Saltelli Andrea,et al.  Global Sensitivity Analysis: The Primer , 2008 .

[41]  Ying Fan.  Ownership Consolidation and Product Characteristics: A Study of the US Daily Newspaper Market , 2013 .

[42]  N. Hjort,et al.  Model Uncertainty First, Not Afterwards , 2016 .

[43]  Brett R. Gordon,et al.  Does AMD Spur Intel to Innovate More? , 2011, Journal of Political Economy.

[44]  David Berger,et al.  Consumption Dynamics During Recessions , 2014 .

[45]  B. Salani'e,et al.  Higher-order properties of approximate estimators , 2013 .

[46]  Mark Aguiar,et al.  Deconstructing Life Cycle Expenditure , 2013, Journal of Political Economy.

[47]  W. Newey,et al.  Generalized method of moments specification testing , 1985 .