Addressing unobserved endogeneity bias in accounting studies: control and sensitivity methods by variable type

Together with their associated statistical routines, this paper describes the control and sensitivity methods that can be employed by accounting researchers to address the important issue of unobserved (omitted) variable bias in regression and matching models according to the types of variables employed. As with other social science disciplines, an important and pervasive issue in observational (non-experimental) accounting research is omitted variable bias (endogeneity). Causal inferences for endogenous explanatory variables are biased. This occurs in regression models where an unobserved (confounding) variable is correlated with both the dependent (outcome) variable in a regression model and the causal explanatory (often a selection) variable of interest. The Heckman treatment effect model has been widely employed to control for hidden bias for continuous outcomes and endogenous binary selection variables. However, in accounting studies, limited (categorical) dependent variables are a common feature and endogenous explanatory variables may be other than binary in nature. The purpose of this paper is to provide an overview of contemporary control methods, together with the statistical routines to implement them, which extend the Heckman approach to binary, multinomial, ordinal, count and percentile outcomes and to where endogenous variables take various forms. These contemporary methods aim to improve causal estimates by controlling for hidden bias, though at the price of increased complexity. A simpler approach is to conduct sensitivity analysis. This paper also presents a synopsis of a number of sensitivity techniques and their associated statistical routines which accounting researchers can employ routinely to appraise the vulnerability of causal effects to potential (simulated) unobserved bias when estimated with conventional regression and propensity score matching estimators.

[1]  Sander Greenland,et al.  A Procedure to Tabulate and Plot Results after Flexible Modeling of a Quantitative Covariate , 2011 .

[2]  Marcin T. Kacperczyk,et al.  Do Non-Financial Stakeholders Affect the Pricing of Risky Debt? Evidence from Unionized Workers , 2010 .

[3]  P. Rosenbaum Discussing hidden bias in observational studies. , 1991, Annals of internal medicine.

[4]  Shaomin Li,et al.  The Impact of Order and Mode of Market Entry on Profitability and Market Share , 1999 .

[5]  Emmanuel Flachaire,et al.  Bootstrapping heteroskedastic regression models: wild bootstrap vs. pairs bootstrap , 2005, Comput. Stat. Data Anal..

[6]  The Impact of Subsidized Health Insurance on the Poor in Colombia: Evaluating the Case of Medellín , 2011 .

[7]  C. Meyerhoefer,et al.  The Medical Care Costs of Obesity: an Instrumental Variables Approach , 2010, Journal of health economics.

[8]  Stephen G. Dimmock,et al.  Loss-Aversion and Household Portfolio Choice , 2009 .

[9]  Anwer S. Ahmed,et al.  The Role of Accounting Conservatism in Mitigating Bondholder-Shareholder Conflicts over Dividend Policy and in Reducing Debt Costs , 2002 .

[10]  Kenneth W. Shaw CEO incentives and the cost of debt , 2012 .

[11]  MTREATREG: Stata module to fits models with multinomial treatments and continuous, count and binary outcomes using maximum simulated likelihood , 2009 .

[12]  M. Peel,et al.  Differential Audit Quality, Propensity Score Matching and Rosenbaum Bounds for Confounding Variables , 2012 .

[13]  James B. McDonald,et al.  Review of Categorical Models for Classification Issues in Accounting and Finance , 1999 .

[14]  J. Tucker Selection Bias and Econometric Remedies in Accounting and Finance Research , 2011 .

[15]  David F. Larcker,et al.  On the Use of Instrumental Variables in Accounting Research , 2008 .

[16]  S. Rabe-Hesketh,et al.  Maximum Likelihood Estimation of Endogenous Switching And Sample Selection Models for Binary, Count, And Ordinal Variables , 2006 .

[17]  Andrea Morescalchi Housing Tenure and Individual Labour Market Outcomes. An Empirical Assessment Based on the UK Labour Force Survey , 2011 .

[18]  C. Lennox,et al.  The Demand for Audit in Private Firms: Recent Large-Sample Evidence from the UK , 2013 .

[19]  A. Jurkus,et al.  Women in Top Management and Agency Costs , 2008 .

[20]  D. Roodman,et al.  Estimating Fully Observed Recursive Mixed-Process Models with Cmp , 2009 .

[21]  T. Brown,et al.  The effect of dental care on cardiovascular disease outcomes: an application of instrumental variables in the presence of heterogeneity and self-selection. , 2011, Health economics.

[22]  Gary King,et al.  Matching as Nonparametric Preprocessing for Reducing Model Dependence in Parametric Causal Inference , 2007, Political Analysis.

[23]  Raymond McNamara,et al.  Audit Committee Characteristics and Firm Performance During the Global Financial Crisis , 2012 .

[24]  Joachim Gassen,et al.  Causal Inference in Empirical Archival Financial Accounting Research , 2013 .

[25]  Susan G. Watts,et al.  Family Firms, Debtholder-Shareholder Agency Costs and the Use of Covenants in Private Debt , 2008 .

[26]  S. Lee Endogeneity in Quantile Regression Models: A Control Function Approach , 2004 .

[27]  G. David Roodman CMP: Stata module to implement conditional (recursive) mixed process estimator , 2007 .

[28]  Carlos Arias,et al.  Maximum Simulated Likelihood: A Brief Introduction for Practitioners , 1999 .

[29]  R. Flores-Fillol,et al.  Workers cooperation within the firm: an analysis using small and medium size firms , 2010 .

[30]  M. Gangl RBOUNDS: Stata module to perform Rosenbaum sensitivity analysis for average treatment effects on the treated , 2004 .

[31]  Anil K. Bera,et al.  Testing the Normality Assumption in Limited Dependent Variable Models , 1984 .

[32]  Mei Feng,et al.  Analysts’ Incentives to Overweight Management Guidance when Revising Their Short-Term Earnings Forecasts , 2009 .

[33]  S. Wright,et al.  The Impact of Client and Misstatement Characteristics on the Disposition of Proposed Audit Adjustments , 2011 .

[34]  Mark A. Clatworthy,et al.  Selection bias and the Big Four premium: New evidence using Heckman and matching models , 2009 .

[35]  Mary S. Doucet,et al.  A simultaneous equations analysis of quality control review outcomes and engagement fees , 1994 .

[36]  Binding Constraints: Does Firm Size Matter? , 2012 .

[37]  Elisabeth Dedman,et al.  The impact of voluntary audit on credit ratings: evidence from UK private firms , 2012 .

[38]  Ting-Kai Chou Information content of credit ratings in pricing of future earnings , 2013 .

[39]  William R. Kinney, Jr.,et al.  Do Control Effectiveness Disclosures Require SOX 404(b) Internal Control Audits? A Natural Experiment with Small U.S. Public Companies , 2010 .

[40]  J. Angrist,et al.  Digitized by the Internet Archive in 2011 with Funding from Estimation of Limited-dependent Variable Models with Dummy Endogenous Regressors: Simple Strategies for Empirical Practice , 2011 .

[41]  S. Rock,et al.  Analyst following and count-data econometrics , 2000 .

[42]  Amedeo De Cesari Expropriation of minority shareholders and payout policy , 2010 .

[43]  Paul Glewwe,et al.  A test of the normality assumption in ordered probit model , 1997 .

[44]  Kristian D. Allee,et al.  The Demand for Financial Statements in an Unregulated Environment: an Examination of the Production and Use of Financial Statements By Privately-Held Small Businesses , 2009 .

[45]  Paolo Naticchioni,et al.  Short and Long Term Evaluations of Public Employment Services in Italy , 2010 .

[46]  Christopher F. Baum,et al.  Enhanced Routines for Instrumental Variables/Generalized Method of Moments Estimation and Testing , 2007 .

[47]  M. Bratti,et al.  Non-Pecuniary Returns to Higher Education: The Effect on Smoking Intensity in the UK , 2006, Health economics.

[48]  Tommaso Nannicini,et al.  Simulation-Based Sensitivity Analysis for Matching Estimators , 2006 .

[49]  Helen Short,et al.  The Accounting Burdens Facing Small Firms: An Empirical Research Note , 1990 .

[50]  L. Miranda-Moreno,et al.  Evaluating the Effects of Land Use and Strategies for Parking and Transit Supply on Mode Choice of Downtown Commuters , 2012 .

[51]  J. Stock,et al.  Retrospectives Who Invented Instrumental Variable Regression , 2003 .

[52]  Alastair Lawrence,et al.  Can Big 4 versus Non-Big 4 Differences in Audit-Quality Proxies Be Attributed to Client Characteristics? , 2011 .

[53]  Jeffrey M. Woodbridge Econometric Analysis of Cross Section and Panel Data , 2002 .

[54]  Partha Deb,et al.  Maximum Simulated Likelihood Estimation of a Negative Binomial Regression Model with Multinomial Endogenous Treatment , 2006 .

[55]  Todd Milbourn,et al.  The Role of Stock Liquidity in Executive Compensation , 2011 .

[56]  Clive S. Lennox,et al.  The Large Audit Firm Fee Premium: A Case of Selectivity Bias? , 2002 .

[57]  J. Angrist,et al.  Estimation of Limited Dependent Variable Models With Dummy Endogenous Regressors , 2001 .

[58]  William H. Greene,et al.  A General Approach to Incorporating Selectivity in a Model , 2006 .

[59]  Robin Jarvis,et al.  The demand for the audit in small companies in the UK , 2004 .

[60]  Christopher F. Baum,et al.  Instrumental Variables and GMM: Estimation and Testing , 2003 .

[61]  C. Andini Within-groups wage inequality and schooling: further evidence for Portugal , 2007, SSRN Electronic Journal.

[62]  W. Greene,et al.  计量经济分析 = Econometric analysis , 2009 .

[63]  Chunyang Zhou,et al.  Political connections, tax benefits and firm performance: Evidence from China , 2012 .

[64]  D. Rubin Using Propensity Scores to Help Design Observational Studies: Application to the Tobacco Litigation , 2001, Health Services and Outcomes Research Methodology.

[65]  Jeong‐Bon Kim,et al.  Audit pricing, legal liability regimes, and big 4 premiums: Theory and cross-country evidence , 2008 .

[66]  C. Mo,et al.  The Voter's Blunt Tool , 2013 .

[67]  G. Fraquelli,et al.  When quality signals talk: Evidence from the Turin hotel industry , 2011 .

[68]  Sascha O. Becker,et al.  Sensitivity Analysis for Average Treatment Effects , 2007 .

[69]  A simple representation of the Bera–Jarque–Lee test for probit models☆ , 2008 .

[70]  Mark A. Clatworthy,et al.  The impact of voluntary audit and governance characteristics on accounting errors in private companies , 2013 .

[71]  Kevin Denny Title Civic Returns to Education: Its Effect on Homophobia , 2011 .

[72]  Shenyang Guo,et al.  Propensity Score Analysis: Statistical Methods and Applications , 2014 .

[73]  Christopher R. Taber,et al.  Selection on Observed and Unobserved Variables: Assessing the Effectiveness of Catholic Schools , 2000, Journal of Political Economy.

[74]  FIML estimation of an endogenous switching model for count data , 2003 .

[75]  Dan Weiss,et al.  Cost Behavior and Analysts’ Earnings Forecasts , 2010 .

[76]  Partha Deb,et al.  Specification and Simulated Likelihood Estimation of a Non-Normal Treatment-Outcome Model with Selection: Application to Health Care Utilization , 2006 .

[77]  Enrico Maria Cervellati,et al.  Individual Investor Behavior: Evidence from the Clients of a Small Credit Cooperative Bank , 2011 .

[78]  B. Pramborg,et al.  Capital Budgeting and Political Risk: Empirical Evidence , 2006 .

[79]  D. Sciulli,et al.  The Causal Effect of Family Difficulties During Childhood on Adult Labour Market Outcomes , 2011 .

[80]  Lane F Burgette,et al.  A Full Gibbs Sampler for the Bayesian Multinomial Probit Switching Model , 2010 .

[81]  Michael J. Peel,et al.  The going-concern qualification debate: Some UK evidence , 1989 .

[82]  Miguel Minutti-Meza,et al.  Does Auditor Industry Specialization Improve Audit Quality , 2013 .

[83]  Mark A. Clatworthy,et al.  The Effect of Corporate Status on External Audit Fees: Evidence from the UK , 2007 .

[84]  A. Gregory,et al.  Stock Market Driven Acquisitions Versus the Q Theory of Takeovers: The UK Evidence , 2011 .

[85]  Yawen Jiao Stakeholder welfare and firm value , 2010 .

[86]  The Impact of Subsidized Health Insurance on the Poor in Colombia: Evaluating the Case of Medellín through Endogenous Switching Models and Propensity Score Matching for Medical Care Utilization , 2010 .

[87]  A. D. Paoli The effect of schooling on fertility, labor market participation and children’s outcomes, evidence from Ecuador , 2010 .

[88]  M. Ammann,et al.  Is There Really No Conglomerate Discount? , 2011 .

[89]  T. Amemiya QUALITATIVE RESPONSE MODELS: A SURVEY , 1981 .

[90]  D. Rivers,et al.  Limited Information Estimators and Exogeneity Tests for Simultaneous Probit Models , 1988 .

[91]  M. Peel,et al.  Combining Information from Heckman and Matching Estimators: Testing and Controlling for Hidden Bias , 2013 .

[92]  W. Greene,et al.  Discrete Choice Modeling , 2007 .

[93]  Jeffrey M. Wooldridge,et al.  Solutions Manual and Supplementary Materials for Econometric Analysis of Cross Section and Panel Data , 2003 .

[94]  B. Melly,et al.  Estimation of Quantile Treatment Effects with Stata , 2010 .

[95]  A. Gregory,et al.  Stock Market Driven Acquisitions versus the Q Theory of Takeovers - The UK Evidence , 2009 .

[96]  S. Rabe-Hesketh,et al.  Maximum Likelihood Estimation of Endogenous Switching and Sample Selection Models for Binary, Ordinal, and Count Variables , 2006 .

[97]  Masataka Harada GSA: Stata module to perform generalized sensitivity analysis , 2012 .

[98]  Edward E. Leamer,et al.  Let's Take the Con Out of Econometrics , 1983 .

[99]  Kevin A. Clarke Return of the Phantom Menace , 2009 .

[100]  Montserrat Guillén,et al.  Count data models for a credit scoring system , 1996 .

[101]  G. W. Imbens Sensitivity to Exogeneity Assumptions in Program Evaluation , 2003 .

[102]  Thomas J. Chemmanur,et al.  What Drives the Valuation Premium in IPOs versus Acquisitions? An Empirical Analysis , 2011 .

[103]  Jere R. Francis,et al.  Selection models in accounting research , 2012 .

[104]  F. Gul,et al.  Female Directors and Earnings Quality , 2011 .

[105]  Paul A. Johnson A test of the normality assumption in the ordered probit model , 1996 .

[106]  Elisabeth Dedman,et al.  Perceived competition, profitability and the withholding of information about sales and the cost of sales , 2009 .

[107]  P. McCann,et al.  Migration and inter-industry mobility of UK graduates: Effect on earnings and career satisfaction , 2011 .

[108]  Political Cost Incentives for Managing the Property-Liability Insurer Loss Reserve , 2009 .

[109]  Sascha O. Becker,et al.  Mhbounds - Sensitivity Analysis for Average Treatment Effects , 2007 .

[110]  Anthony Murphy,et al.  Score Tests of Normality in Bivariate Probit Models , 2007 .

[111]  M. Lokshin,et al.  A Practical Comparison of the Bivariate Probit and Linear IV Estimators , 2011 .

[112]  K. Frank Impact of a Confounding Variable on a Regression Coefficient , 2000 .

[113]  Lane F Burgette,et al.  A Full Gibbs Sampler for a Multinomial Probit Model with Endogeneity , 2009 .

[114]  Clive S. Lennox,et al.  Voluntary Audits Versus Mandatory Audits , 2011 .

[115]  Srinivasan Sankaraguruswamy,et al.  Evidence on the Joint Determination of Audit and Non-Audit Fees , 2003 .

[116]  Christian Leuz,et al.  The Economic Consequences of Increased Disclosure , 1999 .

[117]  Kim Ittonen,et al.  Female Auditors and Accruals Quality , 2013 .

[118]  J. Buckley Choosing Schools, Building Communities? The Effect of Schools of Choice on Parental Involvement. , 2007 .

[119]  A. D. Paoli Education, Teenage Fertility and Labour Market Participation, Evidence from Ecuador , 2011 .

[120]  D. Rubin,et al.  The central role of the propensity score in observational studies for causal effects , 1983 .

[121]  B. Roe,et al.  The welfare impact of food pathogen vaccines , 2012 .

[122]  T. Palva,et al.  Pages 1-19 , 2001 .

[123]  A. Ichino,et al.  From Temporary Help Jobs to Permanent Employment: What Can We Learn from Matching Estimators and Their Sensitivity? , 2006, SSRN Electronic Journal.

[124]  Yu-Chi Ho,et al.  Generalized Sensitivity Analysis , 1991 .

[125]  Jeremy Michels Do Unverifiable Disclosures Matter? Evidence from Peer-to-Peer Lending , 2012 .

[126]  T. DiPrete,et al.  7. Assessing Bias in the Estimation of Causal Effects: Rosenbaum Bounds on Matching Estimators and Instrumental Variables Estimation with Imperfect Instruments , 2004 .

[127]  J. Angrist,et al.  Instrumental Variables Estimates of the Effect of Subsidized Training on the Quantiles of Trainee Earnings , 1999 .

[128]  Ibrahim Niankara Essays in Risk and Applied Bayesian Econometric Modeling , 2011 .

[129]  Dahlia Robinson,et al.  Bankruptcy outcomes: Does the board matter? , 2012 .

[130]  G. Cerulli Ivtreatreg: a new STATA routine for estimating binary treatment models with heterogeneous response to treatment under observable and unobservable selection , 2012 .