Selection Bias and Econometric Remedies in Accounting and Finance Research

While managers’ accounting and financial decisions are, for many, fascinating topics, selection bias poses a serious challenge to researchers estimating the decisions’ effects using non-experimental data. Selection bias potentially occurs because managers’ decisions are non-random and the outcomes of choices not made are never observable. “Selection bias due to observables” arises from sample differences that researchers can observe but fail to control. “Selection bias due to unobservables” arises from the unobservable and thus uncontrolled sample differences that affect managers’ decisions and their consequences. In this article I review two econometric tools developed to mitigate these biases – the propensity score matching (PSM) method to mitigate selection bias due to observables and the Heckman inverse-Mills-ratio (IMR) method to address selection bias due to unobservables – and discuss their applications in accounting and finance research. The article has four takeaways. First, researchers should select the correct method to alleviate potential selection bias: the PSM method mitigates selection bias due to observables, but does not alleviate selection bias due to unobservables. Second, in applying PSM researchers are advised to restrict their inferences to firms whose characteristics can be found in both the sample and control groups. Third, the IMR method, though popular, is limited to situations in which the choices are binary, the outcomes of choices are modeled in a linear regression, and the unobservables in the choice and outcome models follow a multivariate normal distribution. Researchers can overcome these constraints by using full information maximum likelihood estimation. Last, when the IMR method is used, special attention should be paid to the formulas in calculating IMRs. The article also calls for researchers’ attention to other approaches to evaluating the effects of managers’ decisions.

[1]  Zhongzhi Yang,et al.  Three Threats to Validity of Choice-Based and Matched-Sample Studies in Accounting Research: Comment , 2013 .

[2]  Toni M. Whited,et al.  Endogeneity in Empirical Corporate Finance1 , 2013 .

[3]  Jere R. Francis,et al.  Selection models in accounting research , 2012 .

[4]  Youngkyun Park Accrual Based and Real Earnings Management in Korean Firms: Substitutionary or Complementary Relation? , 2012 .

[5]  Daniel W. Collins,et al.  The Effect of Cash Flow Forecasts on Accrual Quality and Benchmark Beating , 2011 .

[6]  Toni M. Whited,et al.  Endogeneity in Empirical Corporate Finance , 2011 .

[7]  Marcus P. Kirk Research for Sale: Determinants and Consequences of Paid-for Analyst Research , 2010 .

[8]  Christopher S. Armstrong,et al.  The Role of Information and Financial Reporting in Corporate Governance and Debt Contracting , 2010 .

[9]  Douglas A. Schroeder Accounting and Causal Effects: Econometric Challenges , 2010 .

[10]  Kee-Hong Bae,et al.  Employee Treatment and Firm Leverage: A Test of the Stakeholder Theory of Capital Structure , 2010 .

[11]  Jun Yang,et al.  Inside the Black Box : The Role and Composition of Compensation Peer Groups * , 2008 .

[12]  Jennifer L. Blouin,et al.  Have the Tax Benefits of Debt Been Overestimated? , 2010 .

[13]  Kevin J. Murphy,et al.  Executive Pay and 'Independent' Compensation Consultants , 2009 .

[14]  M. Peel,et al.  Propensity Score Matching in Accounting Research and Rosenbaum Bounds Analysis for Confounding Variables , 2009 .

[15]  A. Purnanandam,et al.  Federal Dposit Insurance Corporation • Center for Financial ResearchThe Effect of Banking Crisis on Bank-Dependent Borrowers 1 , 2010 .

[16]  Alan D. Jagolinzer,et al.  Chief Executive Officer Equity Incentives and Accounting Irregularities , 2009 .

[17]  Micah S. Officer,et al.  Club Deals in Leveraged Buyouts , 2009 .

[18]  A. Saunders,et al.  Do Hedge Funds Trade on Private Information? Evidence from Syndicated Lending and Short-Selling , 2009 .

[19]  Joseph V. Terza,et al.  Parametric Nonlinear Regression with Endogenous Switching , 2009 .

[20]  Sharon P. Katz,et al.  Does Public Ownership of Equity Improve Earnings Quality? , 2009 .

[21]  Murillo Campello,et al.  The Real Effects of Financial Constraints: Evidence from a Financial Crisis , 2009 .

[22]  K. Ramesh,et al.  Market Reaction Surrounding the Filing of Periodic SEC Reports , 2009 .

[23]  Amy Y. Zang,et al.  What Determine Financial Analysts' Career Outcomes During Mergers? , 2008 .

[24]  A. Ovtchinnikov Capital Structure Decisions: Evidence from Deregulated Industries , 2008 .

[25]  L. Bottazzi,et al.  Who are the active investors? Evidence from venture capital , 2008 .

[26]  H. H. Chung,et al.  Managerial Legal Liability Coverage and Earnings Conservatism , 2008 .

[27]  Toby E. Stuart,et al.  Board Interlocks and the Propensity to Be Targeted in Private Equity Transactions , 2008 .

[28]  Jonathan L. Rogers Disclosure Quality and Management Trading Incentives , 2008 .

[29]  Mei Feng,et al.  Once Bitten, Twice Shy: The Relation Between Outcomes of Earnings Guidance and Management Guidance Strategy , 2008 .

[30]  G. Hale,et al.  Federal Reserve Bank of San Francisco Working Paper Series Do Banks Price Their Informational Monopoly? Do Banks Price Their Informational Monopoly? Do Banks Price Their Informational Monopoly? , 2022 .

[31]  D. Cohen,et al.  Accrual-Based and Real Earnings Management Activities Around Seasoned Equity Offerings , 2008 .

[32]  Siddhartha Chib,et al.  Analysis of treatment response data without the joint distribution of potential outcomes , 2007 .

[33]  Siddhartha Chib,et al.  Modeling and calculating the effect of treatment at baseline from panel outcomes. , 2007 .

[34]  Donald P. Cram,et al.  Three Threats to Validity of Choice-Based and Matched Sample Studies in Accounting Research , 2007 .

[35]  Weili Ge,et al.  Accruals Quality and Internal Control Over Financial Reporting , 2007 .

[36]  J. Tucker,et al.  Is Openness Penalized? Stock Returns Around Earnings Warnings , 2006 .

[37]  Thomas C. Omer,et al.  Auditor‐Provided Tax Services: The Effects of a Changing Regulatory Environment , 2006 .

[38]  Juan-José Díaz,et al.  An Assessment of Propensity Score Matching as a Nonexperimental Impact Estimator , 2005, The Journal of Human Resources.

[39]  M. Dahan,et al.  The role of information , 2006 .

[40]  Shuping Chen,et al.  Is silence golden? An empirical analysis of firms that stop giving quarterly earnings guidance , 2005 .

[41]  Marco Caliendo,et al.  Some Practical Guidance for the Implementation of Propensity Score Matching , 2005, SSRN Electronic Journal.

[42]  Henock Louis Acquirers' Abnormal Returns and the Non-Big 4 Auditor Clientele Effect , 2005 .

[43]  Belen Villalonga,et al.  How Do Family Ownership, Control, and Management Affect Firm Value? , 2004 .

[44]  Sunil Wahal,et al.  Grandstanding, certification and the underpricing of venture capital backed IPOs , 2004 .

[45]  P. Asquith,et al.  Performance Pricing in Bank Debt Contracts , 2004 .

[46]  Rachel M. Hayes,et al.  The Sarbanes-Oxley Act and Firms' Going-Private Decisions , 2004 .

[47]  I. Haw,et al.  Ultimate Ownership, Income Management, and Legal and Extra‐Legal Institutions , 2004 .

[48]  K. K. Raman,et al.  Litigation Risk and the Financial Reporting Credibility of Big 4 versus Non‐Big 4 Audits: Evidence from Anglo‐American Countries , 2004 .

[49]  Zhong Zhao,et al.  Using Matching to Estimate Treatment Effects: Data Requirements, Matching Metrics, and Monte Carlo Evidence , 2004, Review of Economics and Statistics.

[50]  A. Leone,et al.  Disclosure of Intended Use of Proceeds and Underpricing in Initial Public Offerings , 2006 .

[51]  Justin L. Tobias,et al.  Do Dropouts Suffer from Dropping Out? Estimation and Prediction of Outcome Gains in Generalized Selection Models , 2004 .

[52]  Michael Willenborg,et al.  Do Expert Informational Intermediaries Add Value? Evidence from Auditors in Microcap Initial Public Offerings , 2003 .

[53]  B. Hamilton,et al.  Correcting for Endogeneity in Strategic Management Research , 2003 .

[54]  Whitney K. Newey,et al.  Nonparametric Estimation of Sample Selection Models , 2003 .

[55]  Debra C. Jeter,et al.  Self-Selection of Auditors and Audit Pricing in Private Firms , 2003 .

[56]  Jeffrey M. Woodbridge Econometric Analysis of Cross Section and Panel Data , 2002 .

[57]  Karl A. Muller,et al.  External Monitoring of Property Appraisal Estimates and Information Asymmetry , 2001 .

[58]  James J. Heckman,et al.  Micro Data, Heterogeneity and the Evaluation of Public Policy Part 1 , 2001 .

[59]  Theo Vermaelen,et al.  Death Spiral Convertibles , 2001 .

[60]  John E. Core,et al.  The Use of Equity Grants to Manage Optimal Equity Incentive Levels , 1999 .

[61]  Robert E. Verrecchia,et al.  The Economic Consequences of Increased Disclosure , 1999 .

[62]  Petra E. Todd,et al.  Matching As An Econometric Evaluation Estimator , 1998 .

[63]  T. Shakespeare,et al.  Observational Studies , 2003 .

[64]  F. Vella Estimating Models with Sample Selection Bias: A Survey , 1998 .

[65]  Tim Loughran,et al.  The Operating Performance of Firms Conducting Seasoned Equity Offerings , 1997 .

[66]  D. Relles,et al.  Tools for intuition about sample selection bias and its correction , 1997 .

[67]  Chris E. Hogan Costs and Benefits of Audit Quality in the IPO Market: A Self-Selection Analysis , 1996 .

[68]  B. Carlin,et al.  Bayesian Model Choice Via Markov Chain Monte Carlo Methods , 1995 .

[69]  P. Schmidt,et al.  Limited-Dependent and Qualitative Variables in Econometrics. , 1984 .

[70]  D. Rubin,et al.  The central role of the propensity score in observational studies for causal effects , 1983 .

[71]  W. Greene Sample Selection Bias as a Specification Error: Comment , 1981 .

[72]  J. Heckman Sample selection bias as a specification error , 1979 .

[73]  Lung-fei Lee Unionism and Wage Rates: A Simultaneous Equations Model with Qualitative and Limited Dependent Variables , 1978 .