Gathering Data for Archival, Field, Survey and Experimental Accounting Research

In the published proceedings of the first Journal of Accounting Research Conference, Vatter [1966] lamented that “Gathering direct and original facts is a tedious and difficult task, and it is not surprising that such work is avoided.” For the fiftieth JAR Conference, we introduce a framework to help researchers understand the complementary value of seven empirical methods that gather data in different ways: prestructured archives, unstructured (“hand-collected”) archives, field studies, field experiments, surveys, laboratory studies, and laboratory experiments. The framework spells out five goals of an empirical literature and defines the seven methods according to researchers’ choices with respect to five data gathering tasks. We use the framework and examples of successful research studies in the financial reporting literature to clarify how data gathering choices affect a study's ability to achieve its goals, and conclude by showing how the complementary nature of different methods allows researchers to build a literature more effectively than they could with less diverse approaches to gathering data.

[1]  J. List,et al.  Using Field Experiments in Accounting and Finance , 2016 .

[2]  Scott A. Emett,et al.  Earnings presentation effects on manager reporting choices and investor decisions , 2014 .

[3]  Shana M. Clor-Proell,et al.  The Impact of Recognition Versus Disclosure on Financial Information: A Preparer's Perspective , 2014 .

[4]  Jacob M. Rose,et al.  Will Disclosure of Friendship Ties between Directors and CEOs Yield Perverse Effects , 2014 .

[5]  Eugene F. Soltes Incorporating Field Data into Archival Research , 2014 .

[6]  Ann Heinrichs Investors' access to corporate management : a field experiment about 1-on-1-calls , 2014 .

[7]  Eugene F. Soltes,et al.  Private Interaction Between Firm Management and Sell‐Side Analysts , 2013 .

[8]  M. W. Nelson,et al.  How Should We Think About Earnings Quality? A Discussion of 'Earnings Quality: Evidence from the Field' , 2013 .

[9]  Douglas J. Skinner,et al.  The politics of accounting standard-setting: A review of empirical research , 2013 .

[10]  Kevin T. Rich,et al.  Accounting Restatements, Governance and Municipal Debt Financing , 2013 .

[11]  Hong Qu How Do Market Prices and Cheap Talk Affect Coordination? , 2013 .

[12]  E. Duflo,et al.  Truth-Telling by Third-Party Auditors and the Response of Polluting Firms: Experimental Evidence from India , 2013 .

[13]  Shivaram Rajgopal,et al.  Earnings Quality: Evidence from the Field , 2013 .

[14]  A. Costello,et al.  Mitigating Incentive Conflicts in Inter-Firm Relationships: Evidence from Long-Term Supply Contracts , 2013 .

[15]  Joseph J. Gerakos,et al.  Performance Shocks and Misreporting , 2013 .

[16]  R. Kroszner Disclosure Regulation in the Commercial Banking Industry : Lessons from the National Banking Era , 2013 .

[17]  Jakob Krause-Jensen,et al.  Liquidated - An ethnography of Wall Street , 2012 .

[18]  J. Evans Annual Report and Editorial Commentary for The Accounting Review , 2012 .

[19]  Leslie D. Hodder,et al.  Agency Problems, Accounting Slack and Banks’ Response to Proposed Reporting of Loan Fair Values , 2012 .

[20]  Kristina Rennekamp,et al.  Processing Fluency and Investors’ Reactions to Disclosure Readability , 2012 .

[21]  Alexander Ljungqvist,et al.  Shaping Liquidity: On the Casual Effects of Voluntary Disclosure , 2011 .

[22]  William J. Mayew,et al.  Analyzing Speech to Detect Financial Misreporting , 2011 .

[23]  M. Weisbach,et al.  What Do Boards Really Do? Evidence from Minutes of Board Meetings , 2011 .

[24]  John A. List,et al.  Why Economists Should Conduct Field Experiments and 14 Tips for Pulling One Off , 2011 .

[25]  P. Healy,et al.  What Drives Sell-Side Analyst Compensation at High-Status Investment Banks? , 2011 .

[26]  J. V. Maanen,et al.  Ethnography as Work: Some Rules of Engagement , 2011 .

[27]  C. Allen,et al.  Stanford Encyclopedia of Philosophy , 2011 .

[28]  D. Larcker,et al.  Detecting Deceptive Discussions in Conference Calls , 2012 .

[29]  Luis Miller,et al.  Why a Trade-Off? The Relationship between the External and Internal Validity of Experiments , 2010, THEORIA.

[30]  Patricia M. Dechow,et al.  Understanding Earnings Quality: A Review of the Proxies, Their Determinants and Their Consequences , 2010 .

[31]  D. Cohen,et al.  The Financial Reporting Environment: Review of the Recent Literature , 2010 .

[32]  B. Miller The Effects of Reporting Complexity on Small and Large Investor Trading , 2010 .

[33]  John Morgan,et al.  Shrouded Attributes and Information Suppression: Evidence from the Field , 2010 .

[34]  Raffi Indjejikian,et al.  CFO Fiduciary Responsibilities and Annual Bonus Incentives , 2009 .

[35]  Peter Iliev,et al.  The Effect of SOX Section 404: Costs, Earnings Quality and Stock Prices , 2009 .

[36]  J. Pearl Causal inference in statistics: An overview , 2009 .

[37]  Steven D. Levitt,et al.  Was There Really a Hawthorne Effect at the Hawthorne Plant? An Analysis of the Original Illumination Experiments , 2009 .

[38]  Vernon L. Smith,et al.  Theory and Experiment: What are the questions? , 2009 .

[39]  Joshua D. Angrist,et al.  Mostly Harmless Econometrics: An Empiricist's Companion , 2008 .

[40]  Abhijit Banerjee,et al.  The Experimental Approach to Development Economics , 2008 .

[41]  David A. Wood,et al.  The Effects of Financial Statement and Informational Complexity on Analysts’ Cash Flow Forecasts , 2008 .

[42]  Sarah E. Bonner Judgment and Decision Making in Accounting , 2007 .

[43]  K. Schipper Required Disclosures in Financial Reports , 2007 .

[44]  Jane Kennedy,et al.  Are M.B.A. Students a Good Proxy for Nonprofessional Investors , 2007 .

[45]  T. Ahrens,et al.  Doing Qualitative Field Research in Management Accounting: Positioning Data to Contribute to Theory , 2005 .

[46]  Gerald J. Lobo,et al.  Does Recognition Versus Disclosure Matter? Evidence from Value-Relevance of Banks' Recognized and Disclosed Derivative Financial Instruments , 2004 .

[47]  D. Eric Hirst,et al.  Fair values, income measurement, and bank analysts' risk and valuation judgments , 2004 .

[48]  Steven J. Kachelmeier,et al.  Using Laboratory Experiments to Evaluate Accounting Policy Issues , 2002 .

[49]  R. Bloomfield The 'Incomplete Revelation Hypothesis' and Financial Reporting , 2002 .

[50]  William R. Kinney,et al.  Discussion of The Relation between Auditors' Fees for Nonaudit Services and Earnings Management , 2002 .

[51]  Patricia M. Dechow,et al.  The Quality of Accruals and Earnings: The Role of Accrual Estimation Errors , 2002 .

[52]  M. W. Nelson,et al.  Evidence from Auditors About Managers' and Auditors' Earnings-Management Decisions , 2001 .

[53]  B. V. Fraassen Constructive Empiricism Now , 2001 .

[54]  A. Fine The Scientific Image Twenty Years Later , 2001 .

[55]  E. Duflo,et al.  How Much Should We Trust Differences-in-Differences Estimates? , 2001 .

[56]  M. W. Nelson,et al.  Experimental Research in Financial Accounting , 2001 .

[57]  William M. K. Trochim,et al.  Research methods knowledge base , 2001 .

[58]  Chao-Shin Liu,et al.  Recognition and Disclosure Reliability: Evidence from SFAS No. 106 , 2002 .

[59]  Linda S. McDaniel,et al.  Effects of Comprehensive‐Income Characteristics on Nonprofessional Investors' Judgments: The Role of Financial‐Statement Presentation Format , 2000 .

[60]  Chao-Shin Liu,et al.  The Value Relevance of Financial Statement Recognition vs. Disclosure: Evidence from SFAS No. 106 , 1999 .

[61]  J. Angrist,et al.  Empirical Strategies in Labor Economics , 1998 .

[62]  D. Eric Hirst,et al.  Comprehensive income reporting and analysts' valuation judgments , 1998 .

[63]  B. Uzzi,et al.  Social Structure and Competition in Interfirm Networks: The Paradox of Embeddedness , 1997 .

[64]  R. Bloomfield,et al.  Market reactions to differentially available information in the laboratory , 1996 .

[65]  Thomas Z. Lys,et al.  An analysis of value destruction in AT&T's acquisition of NCR , 1995 .

[66]  R. Zayan Editor's preface , 1994, Behavioural Processes.

[67]  R. Pieters,et al.  Working Paper , 1994 .

[68]  Charles F. Manski,et al.  Evaluating Welfare and Training Programs. , 1994 .

[69]  James J. Heckman,et al.  Randomization and Social Policy Evaluation , 1991 .

[70]  J. Jones Earnings Management During Import Relief Investigations , 1991 .

[71]  V. Smith,et al.  Bubbles, Crashes, and Endogenous Expectations in Experimental Spot Asset Markets , 1988 .

[72]  William J. Bruns,et al.  Accounting and Management: Field Study Perspectives , 1987 .

[73]  Jerry R. Strawser,et al.  The Impact of New Pension Disclosure Rules on Perceptions of Debt , 1987 .

[74]  D. LaMont Johnson,et al.  What Are the Questions , 1986 .

[75]  V. Smith Microeconomic Systems as an Experimental Science , 1982 .

[76]  Robert Libby,et al.  Accounting and human information processing : theory and applications , 1981 .

[77]  Bas C. van Fraassen,et al.  The Scientific Image , 1980 .

[78]  A. Belkaoui The impact of socio-economic accounting statements on the investment decision: An empirical study , 1980 .

[79]  T. Cook,et al.  Quasi-experimentation: Design & analysis issues for field settings , 1979 .

[80]  C. Geertz The interpretation of cultures: Selected essays , 1975 .

[81]  Nicholas J. Gonedes,et al.  CAPITAL MARKET EQUILIBRIUM, INFORMATION PRODUCTION, AND SELECTING ACCOUNTING TECHNIQUES - THEORETICAL FRAMEWORK AND REVIEW OF EMPIRICAL WORK , 1974 .

[82]  Jason Millman,et al.  Research on human behavior;: A systematic guide to method , 1972 .

[83]  The Accounting Review , 1972 .

[84]  E. Fama EFFICIENT CAPITAL MARKETS: A REVIEW OF THEORY AND EMPIRICAL WORK* , 1970 .

[85]  T. Kuhn The Structure of Scientific Revolutions 2nd edition , 1970 .

[86]  W. J. Vatter Critical Synthesis Of Conference Papers , 1966 .

[87]  T. Kuhn,et al.  The Structure of Scientific Revolutions. , 1964 .

[88]  S. Itzkoff,et al.  What Is History , 1962, History of Education Quarterly.

[89]  L. Cronbach,et al.  Construct validity in psychological tests. , 1955, Psychological bulletin.

[90]  P. W. Bridgman The Logic of Modern Physics , 1927 .

[91]  J. Dewey,et al.  Reconstruction in Philosophy. , 1921 .

[92]  C. Judd,et al.  Pragmatism. A new name for some old ways of thinking. , 1908 .

[93]  W. James The principles of psychology , 1983 .