Measuring the Readability of Sustainability Reports: A Corpus-Based Analysis Through Standard Formulae and NLP

This study characterises and problematises the language of corporate reporting along region, industry, genre, and content lines by applying readability formulae and more advanced natural language processing (NLP)–based analysis to a manually assembled 2.75-million-word corpus. Readability formulae reveal that, despite its wider readership, sustainability reporting remains a very difficult to read genre, sometimes more difficult than financial reporting. Although we find little industry impact on readability, region does prove an important variable, with NLP-based variables more strongly affected than formulae. These results not only highlight the impact of legislative contexts but also language variety itself as an underexplored variable. Finally, the study reveals some of the weaknesses of default readability formulae, which are largely unable to register syntactic variation between the varieties of English in the reports and demonstrates the merits of NLP in report readability analysis as well as the need for more accessible sustainability reporting.

[1]  J. Courtis.  Readability of annual reports: Western versus Asian evidence , 1995 .

[2]  Carlos Larrinaga,et al.  Corporate social reporting and reputation risk management , 2008 .

[3]  B. Rutherford,et al.  Obfuscation, Textual Complexity and the Role of Regulated Narrative Accounting Disclosure in Corporate Governance , 2003 .

[4]  Feng Li.  Annual Report Readability, Current Earnings, and Earnings Persistence , 2008 .

[5]  Charles H. Cho,et al.  Impression Management in Sustainability Reports: An Empirical Investigation of the Use of Graphs , 2012 .

[6]  Kenneth J. Merkley,et al.  The Effect of Annual Report Readability on Analyst Following and the Properties of Their Earnings Forecasts , 2011 .

[7]  J. Stanton,et al.  Corporate annual reports: research perspectives used , 2002 .

[8]  Felice Dell'Orletta,et al.  Assessing the Readability of Sentences: Which Corpora and Features? , 2014, BEA@ACL.

[9]  J. Courtis.  Annual report readability variability: tests of the obfuscation hypothesis , 1998 .

[10]  K. Basu,et al.  Corporate Social Responsibility: A Process Model of Sensemaking , 2008 .

[11]  Pedro Neves,et al.  When Corporate Social Responsibility (CSR) Increases Performance: Exploring the Role of Intrinsic and Extrinsic CSR Attribution , 2015 .

[12]  C. Deegan,et al.  An examination of the corporate social and environmental disclosures of BHP from 1983‐1997: A test of legitimacy theory , 2002 .

[13]  J. Moon,et al.  'Implicit' and 'Explicit' CSR: A Conceptual Framework for a Comparative Understanding of Corporate Social Responsibility , 2008 .

[14]  Gregory Jackson,et al.  Corporate Social Responsibility in Western Europe: An Institutional Mirror or Substitute? , 2010 .

[15]  E. B. Coleman.  The comprehensibility of several grammatical transformations. , 1964 .

[16]  R. Flesch.  A new readability yardstick. , 1948, The Journal of applied psychology.

[17]  O. Boiral.  Sustainability reports as simulacra? A counter-account of A and A+ GRI reports , 2013 .

[18]  Charles H. Cho,et al.  The role of environmental disclosures as tools of legitimacy: A research note , 2007 .

[19]  Judith Bogert,et al.  In Defense of the Fog Index , 1985 .

[20]  Gaurav Kumar,et al.  Determinants of Readability of Financial Reports of U.S.-Listed Asian Companies , 2014 .

[21]  Kristen Precht,et al.  Stance moods in spoken English: Evidentiality and affect in British and American conversation* , 2003 .

[22]  Matthew V. Tilling.  Refinements to Legitimacy Theory in Social and Environmental Accounting , 2004 .

[23]  Yama Temouri,et al.  International business and institutions after the financial crisis , 2014 .

[24]  S Hrasky,et al.  Visual disclosure strategies adopted by more and less sustainability-driven companies , 2012 .

[25]  Charles H. Cho,et al.  Enhancement and obfuscation through the use of graphs in sustainability reports: An international comparison , 2012 .

[26]  Peng Cheng,et al.  Causal disclosures on earnings and earnings management in an IPO setting , 2011 .

[27]  Sandra Harrison,et al.  Two new readability predictors for the professional writer: pilot trials , 1998 .

[28]  Rüdiger Hahn,et al.  Determinants of Sustainability Reporting: A Review of Results, Trends, Theory, and Opportunities in an Expanding Field of Research , 2013 .

[29]  Rashid Ameer,et al.  Readability of Corporate Social Responsibility Communication in Malaysia , 2010 .

[30]  Kristen Precht.  Great Versus Lovely: Stance Differences in American and British English , 2003 .

[31]  R. Taffler,et al.  The Chairman's Statement and Corporate Financial Performance , 1992 .

[32]  Maria Mazzuca,et al.  Sustainability Report and Bank Valuation: Evidence from European Stock Markets , 2014 .

[33]  Mark A. Clatworthy,et al.  Financial reporting of good news and bad news: evidence from accounting narratives , 2003 .

[34]  Peter D. Wysocki,et al.  Earnings Management and Investor Protection: An International Comparison , 2002 .

[35]  W. Aerts.  On the use of accounting logic as an explanatory category in narrative accounting disclosures , 1994 .

[36]  Alexander Dahlsrud.  How corporate social responsibility is defined: an analysis of 37 definitions , 2008 .