If on a winter’s night two researchers… A challenge to assumptions of soundness of interpretation

This paper reports on a quasi-experiment into triangulation, which is increasingly frequently cited as a guarantor of validity and reliability of findings. The methodology that we are exploring is the increasingly widely employed combination of corpus linguistics and (critical) discourse analysis. It has been argued that corpus approaches can offer greater objectivity because they are data-driven (or at least data-supported), more generalisable as they are based on larger samples, and more transparent given the research may be replicated on the same data. In order to explore the extent to which integrating corpus approaches may contribute to the stability of interpretations the authors set up an exploratory experiment. We attempt to answer the question: would two researchers starting with the same corpus and research question and (broadly) theoretical / methodological framework come to the same/similar conclusions?

[1]  Mike Scott Wordsmith Tools version 3 , 1997 .

[2]  R. Fowler Language in the News: Discourse and Ideology in the Press , 1991 .

[3]  N. Denzin,et al.  The Research Act in Sociology. , 1973 .

[4]  Jan-Ola Östman,et al.  Handbook of Pragmatics , 2018, Handbook of Pragmatics.

[5]  Gerald Prein,et al.  Triangulation: Validity and empirically-based hypothesis construction , 1997 .

[6]  Donald Matheson,et al.  Scowling at their Notebooks , 2003 .

[7]  Thao Lê,et al.  Linguistics and critical discourse analysis , 2009 .

[8]  Ronald Carter,et al.  Trust the Text: Language, Corpus and Discourse , 2004 .

[9]  Debbie Orpin Corpus Linguistics and Critical Discourse Analysis: Examining the ideology of sleaze , 2005 .

[10]  Caroline Coffin,et al.  Checking over-interpretation and under-interpretation: help from corpora in critical linguistics , 2004 .

[11]  D. V. D. Mieroop An integrated approach of quantitative and qualitative analysis in the study of identity in speeches , 2005 .

[12]  John Sinclair,et al.  Corpus, Concordance, Collocation , 1991 .

[13]  J. Eyles,et al.  Developing and Implementing a Triangulation Protocol for Qualitative Health Research , 2006, Qualitative health research.

[14]  Elaine W. Vine,et al.  Multiple Discourse Analyses of a Workplace Interaction , 2003 .

[15]  V A Thurmond,et al.  The point of triangulation. , 2001, Journal of nursing scholarship : an official publication of Sigma Theta Tau International Honor Society of Nursing.

[16]  M. Deuze What is journalism? , 2005 .

[17]  Jennifer Pearson,et al.  Working with Specialized Language: A Practical Guide to Using Corpora , 2002 .

[18]  G. Myrdal,et al.  Objectivity In Social Research , 1969 .

[19]  Caroline Coffin,et al.  Applying English grammar : functional and corpus approaches , 2004 .

[20]  Russell Frank,et al.  `These Crowded Circumstances' , 2003 .

[21]  Paul Baker,et al.  Using Corpora in Discourse Analysis , 2006 .

[22]  Michael Meyer,et al.  Methods of text and discourse analysis , 2000 .

[23]  Amaryll Perlesz,et al.  Methodological triangulation in researching families: Making sense of dissonant data , 2003 .

[24]  Dan Berkowitz,et al.  Social Meanings of News: A Text-Reader , 1997 .

[25]  Anatol Stefanowitsch,et al.  Corpus-Based Approaches to Metaphor and Metonymy , 2006 .

[26]  Signe Oksefjell Ebeling,et al.  Out of Corpora , 1999 .

[27]  M. Schudson The sociology of news production , 1989 .

[28]  Gerlinde Hardt-Mautner 'Only Connect.' Critical Discourse Analysis and Corpus Linguistics , 1995 .

[29]  Peter Dahlgren,et al.  Journalism and popular culture , 1992 .

[30]  John Morley,et al.  Corpora and discourse , 2004 .

[31]  Tony McEnery,et al.  A useful methodological synergy? Combining critical discourse analysis and corpus linguistics to examine discourses of refugees and asylum seekers in the UK press , 2008 .

[32]  R. Wodak Critical Linguistics and Critical Discourse Analysis , 2011 .

[33]  Michael Stubbs,et al.  COLLOCATIONS AND SEMANTIC PROFILES: ON THE CAUSE OF THE TROUBLE WITH QUANTITATIVE STUDIES , 1995 .

[34]  T. Jick Mixing Qualitative and Quantitative Methods: Triangulation in Action. , 1979 .

[35]  Gretchen B. Rossman,et al.  Numbers and words revisited: Being “shamelessly eclectic” , 1994 .

[36]  J. Evetts,et al.  Rethinking the concept of professionalism: the case of journalism. , 2003, The British journal of sociology.

[37]  Mike Scott,et al.  Textual Patterns: Key words and corpus analysis in language education , 2006 .

[38]  R. Wodak Critical Discourse Analysis , 2003 .