Legal HARKing: theoretical grounding in interaction research

In psychology, we tend to follow the general logic of falsificationism: we separate the ‘context of discovery’ (how we come up with theories) from the ‘context of justification’ (how we test them). However, when studying human interaction, separating these contexts can lead to theories with low ecological validity that do not generalize well to life outside the lab. We propose borrowing research practices from formal inductive methodologies during the process of discovering new regularities and analyzing natural data without being led by theory. From the perspective of experimental psychology, this approach may appear similar to the ‘questionable research practice’ of HARKing (Hypothesizing After The Results are Known). We argue that a carefully constructed form of HARKing can be used systematically and transparently during exploratory research and can lead to more robust and ecologically valid theories.

[1]  J. Hindmarch Video in Qualitative Research: Analysing Social Interaction in Everyday Life , 2012, QMiP Bulletin.

[2]  Alexa Hepburn,et al.  The Conversation Analytic Approach to Transcription , 2012 .

[3]  H. Garfinkel,et al.  Two incommensurable, asymmetrically alternate technologies of social analysis , 1992 .

[4]  H. Garfinkel Studies of the Routine Grounds of Everyday Activities , 1964 .

[5]  H. Pashler,et al.  Editors’ Introduction to the Special Section on Replicability in Psychological Science , 2012, Perspectives on psychological science : a journal of the Association for Psychological Science.

[6]  E. Schegloff,et al.  A simplest systematics for the organization of turn-taking for conversation , 1974 .

[7]  Kobin H. Kendrick Using Conversation Analysis in the Lab , 2017 .

[8]  E. Schegloff Reflections on Quantification in the Study of Conversation , 1993 .

[9]  The Work of a [Scientific] Demonstration: Respecifying Newton’s and Goethe’s Theories of Prismatic Colors , 1992 .

[10]  Sebastian Loth,et al.  Automatic detection of service initiation signals used in bars , 2013, Front. Psychol..

[11]  J. D. Ruiter Methodological paradigms 
in interaction research , 2013 .

[12]  J. Potter Two kinds of natural , 2002 .

[13]  Elwys De Stefani Reference as an interactively and multimodally accomplished practice. Organizing spatial reorientation in guided tours , 2010 .

[14]  T. Stivers,et al.  A coding scheme for question-response sequences in conversation , 2010 .

[15]  A. Strauss,et al.  The discovery of grounded theory: strategies for qualitative research aldine de gruyter , 1968 .

[16]  J. T. Fay What's going on here. , 1966, Journal of the American Pharmaceutical Association.

[17]  E. Schegloff Sequencing in Conversational Openings , 1968 .

[18]  Sanna Raudaskoski Tool and Machine: The Affordances of the Mobile Phone , 2009 .

[19]  Pentti Haddington,et al.  Interaction and mobility : language and the body in motion , 2013 .

[20]  木村 和夫 Pragmatics , 1997, Language Teaching.

[21]  J. Wagner,et al.  Accounting for moral judgments in academic talk: The case of a conversation analysis data session , 2008 .

[22]  Michael Lynch,et al.  Revisiting the Cultural Dope , 2012, Human Studies.

[23]  Austin Henderson,et al.  Interaction Analysis: Foundations and Practice , 1995 .

[24]  Lorenza Mondada,et al.  Reorganizing Mobile Formations , 2014 .

[25]  H. Garfinkel Studies in Ethnomethodology , 1968 .

[26]  G. Loewenstein,et al.  Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling , 2012, Psychological science.

[27]  Yijin Wu,et al.  The Handbook of Conversation Analysis , 2015 .

[28]  Kobin H. Kendrick,et al.  A Coding Scheme for Other-initiated Repair Across Languages , 2016 .

[29]  Paul ten Have,et al.  Doing Conversation Analysis: A Practical Guide , 1999 .

[30]  Tanya Stivers,et al.  Coding Social Interaction: A Heretical Approach in Conversation Analysis? , 2015 .

[31]  Galina B. Bolden Transcribing as Research: “Manual” Transcription and Conversation Analysis , 2015 .

[32]  Michael C. Frank,et al.  Estimating the reproducibility of psychological science , 2015, Science.

[33]  Sang Eun Woo,et al.  Exploratory data analysis as a foundation of inductive research , 2017 .

[34]  Emanuel A. Schegloff,et al.  On possibles , 2006 .

[35]  Mathias Broth,et al.  Walking away: The embodied achievement of activity closings in mobile interaction , 2013 .

[36]  S. Danby,et al.  Reshaping Doctoral Education: International Approaches and Pedagogies. , 2012 .

[37]  H. Pashler,et al.  Is the Replicability Crisis Overblown? Three Arguments Examined , 2012, Perspectives on psychological science : a journal of the Association for Psychological Science.

[38]  J. D. de Ruiter,et al.  An Appeal for a Methodological Fusion of Conversation Analysis and Experimental Psychology , 2017 .

[39]  R. Mackay Garfinkel and Ethnomethodology , 1987 .

[40]  L. HARKing: Hypothesizing After the Results are Known , 2002 .

[41]  E. Schegloff,et al.  The preference for self-correction in the organization of repair in conversation , 1977 .

[42]  Martin Havlík,et al.  Emanuel A. Schegloff: Sequence Organization in Interaction. Volume 1. A Primer in Conversation Analysis , 2010 .

[43]  P. Kay,et al.  Universals and cultural variation in turn-taking in conversation , 2009, Proceedings of the National Academy of Sciences.

[44]  Emanuel A. Schegloff,et al.  Confirming Allusions: Toward an Empirical Account of Action , 1996, American Journal of Sociology.

[45]  E. Schegloff Sequence Organization in Interaction: Contents , 2007 .