Novel Methods for Leveraging Large Cohort Studies for Qualitative and Mixed-Methods Research

Abstract Qualitative research methods, while rising in popularity, are still a relatively underutilized tool in public health research. Usually reserved for small samples, qualitative research techniques have the potential to enhance insights gained from large questionnaires and cohort studies, both deepening the interpretation of quantitative data and generating novel hypotheses that might otherwise be missed by standard approaches; this is especially true where exposures and outcomes are new, understudied, or rapidly changing, as in a pandemic. However, methods for the conduct of qualitative research within large samples are underdeveloped. Here, we describe a novel method of applying qualitative research methods to free-text comments collected in a large epidemiologic questionnaire. Specifically, this method includes: 1) a hierarchical system of coding through content analysis; 2) a qualitative data management application; and 3) an adaptation of Cohen’s κ and percent agreement statistics for use by a team of coders, applying multiple codes per record from a large codebook. The methods outlined in this paper may help direct future applications of qualitative and mixed methods within large cohort studies.

[1]  M. Bliemer,et al.  Covid-19 pandemic and the unprecedented mobilisation of scholarly efforts prompted by a health crisis: Scientometric comparisons across SARS, MERS and 2019-nCoV literature , 2020, Scientometrics.

[2]  Helene Joffe,et al.  Intercoder Reliability in Qualitative Research: Debates and Practical Guidelines , 2020 .

[3]  W. Shakespeare,et al.  The complete works of William Shakespeare : the Cambridge edition text , 2019 .

[4]  S. Chow,et al.  Sample Size , 2019, Encyclopedic Dictionary of Archaeology.

[5]  Lara Carminati,et al.  Generalizability in Qualitative Research: A Tale of Two Traditions , 2018, Qualitative health research.

[6]  Rosmaladewi Rosmaladewi,et al.  BENEFITS AND DRAWBACKS OF NVIVO QSR APPLICATION , 2017 .

[7]  William Shakespeare,et al.  The Tragedy of Hamlet, Prince of Denmark , 1985, Hamlet.

[8]  Mike Allen,et al.  The SAGE Encyclopedia of Communication Research Methods Vulnerable Groups , 2017 .

[9]  Sarah Bulloch,et al.  CAQDAS at a Crossroads: Affordances of Technology in an Online Environment , 2017 .

[10]  Klaus Krippendorff,et al.  The Reliability of Multi-Valued Coding of Data , 2016 .

[11]  S. Seo,et al.  Research Methods in Healthcare Epidemiology: Survey and Qualitative Research , 2016, Infection Control & Hospital Epidemiology.

[12]  N. Gale,et al.  Using the framework method for the analysis of qualitative data in multi-disciplinary health research , 2013, BMC Medical Research Methodology.

[13]  M. McHugh Interrater reliability: the kappa statistic , 2012, Biochemia medica.

[14]  A. Onwuegbuzie,et al.  Methodological reporting in qualitative, quantitative, and mixed methods health services research articles. , 2012, Health services research.

[15]  Zheng Yan,et al.  Factors affecting response rates of the web survey: A systematic review , 2010, Comput. Hum. Behav..

[16]  Lp Wong,et al.  Data analysis in qualitative research: a brief guide to using nvivo. , 2008, Malaysian family physician : the official journal of the Academy of Family Physicians of Malaysia.

[17]  Kathleen M. T. Collins,et al.  A Mixed Methods Investigation of Mixed Methods Sampling Designs in Social and Health Science Research , 2007 .

[18]  Hsiu-Fang Hsieh,et al.  Three Approaches to Qualitative Content Analysis , 2005, Qualitative health research.

[19]  J. Sim,et al.  The kappa statistic in reliability studies: use, interpretation, and sample size requirements. , 2005, Physical therapy.

[20]  Carl Auerbach,et al.  Qualitative Data: An Introduction to Coding and Analysis , 2003 .

[21]  K. Malterud Qualitative research: standards, challenges, and guidelines , 2001, The Lancet.

[22]  M Lakshman,et al.  Quantitative Vs qualitative research methods , 2000, Indian journal of pediatrics.

[23]  Matthew B. Miles,et al.  Qualitative Data Analysis: An Expanded Sourcebook , 1994 .

[24]  N Britten,et al.  Qualitative research and general practice. , 1993, The British journal of general practice : the journal of the Royal College of General Practitioners.

[25]  K. Charmaz,et al.  'Discovering' chronic illness: using grounded theory. , 1990, Social science & medicine.

[26]  Valerie J. Caracelli,et al.  Toward a Conceptual Framework for Mixed-Method Evaluation Designs , 1989 .

[27]  J. Fleiss Measuring nominal scale agreement among many raters. , 1971 .

[28]  C. Brodsky The Discovery of Grounded Theory: Strategies for Qualitative Research , 1968 .