Checklists for improving rigour in qualitative research: a case of the tail wagging the dog?

Qualitative research methods are enjoying unprecedented popularity. Although checklists have undoubtedly contributed to the wider acceptance of such methods, these can be counterproductive if used prescriptively. The uncritical adoption of a range of “technical fixes” (such as purposive sampling, grounded theory, multiple coding, triangulation, and respondent validation) does not, in itself, confer rigour. In this article I discuss the limitations of these procedures and argue that there is no substitute for systematic and thorough application of the principles of qualitative research. Technical fixes will achieve little unless they are embedded in a broader understanding of the rationale and assumptions behind qualitative research. #### Summary points Checklists can be useful improving qualitative research methods, but overzealous and uncritical use can be counterproductive Reducing qualitative research to a list of technical procedures (such as purposive sampling, grounded theory, multiple coding, triangulation, and respondent validation) is overly prescriptive and results in “the tail wagging the dog” None of these “technical fixes” in itself confers rigour; they can strengthen the rigour of qualitative research only if embedded in a broader understanding of qualitative research design and data analysis Otherwise we risk compromising the unique contribution that systematic qualitative research can make to health services research In medical research the question is no longer whether qualitative methods are valuable but how rigour can be ensured or enhanced. Checklists have played an important role in conferring respectability on qualitative research and in convincing potential sceptics of its thoroughness.1–3 They have equipped those unfamiliar with this approach to evaluate or review qualitative work (by providing guidance on crucial questions that need to be asked) and in reminding qualitative researchers of the need for a systematic approach (by providing an aide-memoire of the various stages involved in research design and data analysis4). Qualitative researchers stress the …

[1]  Rosaline S. Barbour,et al.  The Case for Combining Qualitative and Quantitative Approaches in Health Services Research , 1999, Journal of health services research & policy.

[2]  N Mays,et al.  Qualitative Research: Rigour and qualitative research , 1995 .

[3]  G. Harding,et al.  Qualitative methods: beyond the cookbook. , 1998, Family practice.

[4]  A. Strauss,et al.  The Discovery of Grounded Theory , 1967 .

[5]  K. Melia Producing ‘Plausible Stories’: Interviewing Student Nurses , 1997 .

[6]  R. Barbour Mixing Qualitative Methods: Quality Assurance or Qualitative Quagmire? , 1998, Qualitative health research.

[7]  R Pill,et al.  A review of recently published qualitative research in general practice. More methodological questions than answers? , 1997, Family practice.

[8]  N. Britten,et al.  Using Reflexivity to Optimize Teamwork in Qualitative Research , 1999, Qualitative health research.

[9]  Meddling with Mythology : AIDS and the Social Construction of Knowledge , 2000 .

[10]  T. Marteau,et al.  The Place of Inter-Rater Reliability in Qualitative Research: An Empirical Study , 1997 .

[11]  L. Richardson Postmodern Social Theory: Representational Practices* , 1991 .

[12]  Odette Parry,et al.  The Data are Out there, or are They? Implications for Archiving and Revisiting Qualitative Data , 1998 .

[13]  Alan Bryman,et al.  Analyzing Qualitative Data , 1994 .

[14]  Jane Frankland,et al.  Some issues arising in the systematic analysis of focus group materials. , 1998 .

[15]  M. Bloor Techniques of Validation in Qualitative Research: a Critical Commentary , 1997 .

[16]  D. Silverman,et al.  Ensuring rigour in qualitative research , 1997 .

[17]  Robert Dingwall,et al.  Context and Method in Qualitative Research , 1997 .

[18]  Alma Whiteley,et al.  Rigour in qualitative research , 2002 .

[19]  Paul Atkinson,et al.  Narrative Turn or Blind Alley? , 1997 .

[20]  Judith Green,et al.  Commentary: grounded theory and the constant comparative method. , 1998, BMJ.

[21]  J. Popay,et al.  Rationale and Standards for the Systematic Review of Qualitative Literature in Health Services Research , 1998, Qualitative health research.

[22]  J. Kitzinger,et al.  Developing Focus Group Research: Politics, Theory and Practice , 1998 .

[23]  Anton J. Kuzel,et al.  Sampling in qualitative inquiry. , 1992 .