Integrative approaches to qualitative and quantitative evidence

The Health Development Agency (www.hda.nhs.uk) is the national authority and information resource on what works to improve people's health and reduce health inequalities in England. It gathers evidence and produces advice for policy makers, professionals and practitioners, working alongside them to get evidence into practice. iii Contents Foreword iv Summary 1 What is the role of qualitative approaches in traditional trials and experimental studies? 2 Background 2 Multi-method research 2 Qualitative research in trials 3 Why synthesise evidence from quantitative and qualitative studies? 4 At what point in the development of a field of knowledge is it appropriate to pull qualitative and quantitative learning together? 6 Generating hypotheses and questions 6 Informing the selection of outcomes for review 6 Extending or guiding sampling 6 Providing explanations and informing conclusions 6 What constitutes good evidence from qualitative studies? 7 Are there hierarchies of evidence within the different types of qualitative investigation? 10 How may the findings of qualitative and quantitative research be synthesised? 11 Advice from the NHS Centre for Reviews and Dissemination 11 The interpretive/integrative distinction 11 Narrative summary 12 Thematic analysis 15 Grounded theory 15 Meta-ethnography 17 Estabrooks, Field and Morse's aggregation of findings approach 19 Qualitative meta-analysis 19 Qualitative meta-synthesis 19 Meta-study 21 Miles and Huberman's cross-case data analysis techniques 22 Content analysis 23 Case survey 24 Qualitative comparative analysis 24 Bayesian meta-analysis 25 Meta-needs assessment 27 Discussion 28 Quantitising and qualitising 28 Issues in qualitative synthesis 28 Conclusions 31 References 32 Quant-and-qual.indd 3/26/2004, 10:10 AM 3 iv In 2000 the Health Development Agency (HDA) was established to, among other things, build the evidence base in public health, with particular reference to reducing inequalities in health (Department of Health, 2001). Since then the HDA has been engaged in a programme of developing methodologies and protocols to do precisely that (Swann et al., 2002). There are two important ideas behind the HDA's remit, political and scientific. The political imperative is a clear commitment to tackling the long-term problem at the heart of public health – that, as the health of the population as a whole continues to improve, at the same time the gradient in inequalities in health across the population, from the most to the least advantaged becomes worse (Acheson, 1998) There is, in other words, a long-standing problem of inequalities in health. The scientific principle is that the best available evidence should be used in order to …

[1]  D. Finfgeld,et al.  Courage as a Process of Pushing Beyond the Struggle , 1999, Qualitative health research.

[2]  D. Snow,et al.  The Outcomes of Homeless Mobilization: The Influence of Organization, Disruption, Political Mediation, and Framing , 2000, American Journal of Sociology.

[3]  George Davey Smith,et al.  Meta-analysis: Principles and procedures , 1997, BMJ.

[4]  D. Dixon.  Unifying Concepts in Parents' Experiences with Health Care Providers , 1996 .

[5]  Keith R Abrams,et al.  Factors affecting uptake of childhood immunisation: a Bayesian synthesis of qualitative and quantitative evidence , 2002, The Lancet.

[6]  Jenny Donovan,et al.  Evaluating meta-ethnography: a synthesis of qualitative research on lay experiences of diabetes and diabetes care. , 2003, Social science & medicine.

[7]  Tim Blackman,et al.  Studying the Organisation and Delivery of Health Services , 2002 .

[8]  Louise A. Jensen,et al.  Meta-Synthesis of Qualitative Findings , 1996 .

[9]  유창조.  Naturalistic Inquiry , 2022, The SAGE Encyclopedia of Research Design.

[10]  J Popay,et al.  Qualitative research and evidence-based healthcare , 1998, Journal of the Royal Society of Medicine.

[11]  J Kitzinger,et al.  Representing infant feeding: content analysis of British media portrayals of bottle feeding and breast feeding , 2000, BMJ : British Medical Journal.

[12]  Anselm L. Strauss,et al.  Basics of qualitative research : techniques and procedures for developing grounded theory , 1998 .

[13]  D. McNaughton,et al.  A synthesis of qualitative home visiting research. , 2000, Public health nursing.

[14]  A. Edwards,et al.  Do hospital-based palliative teams improve care for patients or families at the end of life? , 2002, Journal of pain and symptom management.

[15]  J. Forte.  Power and Role-Taking: A Review of Theory, Research, and Practice , 1998 .

[16]  Martyn Hammersley,et al.  Qualitative Data Archiving: Some Reflections on its Prospects and Problems , 1997 .

[17]  A. Chapple,et al.  Explicit guidelines for qualitative research: a step in the right direction, a defence of the 'soft' option, or a form of sociological imperialism? , 1998, Family practice.

[18]  K. Cox.  Enhancing cancer clinical trial management: recommendations from a qualitative study of trial participants' experiences , 2000, Psycho-oncology.

[19]  Andrew Abbott,et al.  Conceptions of Time and Events in Social Science Methods: Causal and Narrative Approaches , 1990 .

[20]  A. Strauss.  Basics Of Qualitative Research , 1992 .

[21]  Jane Henderson,et al.  Women's views of pregnancy ultrasound: a systematic review. , 2002, Birth.

[22]  S. Neill.  Acute childhood illness at home: the parents' perspective. , 2000, Journal of advanced nursing.

[23]  J. Wiersma.  Tho Press Release: Symbolic Communication In Life History Interviewing , 1988 .

[24]  C. Worth,et al.  Understanding differences between high and low childhood accident rate areas: the importance of qualitative data. , 1994, Journal of Public Health Medicine.

[25]  G. Noblit,et al.  Meta-Ethnography: Synthesizing Qualitative Studies , 1988 .

[26]  Janice M. Morse,et al.  Completing a qualitative project : details and dialogue , 1998 .

[27]  D. Elbourne,et al.  Zelen randomization: attitudes of parents participating in a neonatal clinical trial. , 1998, Controlled clinical trials.

[28]  Pooled Case Comparison: An Innovation for Cross-Case Study , 1995 .

[29]  T. Peters,et al.  Improving design and conduct of randomised trials by embedding them in qualitative research: ProtecT (prostate testing for cancer and treatment) study , 2002 .

[30]  S. Hawker,et al.  Appraising the Evidence: Reviewing Disparate Data Systematically , 2002, Qualitative health research.

[31]  N. Hoffart.  Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory , 2000 .

[32]  G. Huby,et al.  From trial data to practical knowledge: qualitative study of how general practitioners have accessed and used evidence about statin drugs in their management of hypercholesterolaemia , 1998, BMJ.

[33]  Shanyang Zhao.  Metatheory, Metamethod, Meta-Data-Analysis: What, Why, and How? , 1991 .

[34]  David Evans,et al.  Reasons for physically restraining patients and residents: a systematic review and content analysis. , 2002, International journal of nursing studies.

[35]  Antony Morgan,et al.  Prevention and reduction of accidental injury in children and older people - HDA Evidence briefing , 2003 .

[36]  R. Yin,et al.  Using the Case Survey Method To Analyze Policy Studies. , 1975 .

[37]  M E Duffy,et al.  Methodological triangulation: a vehicle for merging quantitative and qualitative research methods. , 1987, Image--the journal of nursing scholarship.

[38]  J. Walkup.  Fuzzy-set social science , 2003 .

[39]  Janice M. Morse,et al.  Aggregating Qualitative Findings: An Approach to Theory Development , 1994 .

[40]  R. Larsson.  Case Survey Methodology: Quantitative Analysis of Patterns Across Case Studies , 1993 .

[41]  R. Pill,et al.  Understanding the culture of prescribing: qualitative study of general practitioners' and patients' perceptions of antibiotics for sore throats , 1998, BMJ.

[42]  Charles C. Ragin,et al.  Fuzzy-Set Social Science , 2001 .

[43]  David M. Eddy,et al.  Meta-analysis by the confidence profile method , 1992 .

[44]  N. Crowell,et al.  The American Association of Retired Persons. , 1973, Journal of psychiatric nursing and mental health services.

[45]  M. Meade,et al.  Qualitative studies on the patient's experience of weaning from mechanical ventilation. , 2001, Chest.

[46]  R. Barbour.  Mixing Qualitative Methods: Quality Assurance or Qualitative Quagmire? , 1998, Qualitative health research.

[47]  Jennie Popay,et al.  Synthesising research evidence. , 2001 .

[48]  G. Sherwood.  Meta-Synthesis: Merging Qualitative Studies to Develop Nursing Knowledge , 1999, International Journal for Human Caring.

[49]  Jenny L Donovan,et al.  Random allocation or allocation at random? Patients' perspectives of participation in a randomised controlled trial , 1998, BMJ.

[50]  M. Kearney,et al.  Enduring love: a grounded formal theory of women's experience of domestic violence. , 2001, Research in nursing & health.

[51]  S. Thorne.  Phenomenological Positivism and other Problematic Trends in Health Science Research , 1997 .

[52]  Sue Ziebland,et al.  Analysing qualitative data , 2000, BMJ : British Medical Journal.

[53]  K. Morin,et al.  Evaluating the level of evidence of qualitative research. , 2002, Journal of obstetric, gynecologic, and neonatal nursing : JOGNN.

[54]  A. Bryman.  Quantity and quality in social research , 1988 .

[55]  D Acheson,et al.  Independent inquiry into inequalities in health , 2005 .

[56]  M. Berkwits.  From practice to research: the case for criticism in an age of evidence. , 1998, Social science & medicine.

[57]  Sally Thorne,et al.  Meta-Study of Qualitative Health Research , 2001 .

[58]  John Gaber,et al.  Meta-needs assessment , 2000 .

[59]  A. Strauss,et al.  The discovery of grounded theory: strategies for qualitative research aldine de gruyter , 1968 .

[60]  R. Andersson,et al.  The impact of structural factors on the injury rate in different European countries. , 2001, European journal of public health.

[61]  D. Silverman,et al.  Ensuring rigour in qualitative research , 1997 .

[62]  Antonia M. Nelson.  A Metasynthesis: Mothering Other-than-Normal Children , 2002, Qualitative health research.

[63]  Angela Harden,et al.  A Review of The Effectiveness and Appropriateness of Peer-Delivered Health Promotion for Young People , 1999 .

[64]  Nigel Fielding,et al.  Resistance and Adaptation to Criminal Identity: Using Secondary Analysis to Evaluate Classic Studies of Crime and Deviance , 2000 .

[65]  Cheryl Tatano Beck.  A Meta-Synthesis of Qualitative Research , 2002, MCN. The American journal of maternal child nursing.

[66]  S. Lang,et al.  Collected Papers Volume III , 2000 .

[67]  Valerie J. Caracelli,et al.  Toward a Conceptual Framework for Mixed-Method Evaluation Designs , 1989 .

[68]  J. Morse.  Critical Issues in Qualitative Research Methods , 1993 .

[69]  David M. Eddy,et al.  The Confidence Profile Method: A Bayesian Method for Assessing Health Technologies , 1989, Oper. Res..

[70]  B. Paterson,et al.  Shifting images of chronic illness. , 1998, Image--the journal of nursing scholarship.

[71]  C. Pope,et al.  Using meta ethnography to synthesise qualitative research: a worked example , 2002, Journal of health services research & policy.

[72]  J. Heaton.  Secondary Analysis of Qualitative Data , 2003 .

[73]  J. Popay,et al.  Rationale and Standards for the Systematic Review of Qualitative Literature in Health Services Research , 1998, Qualitative health research.

[74]  Lucy Dillon,et al.  Quality in qualitative evaluation: A framework for assessing research evidence. A quality framework. , 2003 .

[75]  D. Silverman.  Interpreting Qualitative Data: Methods for Analysing Talk, Text and Interaction , 1994 .

[76]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.

[77]  M J Buxton,et al.  Evaluating patient-based outcome measures for use in clinical trials. , 1998, Health technology assessment.

[78]  J Chilcott,et al.  The role of modelling in prioritising and planning clinical trials. , 2003, Health technology assessment.

[79]  A. Kuzel,et al.  On the Idea of What Constitutes Good Qualitative Inquiry , 1992 .

[80]  John Brazier,et al.  A review of the use of health status measures in economic evaluation. , 1999, Health technology assessment.

[81]  Abbas Tashakkori,et al.  Mixed Methodology: Combining Qualitative and Quantitative Approaches , 1998 .

[82]  G. Sherwood.  Meta-synthesis of qualitative analyses of caring: defining a therapeutic model of nursing. , 1997, Advanced practice nursing quarterly.

[83]  Margarete Sandelowski,et al.  The Challenges of Searching for and Retrieving Qualitative Studies , 2003, Western journal of nursing research.

[84]  Rosaline S Barbour,et al.  Checklists for improving rigour in qualitative research: a case of the tail wagging the dog? , 2001, BMJ : British Medical Journal.

[85]  M Sandelowski,et al.  Focus on qualitative methods. Qualitative metasynthesis: issues and techniques. , 1997, Research in nursing & health.

[86]  C Langley,et al.  Clinicians' Attitudes to Recruitment to Randomised Trials in Cancer Care: A Qualitative Study , 2000, Journal of health services research & policy.

[87]  Thomas A. Schwandt.  Farewell to Criteriology , 1996 .

[88]  Nicholas Walliman,et al.  Social research methods , 2006 .

[89]  Richard Wilson,et al.  School of Health and Related Research (ScHARR) , 2001 .

[90]  A. L. Cochrane,et al.  Effectiveness and efficiency: random reflections on health services , 1972 .

[91]  R. Lindley,et al.  Thrombolysis for acute ischaemic stroke: consumer involvement in design of new randomised controlled trial , 2002, BMJ : British Medical Journal.

[92]  W. Stiles.  Quality control in qualitative research , 1993 .

[93]  Matthew B. Miles,et al.  Qualitative Data Analysis: An Expanded Sourcebook , 1994 .

[94]  Tom Carney.  Fourth Generation Evaluation , 1991 .

[95]  Martyn Hammersley,et al.  The relationship between qualitative and quantitative research: paradigm loyalty versus methodological eclecticism , 2002 .

[96]  D. Elbourne,et al.  Reactions of participants to the results of a randomised controlled trial: exploratory study , 1998, BMJ.

[97]  Paul Dieppe,et al.  Relation between agendas of the research community and the research consumer , 2000, The Lancet.

[98]  Jason L. Jensen,et al.  Cumulating the Intellectual Gold of Case Study Research , 2001 .

[99]  H. S. Wilson,et al.  Methodologic mistakes in grounded theory. , 1996, Nursing research.

[100]  B. Paterson,et al.  Adapting to and managing diabetes. , 1998, Image--the journal of nursing scholarship.