Qualitative and Mixed Methods Provide Unique Contributions to Outcomes Research

Outcomes research examines the effects of medical care interventions and policies on the health outcomes of individuals and society.1 Investigators conducting outcomes research seek to inform the development of clinical practice guidelines, to evaluate the quality of medical care, and to foster effective interventions to improve the quality of care.2 Outcomes research has traditionally used quantitative sciences to examine the utilization, cost, and clinical effectiveness of medical care through randomized and nonrandomized experimental designs. Quantitative methods are not as well suited to measure other complex aspects of the healthcare delivery system, such as organizational change, clinical leadership in implementing evidence-based guidelines, and patient perceptions of quality of care, which are also critical issues in outcomes research.3–7 These more nuanced aspects of healthcare delivery may be most appropriately examined with qualitative research methods.8–10 Qualitative approaches are becoming more common in clinical medicine and health services research.5,11–15 Federal encouragement of qualitative research is regularly reflected in funding program announcements issued by the National Institutes of Health.16 For more than a decade, federal agencies and foundations such as the National Science Foundation have demonstrated a commitment to supporting qualitative research through funding scientific conferences, workshops, and monographs on this field of inquiry.17–20 Despite this steady growth in qualitative research, outcomes investigators in cardiology have relatively little guidance on when and how best to implement these methods in their investigations. The purpose of the present report is to introduce qualitative methods as providing unique and critical contributions to outcomes research. This report will describe the situations in which qualitative approaches are most helpful; summarize the primary principles and practices in study design, sampling, data collection, and data analysis for qualitative studies; present representative examples of cardiovascular outcomes research that uses qualitative methods; and synthesize current standards for …

[1]  A. Anderson,et al.  In-depth Interviewing , 2011 .

[2]  J. Ivey Focus groups. , 2011, Pediatric nursing.

[3]  Harlan M Krumholz,et al.  Outcomes Research: Generating Evidence for Best Practice and Policies , 2008, Circulation.

[4]  D. Cohen,et al.  Evaluative Criteria for Qualitative Research in Health Care: Controversies and Recommendations , 2008, The Annals of Family Medicine.

[5]  C. Stadtländer Improving Aging and Public Health Research: Qualitative and Mixed Methods , 2008 .

[6]  Jian-ping Liu,et al.  [Qualitative research and evidence-based medicine]. , 2008, Zhongguo Zhong xi yi jie he za zhi Zhongguo Zhongxiyi jiehe zazhi = Chinese journal of integrated traditional and Western medicine.

[7]  A. Edmondson,et al.  METHODOLOGICAL FIT IN MANAGEMENT FIELD RESEARCH. , 2007 .

[8]  K. Devers,et al.  Qualitative data analysis for health services research: developing taxonomy, themes, and theory. , 2007, Health services research.

[9]  Mita Giacomini,et al.  How qualitative research can contribute to research in the intensive care unit. , 2007, Journal of critical care.

[10]  P. Davidson,et al.  Literature review: considerations in undertaking focus group research with culturally and linguistically diverse groups. , 2007, Journal of clinical nursing.

[11]  Bie Nio Ong,et al.  Decision-making regarding total knee replacement surgery: A qualitative meta-synthesis , 2007, BMC Health Services Research.

[12]  M. Morris,et al.  Doing Synchronous Online Focus Groups With Young People , 2007, Qualitative health research.

[13]  G. Rosenthal,et al.  An empirically derived taxonomy of factors affecting physicians’ willingness to disclose medical errors , 2006, Journal of General Internal Medicine.

[14]  T. Inui,et al.  Making use of qualitative research techniques , 1998, Journal of General Internal Medicine.

[15]  J. Frich,et al.  [Qualitative studies]. , 2007, Tidsskrift for den Norske laegeforening : tidsskrift for praktisk medicin, ny raekke.

[16]  Jeanne Daly,et al.  A hierarchy of evidence for assessing qualitative health research. , 2007, Journal of clinical epidemiology.

[17]  Harlan M Krumholz,et al.  Strategies for reducing the door-to-balloon time in acute myocardial infarction. , 2006, The New England journal of medicine.

[18]  A. Stewart,et al.  Overview of Qualitative Methods in Research With Diverse Populations: Making Research Reflect the Population , 2006, Medical care.

[19]  N. Krause The use of qualitative methods to improve quantitative measures of health-related constructs. , 2006, Medical care.

[20]  John W. Creswell,et al.  Designing and Conducting Mixed Methods Research , 2006 .

[21]  R. Hamilton,et al.  Internet Recruitment and E-Mail Interviews in Qualitative Studies , 2006, Qualitative health research.

[22]  B. Crabtree,et al.  The qualitative research interview , 2006, Medical education.

[23]  Harlan M. Krumholz,et al.  Achieving Rapid Door-To-Balloon Times: How Top Hospitals Improve Complex Clinical Systems , 2006, Circulation.

[24]  Harlan M Krumholz,et al.  Achieving door-to-balloon times that meet quality guidelines: how do successful hospitals do it? , 2005, Journal of the American College of Cardiology.

[25]  H. Krumholz The year in epidemiology, health services, and outcomes research. , 2005, Journal of the American College of Cardiology.

[26]  D. Labarthe,et al.  Taking the Initiative: Implementing the American Heart Association Guide for Improving Cardiovascular Health at the Community Level Healthy People 2010 Heart Disease and Stroke Partnership Community Guideline Implementation and Best Practices Workgroup , 2005, Circulation.

[27]  R. McDaniel,et al.  Case Study Research: The View From Complexity Science , 2005, Qualitative health research.

[28]  R. Robinson,et al.  Discovering the Full Spectrum of Cardiovascular Disease: Minority Health Summit 2003 Report of the Advocacy Writing Group , 2005, Circulation.

[29]  E. Benjamin,et al.  Discovering the full spectrum of cardiovascular disease: Minority Health Summit 2003: executive summary. , 2005, Circulation.

[30]  E. Benjamin,et al.  Discovering the Full Spectrum of Cardiovascular Disease: Minority Health Summit 2003: Report of the Outcomes Writing Group , 2005, Circulation.

[31]  E. Stoller,et al.  The pivotal role of cardiac self-care in treatment timing. , 2005, Social science & medicine.

[32]  S. Sofaer,et al.  Patient perceptions of the quality of health services. , 2005, Annual review of public health.

[33]  J. Haafkens,et al.  Patient Expectations of Treatment for Back Pain: A Systematic Review of Qualitative and Quantitative Studies , 2004, Spine.

[34]  K. Ann McKibbon,et al.  A quantitative analysis of qualitative studies in clinical journals for the 2000 publishing year , 2004, BMC Medical Informatics Decis. Mak..

[35]  F. Mold,et al.  Qualitative Studies of Stroke: A Systematic Review , 2004, Stroke.

[36]  Katie MacMillan,et al.  The Wow Factor , 2004 .

[37]  Carol R Horowitz,et al.  A story of maladies, misconceptions and mishaps: effective management of heart failure. , 2004, Social science & medicine.

[38]  John W. Creswell,et al.  Designing A Mixed Methods Study In Primary Care , 2004, The Annals of Family Medicine.

[39]  G. Llewellyn,et al.  Sampling in qualitative research , 2004 .

[40]  Charles C. Ragin,et al.  Workshop on Scientific Foundations of Qualitative Research , 2004 .

[41]  Colin Sharp Qualitative Research and Evaluation Methods (3rd ed.) , 2003 .

[42]  Scott B. MacKenzie,et al.  Common method biases in behavioral research: a critical review of the literature and recommended remedies. , 2003, The Journal of applied psychology.

[43]  J. Gubrium,et al.  Benchmarking as everyday functional assessment in stroke recovery. , 2003, The journals of gerontology. Series B, Psychological sciences and social sciences.

[44]  S. Read Applications of Case Study Research , 2003 .

[45]  Miguel P Caldas,et al.  Research design: qualitative, quantitative, and mixed methods approaches , 2003 .

[46]  Wendy Levinson,et al.  Patients' and physicians' attitudes regarding the disclosure of medical errors. , 2003, JAMA.

[47]  J. Grimshaw,et al.  Research designs for studies evaluating the effectiveness of change and improvement strategies , 2003, Quality & safety in health care.

[48]  A. Hungin,et al.  Barriers to accurate diagnosis and effective management of heart failure in primary care: qualitative study , 2003, BMJ : British Medical Journal.

[49]  N. Britten,et al.  Patients' decisions about whether or not to take antihypertensive drugs: qualitative study , 2002, BMJ : British Medical Journal.

[50]  Trisha Greenhalgh,et al.  Integrating qualitative research into evidence based practice. , 2002, Endocrinology and metabolism clinics of North America.

[51]  R. Lindley,et al.  Thrombolysis for acute ischaemic stroke: consumer involvement in design of new randomised controlled trial , 2002, BMJ : British Medical Journal.

[52]  Helen Lambert,et al.  Anthropology in health research: from qualitative methods to multidisciplinarity , 2002, BMJ : British Medical Journal.

[53]  A. Parry Handbook of Qualitative Research , 2002 .

[54]  L. Doering,et al.  Recovering from cardiac surgery: what patients want you to know. , 2002, American journal of critical care : an official publication, American Association of Critical-Care Nurses.

[55]  P. Twohig,et al.  Group interviews in primary care research: advancing the state of the art or ritualized research? , 2002, Family practice.

[56]  A. Jette,et al.  Uses of evidence in disability outcomes and effectiveness research. , 2002, The Milbank quarterly.

[57]  C. Pope,et al.  Qualitative methods in research on healthcare quality , 2002, Quality & safety in health care.

[58]  Lyn Richards,et al.  Readme First for a User's Guide to Qualitative Methods , 2002 .

[59]  N. Kressin,et al.  Racial Differences in Health-Related Beliefs, Attitudes, and Experiences of VA Cardiac Patients: Scale Development and Application , 2002, Medical care.

[60]  N. Kressin,et al.  Racial Differences in How Patients Perceive Physician Communication Regarding Cardiac Testing , 2002, Medical care.

[61]  G. Pisano,et al.  Disrupted Routines: Team Learning and New Technology Implementation in Hospitals , 2001 .

[62]  H. Krumholz,et al.  A qualitative study of increasing beta-blocker use after myocardial infarction: Why do some hospitals succeed? , 2001, JAMA.

[63]  Mark Schrope,et al.  To boldly go , 2001, Nature.

[64]  K. Malterud Qualitative research: standards, challenges, and guidelines , 2001, The Lancet.

[65]  Kirsti Malterud,et al.  For Personal Use. Only Reproduce with Permission from the Lancet Publishing Group. the Nature of Clinical Knowledge the Art and Science of Clinical Knowledge: Evidence beyond Measures and Numbers Qualitative Research Series , 2022 .

[66]  H. Krumholz,et al.  A Qualitative Study of Increasing β-Blocker Use After Myocardial Infarction: Why Do Some Hospitals Succeed? , 2001 .

[67]  Rosaline S Barbour,et al.  Checklists for improving rigour in qualitative research: a case of the tail wagging the dog? , 2001, BMJ : British Medical Journal.

[68]  J Savage,et al.  Ethnography and health care , 2000, BMJ : British Medical Journal.

[69]  A. Stewart,et al.  Health-Related Quality-of-Life Assessments in Diverse Population Groups in the United States , 2000, Medical care.

[70]  D. Cook,et al.  Users' guides to the medical literature: XXIII. Qualitative research in health care B. What are the results and how do they help me care for my patients? Evidence-Based Medicine Working Group. , 2000, JAMA.

[71]  D. Cook,et al.  Users' guides to the medical literature: XXIII. Qualitative research in health care A. Are the results of the study valid? Evidence-Based Medicine Working Group. , 2000, JAMA.

[72]  T. Hoff,et al.  Exploring the Use of Qualitative Methods in Published Health Services and Management Research , 2000, Medical care research and review : MCRR.

[73]  N. Hoffart Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory , 2000 .

[74]  J. Meyer,et al.  Qualitative research in health care: Using qualitative methods in health related action research , 2000 .

[75]  S. Ziebland,et al.  Analysing qualitative data , 2000, BMJ : British Medical Journal.

[76]  C. Pope,et al.  Assessing quality in qualitative research , 2000, BMJ : British Medical Journal.

[77]  R. Woodgate Part II: a critical review of qualitative research related to children's experiences with cancer. , 2000, Journal of pediatric oncology nursing : official journal of the Association of Pediatric Oncology Nurses.

[78]  Shortell Sm,et al.  The emergence of qualitative methods in health services research. , 1999 .

[79]  S. Sofaer Qualitative methods: what are they and why use them? , 1999, Health services research.

[80]  K. Devers How will we know "good" qualitative research when we see it? Beginning the dialogue in health services research. , 1999, Health services research.

[81]  M. Patton,et al.  Enhancing the quality and credibility of qualitative analysis. , 1999, Health services research.

[82]  R. Yin Enhancing the quality of case studies in health services research. , 1999, Health services research.

[83]  D C Angus,et al.  Outcomes research in critical care: results of the American Thoracic Society Critical Care Assembly Workshop on Outcomes Research. The Members of the Outcomes Research Workshop. , 1999, American journal of respiratory and critical care medicine.

[84]  S M Shortell,et al.  The emergence of qualitative methods in health services research. , 1999, Health services research.

[85]  C. Clancy,et al.  Outcomes Research: Measuring the End Results of Health Care , 1998, Science.

[86]  D. K. Martin,et al.  Racial disparity in cardiac decision making: results from patient focus groups. , 1998, Archives of internal medicine.

[87]  J. Popay,et al.  Rationale and Standards for the Systematic Review of Qualitative Literature in Health Services Research , 1998, Qualitative health research.

[88]  Richard E. Boyatzis,et al.  Transforming Qualitative Information: Thematic Analysis and Code Development , 1998 .

[89]  Janice M. Morse,et al.  "Perfectly Healthy, but Dead": The Myth of Inter-Rater Reliability , 1997 .

[90]  Trisha Greenhalgh,et al.  How to read a paper: Papers that go beyond numbers (qualitative research) , 1997 .

[91]  T. Marteau,et al.  The Place of Inter-Rater Reliability in Qualitative Research: An Empirical Study , 1997 .

[92]  I. Craib Social Constructionism as a Social Psychosis , 1997 .

[93]  T S Inui The virtue of qualitative and quantitative research. , 1996, Annals of internal medicine.

[94]  M. Marshall Sampling for qualitative research. , 1996, Family practice.

[95]  N. Britten Qualitative Research: Qualitative interviews in medical research , 1995 .

[96]  N Mays,et al.  Qualitative Research: Rigour and qualitative research , 1995, BMJ.

[97]  C. Pope,et al.  Qualitative Research: Reaching the parts other methods cannot reach: an introduction to qualitative methods in health and health services research , 1995 .

[98]  J. Morse The Significance of Saturation , 1995 .

[99]  R. Stake The art of case study research , 1995 .

[100]  Matthew B. Miles,et al.  Qualitative Data Analysis: An Expanded Sourcebook , 1994 .

[101]  M. Lorentzon Doing Qualitative Research , 1993 .

[102]  N. Burns Standards for Qualitative Research , 1989, Nursing science quarterly.

[103]  E. Guba,et al.  Naturalistic inquiry: Beverly Hills, CA: Sage Publications, 1985, 416 pp., $25.00 (Cloth) , 1985 .

[104]  S. Fagerhaugh,et al.  Participant Observation , 1979 .

[105]  M. Patton Qualitative research and evaluation methods , 1980 .

[106]  T. Jick Mixing Qualitative and Quantitative Methods: Triangulation in Action. , 1979 .

[107]  J. Lofland,et al.  Analyzing Social Settings , 1971 .

[108]  O. Holsti Content Analysis for the Social Sciences and Humanities , 1969 .

[109]  A. Strauss,et al.  The discovery of grounded theory: strategies for qualitative research aldine de gruyter , 1968 .

[110]  John W. Creswell,et al.  Research Design: Qualitative, Quantitative, and Mixed Methods Approaches , 2010 .

[111]  J. Creswell Qualitative inquiry and research design: Choosing among five approaches, 2nd ed. , 2007 .