Mixed Methods in Biomedical and Health Services Research

Mixed-methods studies, in which qualitative1 and quantitative methods are combined in a single program of inquiry,2 are increasingly common and can be valuable in biomedical and health services research, in which the complementary strengths of each approach can characterize complex phenomena more fully than either approach alone.3,4 To effectively address complex problems in health and healthcare delivery, including heterogeneous and dynamic systems of care, a multilevel approach is needed to capture the perspectives of patients, providers, and organizations. Mixed methods offer enhanced capabilities to this end. Consequently, interest in mixed-methods studies is growing among funders, as evidenced by recent calls for proposals using these methods from the National Institutes of Health (NIH),5 the Agency for Healthcare Research and Quality,6 and independent research organizations (eg, Patient Centered Outcomes Research Institute)7 and foundations (eg, The Robert Wood Johnson Foundation).8 Training in mixed methods is also sponsored by NIH,9 the Agency for Healthcare Research and Quality,10 and professional associations.11 Nevertheless, written guidance on how to conduct rigorous mixed-methods research is not readily available to the general readership of peer-reviewed biomedical and health services journals, a group who may be less familiar with this approach. Accordingly, in this article, we describe applications of mixed methods in biomedical and health services research and provide a concise overview of key principles to facilitate best practices. First, we define mixed-methods approaches and present illustrations from published literature, including cardiovascular care. Second, we summarize standards for the design and conduct of rigorous mixed-methods studies. Third, we highlight 4 central considerations for investigators interested in using these methods. Mixed methods can be useful in the pursuit of a broad range of focal topics and study aims in the biomedical and health services research arenas, including, but not …

[1]  María Andrée López,et al.  Deepening our understanding of quality improvement in Europe (DUQuE): overview of a study of hospital quality management in seven countries , 2014, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[2]  Harlan M Krumholz,et al.  Hospital Strategies for Reducing Risk-Standardized Mortality Rates in Acute Myocardial Infarction , 2012, Annals of Internal Medicine.

[3]  A. Onwuegbuzie,et al.  Methodological reporting in qualitative, quantitative, and mixed methods health services research articles. , 2012, Health services research.

[4]  Michael D. Fetters,et al.  The Role of Group Dynamics in Mixed Methods Health Sciences Research Teams , 2012 .

[5]  J. Creswell,et al.  Best Practices for Mixed Methods Research in Health Sciences: (566732013-001) , 2011 .

[6]  Samantha Mauck,et al.  What Distinguishes Top-performing Hospitals in Acute Myocardial Infarction Mortality Rates? A Qualitative Study , 2011 .

[7]  J. Spertus,et al.  Medication Discussion Questions (MedDQ): Developing a Guide to Facilitate Patient-Clinician Communication About Heart Medications , 2011, The Journal of cardiovascular nursing.

[8]  A. Clark,et al.  Participation in community-based exercise maintenance programs after completion of hospital-based cardiac rehabilitation: a mixed-method study. , 2011, Journal of cardiopulmonary rehabilitation and prevention.

[9]  E. Murray,et al.  The Potential of Web-based Interventions for Heart Disease Self-Management: A Mixed Methods Investigation , 2010, Journal of medical Internet research.

[10]  C. Wagner,et al.  Investigating organizational quality improvement systems, patient empowerment, organizational culture, professional involvement and the quality of care in European hospitals: the 'Deepening our Understanding of Quality Improvement in Europe (DUQuE)' project , 2010, BMC health services research.

[11]  A. O’Cathain,et al.  Three techniques for integrating data in mixed methods studies , 2010, BMJ : British Medical Journal.

[12]  Dimitra I. Petrakaki,et al.  Implementation and adoption of nationwide electronic health records in secondary care in England: qualitative analysis of interim results from a prospective national evaluation , 2010, BMJ : British Medical Journal.

[13]  Anthony J. Onwuegbuzie,et al.  Mixed Research as a Tool for Developing Quantitative Instruments , 2010 .

[14]  W. Berta,et al.  Development of a measure of patient safety event learning responses. , 2009, Health services research.

[15]  Claire Glenton,et al.  Use of qualitative methods alongside randomised controlled trials of complex healthcare interventions: methodological study , 2009, BMJ : British Medical Journal.

[16]  J. Spertus,et al.  Exploring Patients' Reasons for Discontinuance of Heart Medications , 2009, The Journal of cardiovascular nursing.

[17]  D. Stewart,et al.  A mixed methods study of continuity of care from cardiac rehabilitation to primary care physicians. , 2009, The Canadian journal of cardiology.

[18]  Ingrid M. Nembhard,et al.  Qualitative and Mixed Methods Provide Unique Contributions to Outcomes Research , 2009, Circulation.

[19]  L. Fraenkel,et al.  Informed consent for abdominal aortic aneurysm repair: The patient's perspective. , 2008, Journal of vascular surgery.

[20]  C. Stadtländer Improving Aging and Public Health Research: Qualitative and Mixed Methods , 2008 .

[21]  A. O’Cathain,et al.  The Quality of Mixed Methods Studies in Health Services Research , 2008, Journal of health services research & policy.

[22]  Susan McLaren,et al.  Assessing organisational readiness for change: use of diagnostic analysis prior to the implementation of a multidisciplinary assessment for acute stroke care , 2007, Implementation science : IS.

[23]  Joanne Dean,et al.  Using a multi-method, user centred, prospective hazard analysis to assess care quality and patient safety in a care pathway , 2007, BMC Health Services Research.

[24]  Jon Nicholl,et al.  Why, and how, mixed methods research is undertaken in health services research in England: a mixed methods study , 2007, BMC Health Services Research.

[25]  R. Thomson,et al.  Qualitative methods in a randomised controlled trial: the role of an integrated qualitative process evaluation in providing evidence to discontinue the intervention in one arm of a trial of a decision support tool , 2007, Quality and Safety in Health Care.

[26]  John W. Creswell,et al.  Designing and Conducting Mixed Methods Research , 2006 .

[27]  Kurt C Stange,et al.  Publishing Multimethod Research , 2006, The Annals of Family Medicine.

[28]  Harlan M. Krumholz,et al.  Prevalence, Predictors, and Outcomes of Premature Discontinuation of Thienopyridine Therapy After Drug-Eluting Stent Placement: Results From the PREMIER Registry , 2006, Circulation.

[29]  A. Bryman Integrating quantitative and qualitative research: how is it done? , 2006 .

[30]  A. Localio,et al.  Role of computerized physician order entry systems in facilitating medication errors. , 2005, JAMA.

[31]  C. Teddlie,et al.  SAGE Handbook of Mixed Methods in Social & Behavioral Research , 2010 .

[32]  B. Bokhour,et al.  Measuring Patients' Perceptions of the Outcomes of Treatment for Early Prostate Cancer , 2003, Medical care.

[33]  Neal Krause,et al.  A comprehensive strategy for developing closed-ended survey items for use in studies of older adults. , 2002, The journals of gerontology. Series B, Psychological sciences and social sciences.

[34]  M. Patton Qualitative research & evaluation methods , 2002 .

[35]  D. Mant,et al.  Development and evaluation of complex interventions in health services research: case study of the Southampton heart integrated care project (SHIP) , 1999 .

[36]  D. Mant,et al.  Development and evaluation of complex interventions in health services research: case study of the Southampton heart integrated care project (SHIP). The SHIP Collaborative Group. , 1999, BMJ.

[37]  D L Morgan,et al.  Practical Strategies for Combining Qualitative and Quantitative Methods: Applications to Health Research , 1998, Qualitative health research.

[38]  W. Raub From the National Institutes of Health. , 1990, JAMA.

[39]  E. Guba,et al.  Naturalistic inquiry: Beverly Hills, CA: Sage Publications, 1985, 416 pp., $25.00 (Cloth) , 1985 .

[40]  T. Jick Mixing Qualitative and Quantitative Methods: Triangulation in Action. , 1979 .

[41]  D. Campbell Factors relevant to the validity of experiments in social settings. , 1957, Psychological bulletin.

[42]  L. Cronbach Coefficient alpha and the internal structure of tests , 1951 .