Pragmatic measures: what they are and why we need them.

Pragmatic measures are important to facilitate implementation and dissemination, address stakeholder issues, and drive quality improvement. This paper proposes necessary and recommended criteria for pragmatic measures, provides examples of projects to develop and identify such measures, addresses potential concerns about these recommendations, and identifies areas for future research and application. Key criteria for pragmatic measures include importance to stakeholders in addition to researchers, low burden, broad applicability, sensitivity to change, and being actionable. Examples of pragmatic measures are provided, including ones for different settings (e.g., primary care, hospital) and levels (e.g., individual, practitioner, setting) that illustrate approaches to produce broad-scale dissemination and the development of brief, standardized measures for use in pragmatic studies. There is an important need for pragmatic measures to facilitate pragmatic research, guide quality improvement, and inform progress on public health goals, but few examples are currently available. Development and evaluation of pragmatic measures and metrics would provide useful resources to advance science, policy, and practice.

[1]  Laura Manea,et al.  Optimal cut-off score for diagnosing depression with the Patient Health Questionnaire (PHQ-9): a meta-analysis , 2012, Canadian Medical Association Journal.

[2]  T. Christensen,et al.  Qualitative research and content validity: developing best practices based on science and experience , 2009, Quality of Life Research.

[3]  J. Fries,et al.  The Patient-Reported Outcomes Measurement Information System (PROMIS): Progress of an NIH Roadmap Cooperative Group During its First Two Years , 2007, Medical care.

[4]  E H Wagner,et al.  Quality improvement in chronic illness care: a collaborative approach. , 2001, The Joint Commission journal on quality improvement.

[5]  James B. Rebitzer,et al.  Influence, Information Overload, and Information Technology in Health Care , 2008, Advances in health economics and health services research.

[6]  M. Kreuter,et al.  Applications workbook to accompany health promotion planning : an educational and ecological approach , 1999 .

[7]  D M Berwick,et al.  Broadening the view of evidence-based medicine , 2005, Quality and Safety in Health Care.

[8]  K. Cook,et al.  Dynamic assessment of health outcomes: time to let the CAT out of the bag? , 2005, Health services research.

[9]  M. Zwarenstein,et al.  What kind of randomised trials do patients and clinicians need? , 2009, Evidence-based medicine.

[10]  J. Fries,et al.  The PROMIS of Better Outcome Assessment: Responsiveness, Floor and Ceiling Effects, and Internet Administration , 2011, The Journal of Rheumatology.

[11]  R. Spitzer,et al.  The PHQ-9 , 2001, Journal of General Internal Medicine.

[12]  McGinnis Jm,et al.  Redesigning the Clinical Effectiveness Research Paradigm: Innovation and Practice-Based Approaches: Workshop Summary , 2010 .

[13]  Robert D Gibbons,et al.  On the psychometric validity of the domains of the PDSQ: an illustration of the bi-factor item response theory model. , 2009, Journal of psychiatric research.

[14]  S. Dube,et al.  Tobacco use screening and counseling during physician office visits among adults--National Ambulatory Medical Care Survey and National Health Interview Survey, United States, 2005-2009. , 2012, MMWR supplements.

[15]  Ross C. Brownson,et al.  Dissemination and implementation research in health : translating science to practice , 2012 .

[16]  J. Durand,et al.  Chemotherapy-induced cardiomyopathy , 2011, Expert review of cardiovascular therapy.

[17]  D. Stryer,et al.  Practical clinical trials: increasing the value of clinical research for decision making in clinical and health policy. , 2003, JAMA.

[18]  Russell E Glasgow,et al.  A proposal to speed translation of healthcare research into practice: dramatic change is needed. , 2011, American journal of preventive medicine.

[19]  Carol M Hamilton,et al.  PhenX: a toolkit for interdisciplinary genetics research , 2010, Current opinion in lipidology.

[20]  J. Cappelleri,et al.  Patient-reported outcomes: conceptual issues. , 2007, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[21]  Ian Harvey,et al.  A pragmatic–explanatory continuum indicator summary (PRECIS): a tool to help trial designers , 2009, Canadian Medical Association Journal.

[22]  Anne C. Beal,et al.  The Patient-Centered Outcomes Research Institute (PCORI) national priorities for research and initial research agenda. , 2012, Journal of the American Medical Association (JAMA).

[23]  R. Spitzer,et al.  The Patient Health Questionnaire-2: Validity of a Two-Item Depression Screener , 2003, Medical care.

[24]  N. Kerse,et al.  Validation of PHQ-2 and PHQ-9 to Screen for Major Depression in the Primary Care Population , 2010, The Annals of Family Medicine.

[25]  Lawrence W. Green,et al.  Health Program Planning: An Educational and Ecological Approach , 2004 .

[26]  Paul A Estabrooks,et al.  Practical Clinical Trials for Translating Research to Practice: Design and Measurement Recommendations , 2005, Medical care.

[27]  P. Rothwell,et al.  External validity of randomised controlled trials: “To whom do the results of this trial apply?” , 2005, The Lancet.

[28]  Russell E Glasgow,et al.  Patient-reported measures of psychosocial issues and health behavior should be added to electronic health records. , 2012, Health affairs.

[29]  Enola K Proctor,et al.  Advancing the application, quality and harmonization of implementation science measures , 2012, Implementation Science.

[30]  R. Hays,et al.  Recommended methods for determining responsiveness and minimally important differences for patient-reported outcomes. , 2008, Journal of clinical epidemiology.

[31]  D. Kivlahan,et al.  The AUDIT alcohol consumption questions (AUDIT-C): an effective brief screening test for problem drinking. Ambulatory Care Quality Improvement Project (ACQUIP). Alcohol Use Disorders Identification Test. , 1998, Archives of internal medicine.

[32]  Maureen Boyle,et al.  Harmonized patient-reported data elements in the electronic health record: supporting meaningful use by primary care action on health behaviors and key psychosocial factors , 2012, J. Am. Medical Informatics Assoc..

[33]  Rodica Pop-Busui,et al.  Effect of intensive treatment of hyperglycaemia on microvascular outcomes in type 2 diabetes: an analysis of the ACCORD randomised trial , 2010, The Lancet.

[34]  John F. Steiner,et al.  Comparative Effectiveness Research to Accelerate Translation: Recommendations for an Emerging Field of Science , 2012 .

[35]  D. Amtmann,et al.  A PROMIS fatigue short form for use by individuals who have multiple sclerosis , 2012, Quality of Life Research.

[36]  Daniel J Buysse,et al.  The Patient-Reported Outcomes Measurement Information System (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005-2008. , 2010, Journal of clinical epidemiology.

[37]  David A. Chambers,et al.  National Institutes of Health approaches to dissemination and implementation science: current and future directions. , 2012, American journal of public health.

[38]  John C. Fortney,et al.  A Re-conceptualization of Access for 21st Century Healthcare , 2011, Journal of General Internal Medicine.

[39]  Martina V. Taylor,et al.  An evidence integration triangle for aligning science with policy and practice. , 2012, American journal of preventive medicine.

[40]  Russell E. Glasgow,et al.  What Does It Mean to Be Pragmatic? Pragmatic Methods, Measures, and Models to Facilitate Research Translation , 2013, Health education & behavior : the official publication of the Society for Public Health Education.