Evaluating the Relevance, Generalization, and Applicability of Research

Starting with the proposition that “if we want more evidence-based practice, we need more practice-based evidence,” this article (a) offers questions and guides that practitioners, program planners, and policy makers can use to determine the applicability of evidence to situations and populations other than those in which the evidence was produced (generalizability), (b) suggests criteria that reviewers can use to evaluate external validity and potential for generalization, and (c) recommends procedures that practitioners and program planners can use to adapt evidencebased interventions and integrate them with evidence on the population and setting characteristics, theory, and experience into locally appropriate programs. The development and application in tandem of such questions, guides, criteria, and procedures can be a step toward increasing the relevance of research for decision making and should support the creation and reporting of more practice-based research having high external validity.

[1]  S. Bull,et al.  Reaching those most in need: a review of diabetes self‐management interventions in disadvantaged populations , 2002, Diabetes/metabolism research and reviews.

[2]  M. Salah,et al.  Methodology , 2003 .

[3]  Alan Shiell,et al.  Methods for exploring implementation variation and local context within a cluster randomised community intervention trial , 2004, Journal of Epidemiology and Community Health.

[4]  Barbara Resnick,et al.  Enhancing treatment fidelity in health behavior change studies: best practices and recommendations from the NIH Behavior Change Consortium. , 2004, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[5]  M. Bardo,et al.  Translation in Tobacco and Drug Abuse Prevention Research , 2006, Evaluation & the health professions.

[6]  C. T. Orleans,et al.  Does the chronic care model serve also as a template for improving prevention? , 2001, The Milbank quarterly.

[7]  D B Abrams,et al.  Integrating individual and public health perspectives for treatment of tobacco dependence under managed health care: A combined stepped-care and matching model , 1996, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[8]  R. Hiatt,et al.  Promoting Cancer Screening: Lessons Learned and Future Directions for Research and Practice , 2004 .

[9]  R. Kaplan The significance of quality of life in health care , 2004, Quality of Life Research.

[10]  D. Stryer,et al.  Practical clinical trials: increasing the value of clinical research for decision making in clinical and health policy. , 2003, JAMA.

[11]  M. Kreuter,et al.  Applications workbook to accompany health promotion planning : an educational and ecological approach , 1999 .

[12]  Carol N. D'Onofrio Pooling Information About Prior Interventions: A New Program Planning Tool , 2001 .

[13]  Lawrence W. Green,et al.  Book Review , 2000 .

[14]  Lisa M Klesges,et al.  The future of health behavior change research: What is needed to improve translation of research into health promotion practice? , 2004, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[15]  E. Rogers,et al.  Diffusion of innovations , 1964, Encyclopedia of Sport Management.

[16]  G. Norquist Practice Research Networks: Promises and Pitfalls , 2006 .

[17]  Adrienne Y. Stith,et al.  Unequal treatment: confronting racial and ethnic disparities in health care. , 2003 .

[18]  Russell E Glasgow,et al.  Using RE-AIM metrics to evaluate diabetes self-management support interventions. , 2006, American journal of preventive medicine.

[19]  G. Kok,et al.  Intervention Mapping - Designing Theory and Evidence-Based Health Promotion Programs , 2000 .

[20]  Alastair Baker,et al.  Crossing the Quality Chasm: A New Health System for the 21st Century , 2001, BMJ : British Medical Journal.

[21]  U. P. S. T. Force,et al.  Guide to clinical preventive services : an assessment of the effectiveness of 169 interventions : report of the U.S. Preventive Services Task Force , 1989 .

[22]  ROBERT W. Johnson,et al.  Promoting the maintenance of health behavior change: recommendations for the next generation of research and practice. , 2000, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[23]  A. B. Hill The Environment and Disease: Association or Causation? , 1965, Proceedings of the Royal Society of Medicine.

[24]  A R Hinman,et al.  Developing the Guide to Community Preventive Services--overview and rationale. The Task Force on Community Preventive Services. , 2000, American journal of preventive medicine.

[25]  Donald B. Rubin,et al.  The Dependability of Behavioral Measurements: Theory of Generalizability for Scores and Profiles. , 1974 .

[26]  Paul A Estabrooks,et al.  The Future of Physical Activity Behavior Change Research: What Is Needed to Improve Translation of Research into Health Promotion Practice? , 2004, Exercise and sport sciences reviews.

[27]  M. Trevisan,et al.  Is Italy losing the "Mediterranean advantage?" Report on the Gubbio population study: cardiovascular risk factors at baseline. Gubbio Collaborative Study Group. , 1989, Preventive medicine.

[28]  D. Ruzicki Measurement and evaluation in health education and health promotion , 1986 .

[29]  J. Ware,et al.  Interpreting SF&-36 summary health measures: A response , 2004, Quality of Life Research.

[30]  Kurt C Stange,et al.  One minute for prevention: the power of leveraging to fulfill the promise of health behavior counseling. , 2002, American journal of preventive medicine.

[31]  C. Jordens,et al.  Multiplying health gains: the critical role of capacity-building within health promotion programs. , 1997, Health policy.

[32]  W. Shadish,et al.  Experimental and Quasi-Experimental Designs for Generalized Causal Inference , 2001 .

[33]  P. Briss,et al.  Developing and using the Guide to Community Preventive Services: lessons learned about evidence-based public health. , 2004, Annual review of public health.

[34]  Felipe González Castro,et al.  The Cultural Adaptation of Prevention Interventions: Resolving Tensions Between Fidelity and Fit , 2004, Prevention Science.

[35]  M. Gold Cost-effectiveness in health and medicine , 2016 .

[36]  J. Dolovich,et al.  The need for extended treatment of anaphylaxis. , 1980, Canadian Medical Association journal.

[37]  David Haber,et al.  Guide to clinical preventive services: a challenge to physician resourcefulness , 1993 .

[38]  P. Maurette,et al.  [To err is human: building a safer health system]. , 2002, Annales francaises d'anesthesie et de reanimation.

[39]  C. Marano,et al.  To err is human. Building a safer health system , 2005 .

[40]  L. Walter,et al.  Pitfalls of converting practice guidelines into quality measures: lessons learned from a VA performance measure. , 2004, JAMA.

[41]  A. Inkeles,et al.  International Encyclopedia of the Social Sciences. , 1968 .

[42]  Thomas M Vogt,et al.  Evaluating the impact of health promotion programs: using the RE-AIM framework to form summary measures for decision making involving complex issues. , 2006, Health education research.

[43]  C. Gross,et al.  Reporting the Recruitment Process in Clinical Trials: Who Are These Patients and How Did They Get There? , 2002, Annals of Internal Medicine.

[44]  Douglas G. Altman,et al.  The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomised trials , 2001, The Lancet.

[45]  S. Lusk Health promotion planning: An educational and environmental approach: Lawrence W. Green and Marshall W. Kreuter Mayfield Publishing, Mountain View, California, 2nd edn. , 1992 .

[46]  R. Glasgow,et al.  Why don't we see more translation of health promotion research to practice? Rethinking the efficacy-to-effectiveness transition. , 2003, American journal of public health.

[47]  E. Finkelstein,et al.  Health promotion interventions for disadvantaged women: overview of the WISEWOMAN projects. , 2004, Journal of women's health.

[48]  A R Jadad,et al.  Assessing the quality of reports of randomized clinical trials: is blinding necessary? , 1996, Controlled clinical trials.

[49]  G. Parcel,et al.  Implementing Organizational Changes to Promote Healthful Diet and Physical Activity at School , 1988, Health education quarterly.

[50]  Patricia Dolan Mullen,et al.  Developing an Evidence-Based Guide to Community Preventive Services—Methods , 2000 .

[51]  S. Haack Trial and error: the Supreme Court's philosophy of science. , 2005, American journal of public health.

[52]  C. Basch,et al.  Avoiding Type III Errors in Health Education Program Evaluations: A Case Study , 1985, Health education quarterly.

[53]  L. Green,et al.  Commentary on the emerging Guide to Community Preventive Services from a health promotion perspective. , 2000, American journal of preventive medicine.

[54]  B. Smedley,et al.  Unequal Treatment: Con-fronting Racial and Ethnic Disparities in Health Care , 2002 .

[55]  B. Israel,et al.  Methods in Community-Based Participatory Research for Health , 2005 .

[56]  B. Luce,et al.  Evidence based? Caveat emptor! , 2005, Health affairs.

[57]  K. Glanz,et al.  Health Behavior and Health Education , 1990 .

[58]  E H Wagner,et al.  Chronic disease management: what will it take to improve care for chronic illness? , 1998, Effective clinical practice : ECP.

[59]  L. Green,et al.  Fighting back or fighting themselves? Community coalitions against substance abuse and their use of best practices. , 2002, American journal of preventive medicine.

[60]  K. W. Harris,et al.  The Guide to Community Preventive Services , 2005 .

[61]  L W Green,et al.  From research to "best practices" in other settings and populations. , 2001, American journal of health behavior.

[62]  J. Windeler [External validity]. , 2008, Zeitschrift fur Evidenz, Fortbildung und Qualitat im Gesundheitswesen.

[63]  Cathie M Scott,et al.  Health Promotion Planning: An Educational and Ecological Approach (3rd ed) , 2001 .

[64]  R H Brook,et al.  Efficacy, effectiveness, variations, and quality. Boundary-crossing research. , 1985, Medical care.

[65]  W F Velicer,et al.  Evaluating a population-based recruitment approach and a stage-based expert system intervention for smoking cessation. , 2001, Addictive behaviors.

[66]  Lisa M Klesges,et al.  Reporting of validity from school health promotion studies published in 12 leading journals, 1996-2000. , 2003, The Journal of school health.

[67]  Eva Nick,et al.  The dependability of behavioral measurements: theory of generalizability for scores and profiles , 1973 .

[68]  K. Weare Settings for Health Promotion: Linking Theory and Practice , 2000 .

[69]  Steven Yale Sussman,et al.  Handbook of Program Development for Health Behavior Research and Practice , 2001 .

[70]  Elizabeth Waters,et al.  Guidelines for systematic reviews of health promotion and public health interventions. , 2005 .

[71]  P. Hawe Needs assessment must become more change‐focused , 1996, Australian and New Zealand journal of public health.

[72]  D. Fleming,et al.  Scope and organization of the Guide to Community Preventive Services. The Task Force on Community Preventive Services. , 2000, American journal of preventive medicine.

[73]  L. Kohn,et al.  To Err Is Human : Building a Safer Health System , 2007 .

[74]  L. Green,et al.  Health Promotion Planning: An Educational and Environmental Approach , 1991 .

[75]  P. Basch Quality of health care delivered to adults in the United States. , 2003, The New England journal of medicine.

[76]  Paul A Estabrooks,et al.  TREND: an important step, but not enough. , 2004, American journal of public health.

[77]  Sheldon Krimsky,et al.  The weight of scientific evidence in policy and law. , 2005, American journal of public health.

[78]  M. Tinetti,et al.  Potential pitfalls of disease-specific guidelines for patients with multiple conditions. , 2004, The New England journal of medicine.

[79]  D. Simons-Morton,et al.  An Ecological Approach to the Prevention of Injuries Due to Drinking and Driving , 1989, Health education quarterly.

[80]  Don C Des Jarlais,et al.  Improving the reporting quality of nonrandomized evaluations of behavioral and public health interventions: the TREND statement. , 2004, American journal of public health.

[81]  Laurie M. Anderson,et al.  The challenges of systematically reviewing public health interventions. , 2004, Journal of public health.

[82]  David A. Kindig,et al.  Health literacy : a prescription to end confusion , 2004 .

[83]  B. Flay Efficacy and effectiveness trials (and other phases of research) in the development of health promotion programs. , 1986, Preventive medicine.

[84]  D. Stokols Establishing and maintaining healthy environments. Toward a social ecology of health promotion. , 1992, The American psychologist.

[85]  R. Glasgow,et al.  Evaluating the public health impact of health promotion interventions: the RE-AIM framework. , 1999, American journal of public health.

[86]  N. Duan,et al.  Interventions That are CURRES: Cost-Effective, Useful, Realistic, Robust, Evolving, and Sustainable , 2004 .

[87]  K Goldenberg,et al.  Periodic health examination , 1986, Journal of general internal medicine.

[88]  L. Schorr Common Purpose: Strengthening Families and Neighborhoods to Rebuild America , 1997 .

[89]  L. Green,et al.  Ecological Foundations of Health Promotion , 1996, American journal of health promotion : AJHP.

[90]  Paul A Estabrooks,et al.  Beginning with the application in mind: Designing and planning health behavior change interventions to enhance dissemination , 2005, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[91]  K. Glanz,et al.  An Ecological Perspective on Health Promotion Programs , 1988, Health education quarterly.

[92]  Valerie M. Sue,et al.  Glossary , 2022, Technology and the Historian.

[93]  H. Gerlach [What is evidence-based?]. , 2019, Krankenpflege Journal.

[94]  Robert H. Brook,et al.  Efficacy, Effectiveness, Variations, and Quality , 1991 .