Evaluating the public health impact of health promotion interventions: the RE-AIM framework.

Progress in public health and community-based interventions has been hampered by the lack of a comprehensive evaluation framework appropriate to such programs. Multilevel interventions that incorporate policy, environmental, and individual components should be evaluated with measurements suited to their settings, goals, and purpose. In this commentary, the authors propose a model (termed the RE-AIM model) for evaluating public health interventions that assesses 5 dimensions: reach, efficacy, adoption, implementation, and maintenance. These dimensions occur at multiple levels (e.g., individual, clinic or organization, community) and interact to determine the public health or population-based impact of a program or policy. The authors discuss issues in evaluating each of these dimensions and combining them to determine overall public health impact. Failure to adequately evaluate programs on all 5 dimensions can lead to a waste of resources, discontinuities between stages of research, and failure to improve public health to the limits of our capacity. The authors summarize strengths and limitations of the RE-AIM model and recommend areas for future research and application.

[1]  T J Vecchio,et al.  Predictive value of a single diagnostic test in unselected populations. , 1966, The New England journal of medicine.

[2]  D. Stilson,et al.  Probability and statistics in psychological research and theory , 1966 .

[3]  M. Mahoney,et al.  Self-control: power to the person , 1974 .

[4]  E. Wynder,et al.  Health economics and preventive care. , 1977, Science.

[5]  C. Bulpitt,et al.  Side effects of therapy in diabetes evaluated by a self-administered questionnaire. , 1977, Journal of chronic diseases.

[6]  Thomas F. Gilbert,et al.  Human Competence: Engineering Worthy Performance , 1978 .

[7]  S. S. Bailis.  Psychosocial Treatment of Chronic Mental Patients , 1978 .

[8]  T. Cook,et al.  Quasi-experimentation: Design & analysis issues for field settings , 1979 .

[9]  Alan E. Kazdin,et al.  Research Design in Clinical Psychology , 2021 .

[10]  J. Bloom,et al.  Hypertension labeling and sense of well-being. , 1981, American journal of public health.

[11]  J. Brady.  Behavior, the environment, and the health of the individual. , 1983, Preventive medicine.

[12]  J. Fox,et al.  Eating and its disorders. , 2012, Research publications - Association for Research in Nervous and Mental Disease.

[13]  Joseph D. Matarazzo,et al.  Behavioral health: A handbook of health enhancement and disease prevention , 1986 .

[14]  A. Bandura.  Social Foundations of Thought and Action: A Social Cognitive Theory , 1985 .

[15]  M. Mundinger,et al.  Health service funding cuts and the declining health of the poor. , 1985, The New England journal of medicine.

[16]  Cohodes Dr.  America: the home of the free, the land of the uninsured. , 1986 .

[17]  Design of cancer prevention studies. , 1986 .

[18]  C. Meinert.  Clinical Trials: Design, Conduct, and Analysis , 1986 .

[19]  J. Cullen.  Design of cancer prevention studies. , 1986, Cancer detection and prevention.

[20]  B. Flay.  Efficacy and effectiveness trials (and other phases of research) in the development of health promotion programs. , 1986, Preventive medicine.

[21]  A. Washton,et al.  Relapse Prevention: Maintenance Strategies in the Treatment of Addictive Behaviors , 1986 .

[22]  P. Conrad.  Who comes to work-site wellness programs? A preliminary review. , 1987, Journal of occupational medicine. : official publication of the Industrial Medical Association.

[23]  Clinical Trials—Time for a Paradigm Shift? , 1988, Diabetic medicine : a journal of the British Diabetic Association.

[24]  R. Goodman,et al.  How to Institutionalize Health Promotion Programs , 1989, American journal of health promotion : AJHP.

[25]  J E Fielding,et al.  Frequency of worksite health promotion activities. , 1989, American journal of public health.

[26]  L. Russell.  Some of the tough decisions required by a national health plan. , 1989, Science.

[27]  S Dandoy,et al.  A priority rating system for public health programs. , 1990, Public health reports.

[28]  G. Sorensen,et al.  Reducing the risk of cancer through worksite intervention. , 1990, Occupational medicine.

[29]  W B Schwartz,et al.  Rationing health care: the choice before us. , 1990, Science.

[30]  Community Intervention Trial for Smoking Cessation (COMMIT): summary of design and intervention. COMMIT Research Group. , 1991, Journal of the National Cancer Institute.

[31]  K. Emmons,et al.  Tobacco dependence: An integration of individual and public health perspectives , 1991 .

[32]  E H Wagner,et al.  Data analysis and sample size issues in evaluations of community-based health promotion and disease prevention programs: a mixed-model analysis of variance approach. , 1991, Journal of clinical epidemiology.

[33]  L. Green,et al.  Health Promotion Planning: An Educational and Environmental Approach , 1991 .

[34]  R. Glasgow,et al.  The social unit: an important facet in the design of cancer control research. , 1991, Preventive medicine.

[35]  S. Kaasa.  Measurement of quality of life in clinical trials. , 1992, Oncology.

[36]  M. Greenlick,et al.  Educating physicians for population-based clinical practice. , 1992, JAMA.

[37]  L. Pickle,et al.  The logistic modeling of sensitivity, specificity, and predictive value of a diagnostic test. , 1992, Journal of clinical epidemiology.

[38]  J. Wasson,et al.  Telephone care as a substitute for routine clinic follow-up. , 1992, JAMA.

[39]  R. Glasgow,et al.  Evaluating Diabetes Education: Are we measuring the most important outcomes? , 1992, Diabetes Care.

[40]  E Lichtenstein,et al.  Smoking cessation: what have we learned over the past decade? , 1992, Journal of consulting and clinical psychology.

[41]  D. Stokols.  Establishing and maintaining healthy environments. Toward a social ecology of health promotion. , 1992, The American psychologist.

[42]  J. Hollis,et al.  Nurse-Assisted Counseling for Smokers in Primary Care , 1993, Annals of Internal Medicine.

[43]  W. Browner,et al.  Should we be measuring blood cholesterol levels in young adults? , 1993, JAMA.

[44]  K. Glanz,et al.  Development and validation of measures of psychosocial factors influencing fat- and fiber-related dietary behavior. , 1993, Preventive medicine.

[45]  R. Glasgow,et al.  Participation in Worksite Health Promotion: A Critique of the Literature and Recommendations for Future Practice , 1993, Health education quarterly.

[46]  G. Giovino,et al.  Clean indoor air legislation, taxation, and smoking behaviour in the United States: an ecological analysis , 1993 .

[47]  B. Hillner,et al.  Efficacy and cost-effectiveness of cancer treatment: rational allocation of resources based on decision analysis. , 1993, Journal of the National Cancer Institute.

[48]  M. Perri,et al.  Strategies for Improving Maintenance of Weight Loss: Toward a continuous care model of obesity management , 1993, Diabetes Care.

[49]  C. Bradley.  Designing Medical and Educational Intervention Studies: A review of some alternatives to conventional randomized controlled trials , 1993, Diabetes Care.

[50]  J. Hollis,et al.  A Smoking-Cessation Intervention for Hospital Patients , 1993, Medical care.

[51]  R M Goodman,et al.  Development of Level of Institutionalization Scales for Health Promotion Programs , 1993, Health education quarterly.

[52]  T. Brennan,et al.  A Better-Quality Alternative: Single-Payer National Health System Reform , 1994 .

[53]  S M McKinlay,et al.  Cost-efficient designs of cluster unit trials. , 1994, Preventive medicine.

[54]  Radical Surgery:: What's Next for America's Health Care , 1994 .

[55]  F. Vinicor.  Is diabetes a public-health disorder? , 1994, Diabetes care.

[56]  R. Glasgow,et al.  Future directions for research on pediatric chronic disease management: lessons from diabetes. , 1995, Journal of pediatric psychology.

[57]  Benjamin C. Amick,et al.  Society and health , 1995 .

[58]  D. Sobel.  Rethinking medicine: improving health outcomes with cost-effective psychosocial interventions. , 1995, Psychosomatic medicine.

[59]  E. Fisher.  The results of the COMMIT trial. Community Intervention Trial for Smoking Cessation. , 1995, American journal of public health.

[60]  J. Graham,et al.  The cost effectiveness of three programs to increase use of bicycle helmets among children. , 1995, Public health reports.

[61]  D. Murray,et al.  Design and analysis of community trials: lessons from the Minnesota Heart Health Program. , 1995, American journal of epidemiology.

[62]  G. Clarke.  Improving the transition from basic efficacy research to effectiveness studies: methodological issues and procedures. , 1995, Journal of consulting and clinical psychology.

[63]  M. Susser.  The tribulations of trials--intervention in communities. , 1995, American journal of public health.

[64]  Anthony Biglan,et al.  Changing Cultural Practices: A Contextualist Framework for Intervention Research , 1995 .

[65]  D B Abrams,et al.  Integrating individual and public health perspectives for treatment of tobacco dependence under managed health care: A combined stepped-care and matching model , 1996, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[66]  R. Glasgow,et al.  How Generalizable are the Results of Diabetes Self-Management Research? The Impact of Participation and Attrition , 1996, The Diabetes educator.

[67]  L W Green,et al.  Dissemination and utilization of health promotion and disease prevention knowledge: theory, research and experience. , 1996, Canadian journal of public health = Revue canadienne de sante publique.

[68]  S. Gould.  Full House: The Spread of Excellence from Plato to Darwin , 1996 .

[69]  D. Stokols,et al.  The Ecology of Work and Health: Research and Policy Directions for the Promotion of Employee Health , 1996, Health education quarterly.

[70]  C. Rembold.  Number-needed-to-treat analysis of the prevention of myocardial infarction and death by antidyslipidemic therapy. , 1996, The Journal of family practice.

[71]  Farquhar Jw.  The case for dissemination research in health promotion and disease prevention. , 1996 .

[72]  Lifetime benefits and costs of intensive therapy as practiced in the diabetes control and complications trial. The Diabetes Control and Complications Trial Research Group. , 1996, JAMA.

[73]  D. Stokols.  Translating Social Ecological Theory into Guidelines for Community Health Promotion , 1996, American journal of health promotion : AJHP.

[74]  L. Green,et al.  Ecological Foundations of Health Promotion , 1996, American journal of health promotion : AJHP.

[75]  T. Athanasiou.  Divided Planet: The Ecology of Rich and Poor , 1996 .

[76]  Handbook of Health Behavior Research II , 1997, Springer US.

[77]  Richard L. Street,et al.  Health promotion and interactive technology : theoretical applications and future directions , 1997 .

[78]  Charles Weijer,et al.  Full House: The Spread of Excellence from Plato to Darwin. , 1997 .

[79]  Myke Gluck,et al.  Visual Explanations: Images and Quantities, Evidence and Narrative , 1997, Inf. Process. Manag..

[80]  G. Barnett,et al.  Maintaining the Confidentiality of Medical Records Shared over the Internet and the World Wide Web , 1997, Annals of Internal Medicine.

[81]  J. Schaefer,et al.  Collaborative Management of Chronic Illness , 1997, Annals of Internal Medicine.

[82]  R. Glasgow,et al.  A pragmatic framework for smoking cessation: Implications for clinical and public health programs. , 1997 .

[83]  A. Bandura.  Self-Efficacy: The Exercise of Control , 1997, Journal of Cognitive Psychotherapy.

[84]  Michael L. Dertouzos,et al.  What Will Be: How the New World of Information Will Change Our Lives , 1997 .

[85]  D. S. Gochman,et al.  Handbook of health behavior research , 1997 .

[86]  C S Berkey,et al.  Cancer incidence and mortality: the priority of screening frequency and population coverage. , 1997, The Milbank quarterly.

[87]  W. Downs,et al.  Control theory, labeling theory, and the delivery of services for drug abuse to adolescents. , 1997, Adolescence.

[88]  Pierre-Andre La Chance,et al.  Long-term effects and costs of brief behavioural dietary intervention for patients with diabetes delivered from the medical office. , 1997, Patient education and counseling.

[89]  Don Nutbeam,et al.  Evaluating Health Promotion—Progress, Problems and solutions , 1998 .

[90]  B. Starfield.  Quality-of-care research: internal elegance and external relevance. , 1998, JAMA.

[91]  Stevens Vj,et al.  The medical care system and prevention: the need for a new paradigm. , 1998, HMO practice.

[92]  Pierre-Andre La Chance,et al.  Cost-effectiveness of a hospital-based smoking cessation intervention. , 1998, Medical care.

[93]  D Johnston,et al.  Implications of the results of community intervention trials. , 1998, Annual Review of Public Health.

[94]  Andrew V. Dane,et al.  Program integrity in primary and early secondary prevention: are implementation effects out of control? , 1998, Clinical psychology review.

[95]  R. Glasgow,et al.  Issues in diabetes self-management. , 1998 .

[96]  C. Weinberg,et al.  Use and misuse of population attributable fractions. , 1998, American journal of public health.

[97]  J. Mckinlay,et al.  A tale of 3 tails. , 1999, American journal of public health.

[98]  R. Glasgow,et al.  Behavioral science in diabetes. Contributions and opportunities. , 1999, Diabetes care.

[99]  R. Glasgow,et al.  If diabetes is a public health problem, why not treat it as one? A population-based approach to chronic illness , 1999, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[100]  J. Hollis,et al.  Implementation and effectiveness of a brief smoking-cessation intervention for hospital patients. , 2000, Medical care.

[101]  D. Moher,et al.  Use of the CONSORT statement and quality of reports of randomized trials: a comparative before-and-after evaluation. , 2001, JAMA.