Bridge-It: A System for Predicting Implementation Fidelity for School-Based Tobacco Prevention Programs

Properly implemented school programs to prevent tobacco use and addiction can lower smoking prevalence up to 60%. However, numerous programs are not successful due to poor implementation. A system for estimating likelihood of future implementation fidelity of school-based prevention programs was tested using data collected at baseline and two year follow-up in 47 middle schools and high schools participating in the Texas Tobacco Prevention Initiative. The Bridge-It system includes an eight-factor, 36-item survey to analyze capacity for program implementation and a companion Bayesian model which provides estimations of likelihood of implementation fidelity several years after program initiation. The survey also asks about amount of implementing activity for each of the multiple components recommended in federal guidelines for school programs to prevent tobacco use. Criterion referenced cross-tabulations showed the system's forecast of implementation fidelity was correct in 74% of cases (p < .01). Model reliability was confirmed in regression analyses. Implementation fidelity at follow-up was predicted by the combination of the model's eight capacity factors at baseline. It includes program, implementation support, and non-program factors. Integration of the Bridge-It system, or comparable tools, into the dissemination and evaluation of school-based prevention programs can help to increase understanding of factors that influence implementation and provide guidance for capacity building. If administrators can identify at baseline schools likely to fall short of implementation goals, plans for resource allocation and provision of guidance, training, and technical assistance can be specifically tailored to identified needs.

[1]  Second Edition,et al.  Statistical Package for the Social Sciences , 1970 .

[2]  A. Steckler,et al.  Diffusion of Innovations in Schools: A Study of Adoption and Implementation of School-Based Tobacco Prevention Curricula , 1995, American journal of health promotion : AJHP.

[3]  Mary Kay Rayens,et al.  Efficacy of training and fidelity of implementation of the life skills training program. , 2002, The Journal of school health.

[4]  Mathea Falco,et al.  A review of research on fidelity of implementation: implications for drug abuse prevention in school settings. , 2003, Health education research.

[5]  S. Ennett,et al.  Factors Associated with Fidelity to Substance Use Prevention Curriculum Guides in the Nation's Middle Schools , 2003, Health education & behavior : the official publication of the Society for Public Health Education.

[6]  C. Roberts-Gray,et al.  A Bayesian model to predict the success of the implementation of health and education innovations in school-centered programs , 1999 .

[7]  Katherine Irwin,et al.  Blueprints for Violence Prevention , 2003 .

[8]  Freda Conway,et al.  Bayesian Statistics for Social Scientists. , 1974 .

[9]  J. Graham,et al.  Diffusion of a school-based substance abuse prevention program: predictors of program implementation. , 1993, Preventive medicine.

[10]  M. Greenberg.  Current and Future Challenges in School-Based Prevention: The Researcher Perspective , 2004, Prevention Science.

[11]  D D Allensworth,et al.  The comprehensive school health program: exploring an expanded concept. , 1987, The Journal of school health.

[12]  Andrew V. Dane,et al.  Program integrity in primary and early secondary prevention: are implementation effects out of control? , 1998, Clinical psychology review.

[13]  Gene E. Hall,et al.  Change in Schools: Facilitating the Process. SUNY Series in Educational Leadership. , 1987 .

[14]  Knowlton W. Johnson,et al.  Building capacity and sustainable prevention innovations: a sustainability planning model , 2004 .

[15]  Effectiveness of school-based programs as a component of a statewide tobacco control initiative--Oregon, 1999-2000. , 2001, MMWR. Morbidity and mortality weekly report.

[16]  M. Jeffries.  Know your body , 1976 .

[17]  P. Gingiss.  Enhancing program implementation and maintenance through a multiphase approach to peer-based staff development. , 1992, The Journal of school health.

[18]  C. Kam,et al.  Examining the Role of Implementation Quality in School-Based Prevention Using the PATHS Curriculum , 2003, Prevention Science.

[19]  Mark Greenberg,et al.  PROSPER Community–University Partnership Model for Public Education Systems: Capacity-Building for Evidence-Based, Competence-Building Prevention , 2004, Prevention Science.

[20]  G. Parcel,et al.  Translating theory into practice: Intervention strategies for the diffusion of a health promotion innovation , 1989 .

[21]  N. Gottlieb,et al.  Heart Partners: a strategy for promoting effective diffusion of school health promotion programs. , 1998, The Journal of school health.

[22]  D M Murray,et al.  A Meta-Analysis of Smoking Prevention Programs After Adjustment for Errors in the Unit of Analysis , 1996, Health education quarterly.

[23]  H. Adelman,et al.  Addressing barriers to learning: beyond school-linked services and full-service schools. , 1997, The American journal of orthopsychiatry.

[24]  Cynthia Roberts-Gray,et al.  Managing the implementation of innovations , 1985 .

[25]  D. Satcher.  Guidelines for school health programs to prevent tobacco use and addiction. Centers for Disease Control and Prevention. , 1994, MMWR. Recommendations and reports : Morbidity and mortality weekly report. Recommendations and reports.

[26]  M. Kohn,et al.  Effectiveness of School-Based Programs as a Component of a Statewide Tobacco Control Initiative , 2001 .

[27]  P. Bush,et al.  A process evaluation of the District of Columbia "Know Your Body" project. , 1990, The Journal of school health.

[28]  K. Kumpfer.  Prevention of alcohol and drug abuse: what works? , 2002, Substance abuse.

[29]  Mary Ann Scheirer,et al.  Program Implementation: The Organizational Context , 1981 .

[30]  Michael Fullan,et al.  Leadership & Sustainability: System Thinkers in Action , 2004 .

[31]  P. Gingiss.  Peer coaching: building collegial support for using innovative health programs. , 1993, The Journal of school health.

[32]  R. Saywell,et al.  Impact of the life skills training curriculum on middle school students tobacco use in Marion County, Indiana, 1997-2000. , 2003, The Journal of school health.

[33]  S. Blake,et al.  Local school district adoption of state-recommended policies on HIV prevention education. , 2005, Preventive Medicine.

[34]  Deborah Bybee,et al.  Fidelity Criteria: Development, Measurement, and Validation , 2003 .

[35]  K. Glanz,et al.  Health behavior and health education : theory, research, and practice , 1991 .

[36]  M. Pentz.  Evidence-Based Prevention: Characteristics, Impact, and Future Direction , 2003, Journal of psychoactive drugs.

[37]  Delbert S. Elliott,et al.  Issues in Disseminating and Replicating Effective Prevention Programs , 2004, Prevention Science.

[38]  A. Mcalister,et al.  Texas Tobacco Prevention Pilot Initiative: processes and effects. , 2004, Health education research.

[39]  G. Hall.  The Local Educational Change Process and Policy Implementation. , 2007 .

[40]  Peter K. Smith,et al.  The long‐term effectiveness of anti‐bullying work in primary schools , 1998 .

[41]  R. Goodman,et al.  Measuring the Diffusion of Innovative Health Promotion Programs , 1992, American journal of health promotion : AJHP.

[42]  Mary Ann Scheirer,et al.  Checking the congruence between a program and its organizational environment , 1988 .

[43]  Russell E. Glasgow,et al.  Work Site Health Promotion Research: To what Extent can we Generalize the Results and what is Needed to Translate Research to Practice? , 2003, Health education & behavior : the official publication of the Society for Public Health Education.