Evaluating school capacity to implement new programs.

An eight-factor survey-based Bayesian model (Bridge-It) for assessing school capacity to implement health and education programs was tested in secondary analyses of data from 47 schools in the Texas Tobacco Prevention Initiative (TTPI). Bridge-It was used during the pre-implementation phase and again at mid-course of the TTPI 2 years later. Achieved implementation status was evaluated in follow-up almost 4 years after the start of the TTPI. The Bridge-It score aggregated across all eight of the capacity factors predicted both quality of adherence to the Guidelines for School Programs to Prevent Tobacco Use and Addiction and quantity of implementing activity. The school-based leadership factor was an independent predictor of quality of adherence whereas the facilitation processes factor predicted quantity of implementing activity. Integration of Bridge-It, or comparable multi-attribute tools, into the planning and evaluation of school-centered programs can increase understanding of factors that influence implementation and provide guidance for capacity building.

[1]  K. Jackson.  Tobacco Use, Access, and Exposure to Tobacco in Media Among Middle and High School Students – United States, 2004: , 2005 .

[2]  Cynthia Roberts-Gray,et al.  Bridge-It: A System for Predicting Implementation Fidelity for School-Based Tobacco Prevention Programs , 2006, Prevention Science.

[3]  A. Mcalister,et al.  Texas Tobacco Prevention Pilot Initiative: processes and effects. , 2004, Health education research.

[4]  Andrew V. Dane,et al.  Program integrity in primary and early secondary prevention: are implementation effects out of control? , 1998, Clinical psychology review.

[5]  Sue Scott,et al.  Implementation of a teacher-delivered sex education programme: obstacles and facilitating factors. , 2002, Health education research.

[6]  N. Volkow,et al.  Blending Prevention Research and Practice in Schools: Critical Issues and Suggestions , 2004, Prevention Science.

[7]  D. Olweus,et al.  Predicting Teachers' and Schools' Implementation of the Olweus Bullying Prevention Program: A Multilevel Study. , 2003 .

[8]  D. Satcher.  Guidelines for school health programs to prevent tobacco use and addiction. Centers for Disease Control and Prevention. , 1994, MMWR. Recommendations and reports : Morbidity and mortality weekly report. Recommendations and reports.

[9]  Mary Kay Rayens,et al.  Efficacy of training and fidelity of implementation of the life skills training program. , 2002, The Journal of school health.

[10]  C. Kam,et al.  Examining the Role of Implementation Quality in School-Based Prevention Using the PATHS Curriculum , 2003, Prevention Science.

[11]  D. Gottfredson,et al.  Quality of School-Based Prevention Programs: Results from a National Survey , 2002 .

[12]  L. Kann,et al.  Health education: results from the School Health Policies and Programs Study 2006. , 2007, The Journal of school health.

[13]  L. Kann,et al.  Reliability and validity of the School Health Policies and Programs Study 2000 questionnaires. , 2003, The Journal of school health.

[14]  Karen A. Blase,et al.  Implementation Research: A Synthesis of the , 2005 .

[15]  Delbert S. Elliott,et al.  Issues in Disseminating and Replicating Effective Prevention Programs , 2004, Prevention Science.

[16]  M. Mclaughlin,et al.  Federal Programs Supporting Educational Change, Vol. VIII: Implementing and Sustaining Innovations. , 1978 .

[17]  T. Baranowski,et al.  How best to measure implementation of school health curricula: a comparison of three measures. , 1998, Health education research.

[18]  M. Mclaughlin,et al.  Implementation of Educational Innovation , 1976 .

[19]  L. Kann,et al.  Health education: results from the School Health Policies and Programs Study 2000. , 2001, The Journal of school health.

[20]  Knowlton W. Johnson,et al.  Building capacity and sustainable prevention innovations: a sustainability planning model , 2004 .

[21]  Catherine J. Lillehoj,et al.  Program Provider and Observer Ratings of School-Based Preventive Intervention Implementation: Agreement and Relation to Youth Outcomes , 2004, Health education & behavior : the official publication of the Society for Public Health Education.

[22]  J. Kalafat,et al.  The relationship between implementation fidelity and educational outcomes in a school-based family support program: development of a model for evaluating multidimensional full-service programs. , 2007, Evaluation and program planning.

[23]  C. Roberts-Gray,et al.  Association of the presence of state and district health education policies with school tobacco prevention program practices. , 2007, The Journal of school health.

[24]  D. Hallfors,et al.  Will the 'principles of effectiveness' improve prevention practice? Early findings from a diffusion study. , 2002, Health education research.

[25]  Maurice J. Elias,et al.  Implementation, Sustainability, and Scaling Up of Social-Emotional and Academic Innovations in Public Schools , 2003 .

[26]  Linda Taylor,et al.  On Sustainability of Project Innovations as Systemic Change , 2003 .

[27]  S. Blake,et al.  Local school district adoption of state-recommended policies on HIV prevention education. , 2005, Preventive Medicine.

[28]  Susan S. Han,et al.  Sustainability of Teacher Implementation of School-Based Mental Health Programs , 2005, Journal of abnormal child psychology.

[29]  C. Roberts-Gray,et al.  A Bayesian model to predict the success of the implementation of health and education innovations in school-centered programs , 1999 .

[30]  D. Gottfredson,et al.  School Predictors of the Intensity of Implementation of School-Based Prevention Programs: Results from a National Study , 2006, Prevention Science.

[31]  M. Jeffries.  Know your body , 1976 .

[32]  M. Pentz.  Evidence-Based Prevention: Characteristics, Impact, and Future Direction , 2003, Journal of psychoactive drugs.

[33]  M. Mclaughlin,et al.  Federal Programs Supporting Educational Change , 1975 .

[34]  Michael Fullan,et al.  Leadership & Sustainability: System Thinkers in Action , 2004 .

[35]  Mathea Falco,et al.  Quality of implementation: developing measures crucial to understanding the diffusion of preventive interventions. , 2005, Health education research.

[36]  Peter K. Smith,et al.  The long‐term effectiveness of anti‐bullying work in primary schools , 1998 .

[37]  K. Kumpfer.  Prevention of alcohol and drug abuse: what works? , 2002, Substance abuse.

[38]  M. J. Lewis,et al.  The effect of two types of teacher training on implementation of Smart Choices: a tobacco prevention curriculum. , 1994, The Journal of school health.

[39]  C. Roberts-Gray.  “ Don ’ t know ” responses : Do they inform or undermine the process evaluation ? , 2003 .

[40]  Mathea Falco,et al.  A review of research on fidelity of implementation: implications for drug abuse prevention in school settings. , 2003, Health education research.

[41]  S. Ennett,et al.  Factors Associated with Fidelity to Substance Use Prevention Curriculum Guides in the Nation's Middle Schools , 2003, Health education & behavior : the official publication of the Society for Public Health Education.

[42]  C. Roberts-Gray,et al.  Follow-up comparisons of intervention and comparison schools in a state tobacco prevention and control initiative. , 2006, The Journal of school health.

[43]  P. Bush,et al.  A process evaluation of the District of Columbia "Know Your Body" project. , 1990, The Journal of school health.

[44]  Rafi Nachmias,et al.  Factors Involved in the Implementation of Pedagogical Innovations Using Technology , 2004, Education and Information Technologies.

[45]  M. Kohn,et al.  Effectiveness of School-Based Programs as a Component of a Statewide Tobacco Control Initiative , 2001 .