Fidelity of implementation in a treatment effectiveness trial of Reconnecting Youth.

In 'a treatment effectiveness trial', a program is evaluated in a real-world setting, with an emphasis on achieving high implementation fidelity. Through fidelity assessment, the link between program implementation and outcomes is systematically evaluated and ultimately leads to a greater understanding of program success or failure. This paper reports the results of an implementation fidelity study of the 'Reconnecting Youth' (RY) prevention program. The research questions were (i) was the program implemented with fidelity? and (ii) did better fidelity predict better outcomes? RY is an indicated drug abuse prevention program for high school students that seeks to 'reconnect' high-risk youth to school before they drop out. The results reported here were part of a randomized controlled effectiveness trial of the RY prevention program conducted in two urban school districts in which 15 teachers taught 41 RY classes. Overall, implementation fidelity was high with an average 90% of core lessons being taught. Unexpectedly, increased quality of implementation predicted increased alcohol use and anger. Adherence (teaching more of the curriculum) predicted increased marijuana use, while exposure (student attendance) significantly increased bonding to high-risk peers, alcohol use and anger.

[1]  E. Robertson,et al.  Preventing Drug Use among Children and Adolescents: A Research-Based Guide for Parents, Educators, and Community Leaders. Second Edition. , 1997 .

[2]  R. Prinz,et al.  Promoting intervention fidelity. Conceptual issues, methods, and preliminary results from the EARLY ALLIANCE prevention trial. , 2001, American journal of preventive medicine.

[3]  R Kosterman,et al.  Changing teaching practices to promote achievement and bonding to school. , 1998, The American journal of orthopsychiatry.

[4]  E. Thompson,et al.  Prevention research program: reconnecting at-risk youth. , 1994, Issues in mental health nursing.

[5]  D. Hallfors,et al.  Evaluation of a High School Peer Group Intervention for At-Risk Youth , 2005, Journal of abnormal child psychology.

[6]  Mathea Falco,et al.  A review of research on fidelity of implementation: implications for drug abuse prevention in school settings. , 2003, Health education research.

[7]  E. Thompson,et al.  Preventing Adolescent Drug Abuse and High School Dropout through an Intensive School-Based Social Network Development Program , 1994, American journal of health promotion : AJHP.

[8]  J. Graham,et al.  Program integrity as a moderator of prevention program effectiveness: results for fifth-grade students in the adolescent alcohol prevention trial. , 1991, Journal of studies on alcohol.

[9]  Anthony S. Bryk,et al.  Hierarchical Linear Models: Applications and Data Analysis Methods , 1992 .

[10]  Daniel Solomon,et al.  Prevention Effects of the Child Development Project , 1996 .

[11]  R. Orwin Assessing program fidelity in substance abuse health services research. , 2000, Addiction.

[12]  Joop J. Hox,et al.  Applied Multilevel Analysis. , 1995 .

[13]  E. Thompson,et al.  A measure of adolescent potential for suicide (MAPS): development and preliminary findings. , 1994, Suicide & life-threatening behavior.

[14]  B. Flay Efficacy and effectiveness trials (and other phases of research) in the development of health promotion programs. , 1986, Preventive medicine.

[15]  E. Thompson,et al.  Using the suicide risk screen to identify suicidal adolescents among potential high school dropouts. , 1999, Journal of the American Academy of Child and Adolescent Psychiatry.

[16]  Andrew V. Dane,et al.  Program integrity in primary and early secondary prevention: are implementation effects out of control? , 1998, Clinical psychology review.

[17]  G. Botvin,et al.  Preventing adolescent drug abuse through a multimodal cognitive-behavioral approach: results of a 3-year study. , 1990, Journal of consulting and clinical psychology.

[18]  Grover J. Whitehurst,et al.  Outcomes of an emergent literacy intervention from Head Start through second grade. , 1999 .

[19]  G. Nelson,et al.  Implementation of the teenage health teaching modules: a case study. , 1988, Health education.

[20]  Hyung Min Kim,et al.  Efficacy vs effectiveness trial results of an indicated "model" substance abuse program: implications for public health. , 2006, American journal of public health.

[21]  T. Dishion,et al.  When interventions harm. Peer groups and problem behavior. , 1999, The American psychologist.