Using Participatory Action Research to Design an Intervention Integrity System in the Urban Schools

While integrity is often thought of as the degree to which a program is applied as intended, researchers have recently widened the lens to include not only monitoring of program content, but also evaluating the process by which interventions are implemented and the extent to which the intervention is received as intended. Further, a partnership-based approach has been identified to be as critical to facilitating appropriate and accurate monitoring and interpretation of intervention integrity in the cultural context. Building on these expanded definitions of intervention integrity, this study describes how an intervention monitoring system was developed through participatory research in the context of a classroom-based aggression prevention program for students in an inner-city elementary school. The system highlighted evaluation of the quality of intervention delivery and participant responsiveness. Factor analysis, descriptive statistics, and comparison to a less nuanced integrity monitoring system provided information on the informativeness of this new system. Preliminary investigation, however, suggested that future research is necessary to examine the extent to which differences in quality of implementation across classrooms predict clinically significant differences in program outcomes.

[1]  Shay Bilchik.  The importance of universal school-based programs in preventing violent and aggressive behavior. , 2007, American journal of preventive medicine.

[2]  Kristin D. Eisenbraun.  Violence in schools: Prevalence, prediction, and prevention , 2007 .

[3]  Barbara A. Israel,et al.  Process evaluation for public health interventions and research , 2002 .

[4]  R. Prinz,et al.  Treatment fidelity in outcome studies , 1991 .

[5]  Mathea Falco,et al.  Quality of implementation: developing measures crucial to understanding the diffusion of preventive interventions. , 2005, Health education research.

[6]  N. Crick,et al.  Relational aggression, gender, and social-psychological adjustment. , 1995, Child development.

[7]  Rachel Dinkes,et al.  Indicators of School Crime and Safety: 2013 , 2014 .

[8]  K. Dodge,et al.  Social cognition and children's aggressive behavior. , 1980, Child development.

[9]  M. Cassano,et al.  Initial Validation of a Knowledge-Based Measure of Social Information Processing and Anger Management , 2010, Journal of abnormal child psychology.

[10]  T. Power,et al.  Using participatory research to develop a playground-based prevention program , 2004 .

[11]  N. Crick,et al.  The role of overt aggression, relational aggression, and prosocial behavior in the prediction of children's future social adjustment. , 1996, Child development.

[12]  Elizabeth Talbott,et al.  "Somebody Else Making Somebody Else Fight": Aggression and the Social Context Among Urban Adolescent Girls , 2002 .

[13]  R. Cairns,et al.  Growth and aggression: I. Childhood to early adolescence. , 1989 .

[14]  S. McConnell,et al.  Factors Affecting the Impact of Social Interaction Skills Interventions in Early Childhood Special Education , 1993 .

[15]  L. Nabors,et al.  School-based Aggression Prevention Programs for Young Children: Current Status and Implications for Violence Prevention , 2001 .

[16]  A. Jawad,et al.  Social cognition in context: validating a cartoon-based attributional measure for urban girls. , 2006, Child development.

[17]  Mathea Falco,et al.  A review of research on fidelity of implementation: implications for drug abuse prevention in school settings. , 2003, Health education research.

[18]  Andy P. Field,et al.  Discovering Statistics Using SPSS , 2000 .

[19]  Alan E. Kazdin,et al.  Treatment Integrity and Therapeutic Change: Issues and Research Recommendations , 2006 .

[20]  Jennifer Spaeth,et al.  Task Force on Community Preventive Services , 2009 .

[21]  P. Kendall,et al.  Breathing life into a manual : Flexibility and creativity with manual-based treatments , 1998 .

[22]  Esteve Xavier Rifà Ros,et al.  FIELD, A. (2005). Discovering Statistics Using SPSS. London: SAGE Publications , 2006 .

[23]  M. Underwood,et al.  A developmental investigation of social aggression among children. , 1997, Developmental psychology.

[24]  Nancy E Adler,et al.  Community preventive services. Do we know what we need to know to improve health and reduce disparities? , 2003, American journal of preventive medicine.

[25]  Barbara Resnick,et al.  Enhancing treatment fidelity in health behavior change studies: best practices and recommendations from the NIH Behavior Change Consortium. , 2004, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[26]  A. Kazdin,et al.  Treatment integrity in psychotherapy research: analysis of the studies and examination of the associated factors. , 2007, Journal of consulting and clinical psychology.

[27]  R. Bucks,et al.  Review of SPSS 12 Made Simple (P.R. Kinnear & C.D. Gray) Psychology Press. , 2005 .

[28]  N. Jacobson,et al.  Testing the integrity of a psychotherapy protocol: assessment of adherence and competence. , 1993, Journal of consulting and clinical psychology.

[29]  W. Hartup,et al.  Developmental origins of aggression , 2005 .

[30]  Paul Kinnear,et al.  SPSS 14 Made Simple , 2000 .

[31]  N. Crick,et al.  Relational aggression: The role of intent attributions, feelings of distress, and provocation type , 1995, Development and Psychopathology.

[32]  Betsy E Feinberg,et al.  The Preventing Relational Aggression in Schools Everyday Program: A Preliminary Evaluation of Acceptability and Impact , 2010, School psychology review.

[33]  T. Good,et al.  Teaching Effects , 1977 .

[34]  Frank M. Gresham,et al.  Treatment integrity of school-based behavioral intervention studies: 1980–1990. , 1993 .

[35]  K. Varjas,et al.  The Participatory Intervention Model: A Framework for Conceptualizing and Promoting Intervention Acceptability , 2000 .

[36]  R. Hahn,et al.  Effectiveness of universal school-based programs to prevent violent and aggressive behavior: a systematic review. , 2007, American journal of preventive medicine.

[37]  A. Jawad,et al.  An Initial Evaluation of a Culturally Adapted Social Problem-Solving and Relational Aggression Prevention Program for Urban African-American Relationally Aggressive Girls , 2009, Journal of prevention & intervention in the community.

[38]  Andrew V. Dane,et al.  Program integrity in primary and early secondary prevention: are implementation effects out of control? , 1998, Clinical psychology review.

[39]  N. Crick,et al.  A short-term longitudinal study of growth of relational aggression during middle childhood: Associations with gender, friendship intimacy, and internalizing problems , 2007, Development and Psychopathology.

[40]  Sarah N. Woods,et al.  Direct and relational bullying among primary school children and academic achievement , 2004 .

[41]  T. Power,et al.  Reconceptualizing intervention integrity: A partnership‐based framework for linking research with practice , 2005 .

[42]  Paul R. Kinnear,et al.  SPSS 12 Made Simple. , 2005 .