Evaluating youth development programs: Progress and promise

ABSTRACT Advances in theories of adolescent development and positive youth development have greatly increased our understanding of how programs and practices with adolescents can impede or enhance their development. In this article the authors reflect on the progress in research on youth development programs in the last two decades, since possibly the first review of empirical evaluations by Roth, Brooks-Gunn, Murray, and Foster (1998). The authors use the terms Version 1.0, 2.0, and 3.0 to refer to changes in youth development research and programs over time. They argue that advances in theory and descriptive accounts of youth development programs (Version 2.0) need to be coupled with progress in definitions of youth development programs, measurement of inputs and outputs that incorporate an understanding of programs as contexts for development, and stronger design and evaluation of programs (Version 3.0). The authors also advocate for an integration of prevention and promotion research, and for use of the term youth development rather than positive youth development.

[1]  Richard M. Lerner,et al.  Handbook of child psychology and developmental science , 2015 .

[2]  B. Watson.  Children's activities , 2013 .

[3]  R. Lerner,et al.  Positive Youth Development, Participation in Community Youth Development Programs, and Community Contributions of Fifth-Grade Adolescents , 2005 .

[4]  J. Spilt,et al.  For Whom Does It Work? Subgroup Differences in the Effects of a School-Based Universal Prevention Program , 2013, Prevention Science.

[5]  L. Borden,et al.  Community Youth Development: Programs, Policies, and Practices , 2003 .

[6]  J. Brooks-Gunn,et al.  Patterns of adolescents' participation in organized activities: are sports best when combined with other activities? , 2009, Developmental psychology.

[7]  M. Cater,et al.  From Then to Now: Emerging Directions for Youth Program Evaluation , 2011 .

[8]  A. Bohnert,et al.  Understanding threshold effects of organized activity involvement in adolescents: sex and family income as moderators. , 2012, Journal of adolescence.

[9]  David M. Hansen,et al.  Differing profiles of developmental experiences across types of organized youth activities. , 2006, Developmental psychology.

[10]  Stephanie M. Jones,et al.  Two-year impacts of a universal school-based social-emotional and literacy intervention: an experiment in translational developmental research. , 2011, Child development.

[11]  T. Farmer,et al.  Promoting Interpersonal Competence and Educational Success Through Extracurricular Activity Participation , 2003 .

[12]  Christina Theokas,et al.  Out-of-School Time Is Critical for Children: Who Participates in Programs? Research-to-Results Fact Sheet. Publication #2006-20. , 2006 .

[13]  Margaret R. Stone,et al.  Participation in Structured Youth Programs , 2007 .

[14]  R. Lerner,et al.  Nuances in early adolescent developmental trajectories of positive and problematic/risk behaviors: findings from the 4-H study of positive youth development. , 2007, Child and adolescent psychiatric clinics of North America.

[15]  Sara B. Heller,et al.  Preventing Youth Violence and Dropout: A Randomized Field Experiment , 2013 .

[16]  Joseph L Mahoney,et al.  Developing and Improving After-School Programs to Enhance Youth’s Personal Growth and Adjustment: A Special Issue of AJCP , 2010, American journal of community psychology.

[17]  R. Lerner,et al.  Patterns of Early Adolescents' Participation in Youth Development Programs Having Positive Youth Development Goals , 2009 .

[18]  R. Cairns,et al.  Do extracurricular activities protect against early school dropout? , 1997, Developmental psychology.

[19]  Daniel E. Bontempo,et al.  Effects of the Communities That Care Model in Pennsylvania on Change in Adolescent Risk and Problem Behaviors , 2010, Prevention Science.

[20]  Pittman Kj,et al.  A new vision: promoting youth development. Testimony of Karen Johnson Pittman Vice President Academy for Educational Development Director Center for Youth Development and Policy Research before the House Select Committee on Children Youth and Families. , 1991 .

[21]  R. Lerner,et al.  Handbook of Applied Developmental Science: Promoting Positive Child, Adolescent, and Family Development Through Research, Policies, and Programs , 2003 .

[22]  S. Simpkins,et al.  What Are Kids Getting into These Days? Demographic Differences in Youth Out-of School Time Participation. , 2006 .

[23]  Sue Betka,et al.  National Center for Education Evaluation and Regional Assistance , 2015 .

[24]  Jennifer A. Fredricks,et al.  Participation in boys and girls clubs: motivation and stage environment fit , 2010 .

[25]  The Evaluation of Enhanced Academic Instruction in After-School Programs: Findings After the First Year of Implementation. NCEE 2008-4021. , 2008 .

[26]  R. Larson,et al.  How Teens Become Engaged in Youth Development Programs: The Process of Motivational Change in a Civic Activism Organization , 2006 .

[27]  Edmond P. Bowers,et al.  Positive Youth Development Processes , Philosophies , and Programs , 2012 .

[28]  A. Arbreton,et al.  Safe Havens: The Contributions of Youth Organizations to Healthy Adolescent Development. , 1997 .

[29]  A. Bohnert,et al.  Capturing Unique Dimensions of Youth Organized Activity Involvement , 2010 .

[30]  Jacquelynne S. Eccles,et al.  Organized Activity Participation, Positive Youth Development, and the Over‐Scheduling Hypothesis , 2006 .

[31]  A. Cross,et al.  Effects of Participation in After-School Programs for Middle School Students: A Randomized Trial , 2010 .

[32]  S. Simpkins,et al.  Latino Adolescents' Participation in Extracurricular Activities: How Important Are Family Resources and Cultural Orientation? , 2011 .

[33]  M. Greenberg,et al.  Promoting healthy outcomes among youth with multiple risks: innovative approaches. , 2013, Annual review of public health.

[34]  R. Larson.  Positive Development in a Disorderly World , 2011 .

[35]  S. Simpkins,et al.  Adolescent out-of-school activities. , 2009 .

[36]  S. Bouffard,et al.  Participation in youth programs : enrollment, attendance, and engagement , 2005 .

[37]  B. J. Hirsch,et al.  More Than Attendance: The Importance of After-School Program Quality , 2010, American journal of community psychology.

[38]  P. Scales,et al.  Adolescent Thriving: The Role of Sparks, Relationships, and Empowerment , 2011, Journal of youth and adolescence.

[39]  Thomas D. Cook.  “BIG DATA” IN RESEARCH ON SOCIAL POLICY , 2014 .

[40]  Richard M. Lerner,et al.  Liberty: Thriving and Civic Engagement Among America′s Youth , 2004 .

[41]  S. Bouffard,et al.  More than just being there: balancing the participation equation. , 2005, New directions for youth development.

[42]  Amy F. Feldman,et al.  The Role of School-Based Extracurricular Activities in Adolescent Development: A Comprehensive Review and Future Directions , 2005 .

[43]  J. Brooks-Gunn,et al.  social science Rising: a Tale of Evidence shaping Public Policy , 2009 .

[44]  Kaylin M Greene,et al.  Examining Youth and Program Predictors of Engagement in Out-of-School Time Programs , 2012, Journal of Youth and Adolescence.

[45]  C. Brown,et al.  Promotion as Prevention: Positive Youth Development as Protective against Tobacco, Alcohol, Illicit Drug, and Sex Initiation , 2010 .

[46]  David J. Shernoff,et al.  Engagement in After-School Programs as a Predictor of Social Competence and Academic Performance , 2010, American journal of community psychology.

[47]  C. Midgley,et al.  Development during adolescence. The impact of stage-environment fit on young adolescents' experiences in schools and in families. , 1993, The American psychologist.

[48]  S. Simpkins,et al.  Promoting Positive Youth Development Through Organized After‐School Activities: Taking a Closer Look at Participation of Ethnic Minority Youth , 2012 .

[49]  Jennifer Brown Urban,et al.  The Role of Intentional Self Regulation, Lower Neighborhood Ecological Assets, and Activity Involvement in Youth Developmental Outcomes , 2010, Journal of youth and adolescence.

[50]  Jennifer Brown Urban,et al.  Youth development program participation and intentional self-regulation skills: contextual and individual bases of pathways to positive youth development. , 2011, Journal of adolescence.

[51]  Jennifer Brown Urban,et al.  The role of neighborhood ecological assets and activity involvement in youth developmental outcomes: Differential impacts of asset poor and asset rich neighborhoods , 2009 .

[52]  K. Dodge,et al.  The ecological effects of universal and selective violence prevention programs for middle school students: a randomized trial. , 2009, Journal of consulting and clinical psychology.

[53]  H. Stattin,et al.  Structured after‐school activities as a moderator of depressed mood for adolescents with detached relations to their parents , 2002 .

[54]  Kathrin C. Walker,et al.  New Horizons: Understanding the Processes and Practices of Youth Development , 2011 .

[55]  P. Simon.  Community Programs to Promote Youth Development , 2005 .

[56]  J. Brooks-Gunn,et al.  Promoting Healthy Adolescents: Synthesis of Youth Development Program Evaluations , 1998 .

[57]  M. Richards,et al.  Young Urban African American Adolescents' Experience of Discretionary Time Activities , 2008 .

[58]  Invited Commentary: Promotion and Prevention in Youth Development: Two Sides of the Same Coin? , 2014, Journal of youth and adolescence.

[59]  C. Herrera,et al.  The impact of school-based mentoring on youths with different relational profiles. , 2011, Developmental psychology.

[60]  J. Brooks-Gunn,et al.  Sports participation and juvenile delinquency: the role of the peer context among adolescent boys and girls with varied histories of problem behavior. , 2009, Developmental psychology.

[61]  Suzanne M. Bouffard,et al.  Predicting Youth Out-of-School Time Participation: Multiple Risks and Developmental Differences , 2008 .

[62]  Jacquelynne S. Eccles,et al.  Student Council, Volunteering, Basketball, or Marching Band , 1999 .

[63]  J. Brooks-Gunn,et al.  Does the neighborhood context alter the link between youth's after-school time activities and developmental outcomes? A multilevel analysis. , 2007, Developmental psychology.

[64]  Lauren H. Supplee,et al.  Erratum to: Introduction to the Special Issue: Subgroup Analysis in Prevention and Intervention Research , 2013, Prevention Science.

[65]  S. Schwartz,et al.  Addressing the Challenges and Opportunities for Today's Youth: Toward an Integrative Model and its Implications for Research and Intervention , 2007, The Journal of Primary Prevention.

[66]  Joseph A. Durlak,et al.  The Impact of After-School Programs that Promote Personal and Social Skills. , 2007 .

[67]  R. Catalano,et al.  Positive Youth Development in the United States: Research Findings on Evaluations of Positive Youth Development Programs , 2004 .

[68]  Howard S. Bloom,et al.  A Conceptual Framework for Studying the Sources of Variation in Program Effects , 2013 .

[69]  J. Garber,et al.  Organized Activity Participation and Internalizing and Externalizing Symptoms: Reciprocal Relations during Adolescence , 2008 .

[70]  Lauren H. Supplee,et al.  Introduction to the Special Issue: Subgroup Analysis in Prevention and Intervention Research , 2013, Prevention Science.

[71]  J. L. Mahoney,et al.  An ecological analysis of after-school program participation and the development of academic performance and motivational attributes for disadvantaged children. , 2005, Child development.

[72]  C. Midgley,et al.  Development during adolescence: The impact of stage-environment fit on young adolescents' experiences in schools and in families. , 1993 .

[73]  J. Rhodes.  The critical ingredient: caring youth-staff relationships in after-school settings. , 2004, New directions for youth development.

[74]  Joseph A Durlak,et al.  A Meta-Analysis of After-School Programs That Seek to Promote Personal and Social Skills in Children and Adolescents , 2010, American journal of community psychology.

[75]  Kristina L. Schmid,et al.  Trajectories of Positive and Negative Behaviors from Early- to Middle-Adolescence , 2010, Journal of youth and adolescence.

[76]  R. Lerner,et al.  Cognitive, Emotional, and Behavioral Components of Civic Action: Towards an Integrated Measure of Civic Engagement. , 2009 .

[77]  Kathrin C. Walker,et al.  Reflections on a Century of Youth Development Research and Practice , 2011 .

[78]  H. Stattin,et al.  Leisure activities and adolescent antisocial behavior: the role of structure and social context. , 2000, Journal of adolescence.

[79]  H. Marsh,et al.  Extracurricular School Activities: The Good, the Bad, and the Nonlinear , 2002 .

[80]  R. Granger.  Understanding and Improving the Effectiveness of After-School Practice , 2010, American journal of community psychology.

[81]  Lizabeth M. Malone,et al.  Does the Amount of Participation in Afterschool Programs Relate to Developmental Outcomes? A Review of the Literature , 2010, American journal of community psychology.

[82]  A. Bohnert,et al.  Examining the Potential of Community-Based After-School Programs for Latino Youth , 2010, American journal of community psychology.

[83]  G. Margolis,et al.  Show Me the Evidence: Obama's Fight for Rigor and Results in Social Policy , 2014 .

[84]  R. Catalano,et al.  A review of positive youth development programs that promote adolescent sexual and reproductive health. , 2010, The Journal of adolescent health : official publication of the Society for Adolescent Medicine.

[85]  R. Larson.  Toward a psychology of positive youth development. , 2000, The American psychologist.

[86]  J. Brooks-Gunn,et al.  What Exactly Is a Youth Development Program? Answers From Research and Practice , 2003 .

[87]  A. Bohnert,et al.  The Role of Organized Activities in Facilitating Social Adaptation Across the Transition to College , 2007 .

[88]  N. Yohalem,et al.  Inside the Black Box: Assessing and Improving Quality in Youth Programs , 2010, American journal of community psychology.

[89]  M. Greenberg,et al.  The effects of the fast track preventive intervention on the development of conduct disorder across childhood. , 2011, Child development.

[90]  H. Marsh.  Extracurricular activities: Beneficial extension of the traditional curriculum or subversion of academic goals? , 1992 .

[91]  C. Belfield,et al.  Guiding the Development and Use of Cost-Effectiveness Analysis in Education , 2015 .

[92]  K. Heck,et al.  Middle School Dropout? Enrollment Trends in the California 4-H Youth Development Program , 2008 .