Using Connected Technologies in a Continuous Quality Improvement Approach in after-school Settings: The PAX Good Behavior Game

Abstract This demonstration study explored the use of connected technologies in a continuous quality improvement (CQI) approach to implementing evidence-based practices in after-school. Focus group with staff indicated enjoyment of technology and offered feedback for future development. Ecological momentary assessments (EMA) were gathered daily. Three randomized conditions were compared among 4 programs and 12 staff implementing PAX Good Behavior Game (PAX GBG). Analysis of variance (ANOVA), Post-Hoc Tukey, and chi-square analyses indicated that the tech-enhanced condition showed better implementation using scoreboards than the in person, while similar in game length. Both were superior to the control in behavioral strategies; highlighting the promise of technology in capacity building.

[1]  Bradford W Hesse,et al.  Progress on Broadband Access to the Internet and Use of Mobile Devices in the United States , 2017, Public health reports.

[2]  M. Wolf,et al.  Good behavior game: effects of individual contingencies for group consequences on disruptive behavior in a classroom. , 1969, Journal of applied behavior analysis.

[3]  S. Schinke,et al.  Alcohol Abuse Prevention Among High-Risk Youth , 2005, Journal of prevention & intervention in the community.

[4]  E. Smith,et al.  Positive Youth Development Among Diverse Racial-Ethnic Children: Quality Afterschool Contexts as Developmental Assets. , 2017, Child development.

[5]  Jacinta Bronte-Tinkew,et al.  Improving Attendance and Retention in Out-of-School Time Programs. Research-to-Results Practitioner Insights. Publication # 2007-17. , 2007 .

[6]  J. Durlak,et al.  Implementation Matters: A Review of Research on the Influence of Implementation on Program Outcomes and the Factors Affecting Implementation , 2008, American journal of community psychology.

[7]  H. Snyder,et al.  Juvenile Offenders and Victims: 1999 National Report. , 2006 .

[8]  Dennis D. Embry,et al.  Community-based prevention using simple, low-cost, evidence-based kernels and behavior vaccines , 2004 .

[9]  Dean L. Fixsen,et al.  Improving Programs and Outcomes , 2015 .

[10]  A. Turnbull,et al.  School-wide Positive Behavior Support: Addressing Behavior Problems that Impede Student Learning , 2006 .

[11]  Arthur C. Graesser,et al.  The Effects of a Traditional and Technology-based After-school Setting on 6th Grade Student’s Mathematics Skills , 2012 .

[12]  R. A. Wright,et al.  Class-Wide Positive Behavior Support and Group Contingencies , 2012 .

[13]  Alejandro Peña-Ayala,et al.  A Revision of the Literature Concerned with Mobile, Ubiquitous, and Pervasive Learning: A Survey , 2016 .

[14]  N. Ialongo,et al.  Online Training for Teachers Delivering Evidence-Based Preventive Interventions , 2014 .

[15]  Arthur C. Graesser,et al.  The impact of a technology-based mathematics after-school program using ALEKS on student's knowledge and behaviors , 2013, Comput. Educ..

[16]  A. Arbreton,et al.  Investing in Success: Key Strategies for Building Quality in After-School Programs , 2010, American journal of community psychology.

[17]  E. Foster,et al.  Can a costly intervention be cost-effective?: An analysis of violence prevention. , 2006, Archives of general psychiatry.

[18]  D. Vandell,et al.  Specific Features of After-School Program Quality: Associations with Children’s Functioning in Middle Childhood , 2010, American journal of community psychology.

[19]  Dawn K. Wilson,et al.  Promoting physical activity within under-resourced afterschool programs: A qualitative investigation of staff experiences and motivational strategies for engaging youth , 2018, Applied developmental science.

[20]  R. Weis,et al.  Effectiveness of a Universal, Interdependent Group Contingency Program on Children's Academic Achievement: A Countywide Evaluation , 2015 .

[21]  Daniel M. Maggin,et al.  A systematic evidence review of school-based group contingency interventions for students with challenging behavior. , 2012, Journal of school psychology.

[22]  Wei Wang,et al.  Effects of a universal classroom behavior management program in first and second grades on young adult behavioral, psychiatric, and social outcomes. , 2008, Drug and alcohol dependence.

[23]  Joseph A Durlak,et al.  A Meta-Analysis of After-School Programs That Seek to Promote Personal and Social Skills in Children and Adolescents , 2010, American journal of community psychology.

[24]  C. Bradshaw,et al.  Promoting Nurturing Environments in Afterschool Settings , 2017, Clinical Child and Family Psychology Review.

[25]  Brandy R. Maynard,et al.  Fidelity in After-School Program Intervention Research , 2013 .

[26]  R. MacCoun.  Experimental and Quasi‐Experimental Designs for Generalized Causal Inference, by William R. Shadish, Thomas D. Cook, and Donald T. Campbell. Boston: Houghton Mifflin, 2001, 623 pp., $65.56. , 2003 .

[27]  Helen Crompton,et al.  The Use of Mobile Learning in Science: A Systematic Review , 2016, Journal of Science Education and Technology.

[28]  Barbara Z. Tharp,et al.  Students' Attitudes Toward Science as Predictors of Gains on Student Content Knowledge: Benefits of an After-School Program. , 2015, School science and mathematics.

[29]  M. McManus,et al.  Top-Down, Bottom-Up, and Around the Jungle Gym: A Social Exchange and Networks Approach to Engaging Afterschool Programs in Implementing Evidence-Based Practices , 2014, American journal of community psychology.

[30]  Pannee Suanpang.  The Integration of m-Learning and Social Nework for Suporting Knowledge Sharing , 2012 .

[31]  Gary T. Henry,et al.  Formative Evaluation , 2013 .

[32]  D. Osgood,et al.  Promoting Afterschool Quality and Positive Youth Development: Cluster Randomized Trial of the Pax Good Behavior Game , 2018, Prevention Science.

[33]  S. Peck,et al.  Continuous Quality Improvement in Afterschool Settings: Impact findings from the Youth Program Quality Intervention Study , 2012 .

[34]  Steven J. Amendum,et al.  Live webcam coaching to help early elementary classroom teachers provide effective literacy instruction for struggling readers: The Targeted Reading Intervention. , 2013 .

[35]  T. Akiva,et al.  Simple Interactions: Piloting a Strengths-Based and Interaction-Based Professional Development Intervention for Out-of-School Time Programs , 2017 .

[36]  Janet Mannheimer Zydney,et al.  Mobile apps for science learning: Review of research , 2016, Comput. Educ..

[37]  Deborah Lowe Vandell,et al.  Quality of Afterschool Activities and Relative Change in Adolescent Functioning Over Two Years , 2013 .

[38]  A. Wandersman,et al.  Advances in Bridging Research and Practice: Introduction to the Second Special Issue on the Interactive System Framework for Dissemination and Implementation , 2012, American journal of community psychology.

[39]  D. Vandell,et al.  After-school activities and the development of low-income urban children: a longitudinal study. , 1999, Developmental psychology.

[40]  Tom Clark,et al.  Virtual Schools: Trends and Issues. A Study of Virtual Schools in the United States. , 2001 .

[41]  Thomas A. Brush,et al.  Integrating technology into K-12 teaching and learning: current knowledge gaps and recommendations for future research , 2007 .

[42]  J. Eccles,et al.  Features of Positive Developmental Settings. , 2004 .

[43]  Marcia E. Kraft-Sayre,et al.  Ongoing, Web-Mediated Professional Development Focused on Teacher–Child Interactions: Early Childhood Educators' Usage Rates and Self-Reported Satisfaction , 2009, Early education and development.

[44]  Ivica Boticki,et al.  Usage of a mobile social learning platform with virtual badges in a primary school , 2015, Comput. Educ..

[45]  W. Shadish,et al.  Experimental and Quasi-Experimental Designs for Generalized Causal Inference , 2001 .

[46]  Jennifer Duffy,et al.  Bridging the Gap Between Prevention Research and Practice: The Interactive Systems Framework for Dissemination and Implementation , 2008, American journal of community psychology.

[47]  How Is the Afterschool Field Defining Program Quality? A Review of Effective Program Practices and Definitions of Program Quality. , 2009 .

[48]  R. Shegog,et al.  A review of computer and Internet-based interventions for smoking behavior. , 2006, Addictive behaviors.

[49]  J. Smyth,et al.  Ecological Momentary Assessment Research in Behavioral medicine , 2003 .

[50]  Sanford Gold,et al.  A CONSTRUCTIVIST APPROACH TO ONLINE TRAINING FOR ONLINE TEACHERS , 2019, Online Learning.

[51]  D. Vandell,et al.  Low-income children's after-school care: are there beneficial effects of after-school programs? , 1994, Child development.

[52]  P. Strain,et al.  Peer-assisted interventions: Early promises, notable achievements, and future aspirations , 1990 .

[53]  Charles H. Hillman,et al.  Effects of the FITKids Randomized Controlled Trial on Executive Control and Brain Function , 2014, Pediatrics.

[54]  G. Fowler,et al.  Promoting prevention in primary care: controlled trial of low technology, low cost approach. , 1987, British medical journal.

[55]  G. Fowler,et al.  Promoting prevention in primary care , 1987 .

[56]  Xi Zhang,et al.  Mapping development of social media research through different disciplines: Collaborative learning in management and computer science , 2015, Comput. Hum. Behav..

[57]  Karen A. Blase,et al.  Statewide Implementation of Evidence-Based Programs , 2013 .

[58]  S. Thompson.  Social Learning Theory , 2008 .

[59]  L. Caldwell,et al.  Using the Interactive Systems Framework in Understanding the Relation Between General Program Capacity and Implementation in Afterschool Settings , 2012, American Journal of Community Psychology.

[60]  N. Yohalem,et al.  Inside the Black Box: Assessing and Improving Quality in Youth Programs , 2010, American journal of community psychology.

[61]  Dennis D. Embry,et al.  The Good Behavior Game: A Best Practice Candidate as a Universal Behavioral Vaccine , 2002, Clinical child and family psychology review.

[62]  Shahaboddin Shamshirband,et al.  A review of mobile pervasive learning: Applications and issues , 2015, Comput. Hum. Behav..

[63]  Alberto R. Gonzales,et al.  Office of Juvenile Justice and Delinquency Prevention , 1998 .

[64]  Yen-Chun Jim Wu,et al.  Review of trends from mobile learning studies: A meta-analysis , 2012, Comput. Educ..

[65]  R. Feinn,et al.  Impact of a positive youth development program in urban after-school settings on the prevention of adolescent substance use. , 2007, The Journal of adolescent health : official publication of the Society for Adolescent Medicine.