Could scale-up of parenting programmes improve child disruptive behaviour and reduce social inequalities? Using individual participant data meta-analysis to establish for whom programmes are effective and cost-effective

Background Child disruptive behavioural problems are a large and costly public health problem. The Incredible Years® (IY) parenting programme has been disseminated across the UK to prevent this problem and shown to be effective in several trials. It is vital for policy to know for which families IY is most effective, to be sure that it helps reduce, rather than widen, socioeconomic inequalities. Individual trials lack power and generalisability to examine differential effects; conventional meta-analysis lacks information about within-trial variability in effects. Objectives To overcome these limitations by pooling individual-level data from the IY parenting trials in Europe to examine to what extent it benefits socially disadvantaged families. Secondary objectives examine (1) additional moderators of effects on child behaviour, (2) wider health benefits and potential harms and (3) costs, cost-effectiveness and potential long-term savings. Design Individual participant data meta-analysis of 14 randomised trials of the IY parenting intervention. Settings UK (eight trials), the Netherlands, Ireland, Norway, Sweden and Portugal. Participants Data were from 1799 families, with children aged 2–10 years (mean 5.1 years; 63% boys). Interventions IY Basic parenting programme. Main outcome measures Primary outcome was disruptive child behaviour, determined by the Eyberg Child Behavior Inventory Intensity scale (ECBI-I). Secondary outcomes included self-reported parenting practices, parenting stress, mental health, children’s attention deficit hyperactivity disorder (ADHD) and emotional symptoms. Results There were no differential effects of IY on disruptive behaviour in families with different levels of social/socioeconomic disadvantage or differential effects for ethnic minority families, families with different parenting styles, or for children with comorbid ADHD or emotional problems or of different ages. Some moderators were found: intervention effects were strongest in children with more severe baseline disruptive behaviour, in boys, and in children with parents who were more depressed. Wider health benefits included reduced child ADHD symptoms, greater parental use of praise, and reduced harsh and inconsistent discipline. The intervention did not improve parental depression, stress, self-efficacy or children’s emotional problems. Economic data were available for five UK and Ireland trials (maximum n = 608). The average cost per person of the IY intervention was £2414. The probability that the IY intervention is considered cost-effective is 99% at a willingness to pay of £145 per 1-point improvement on the ECBI-I. Estimated longer-term savings over 20 years range from £1000 to £8400 per child, probably offsetting the cost of the intervention. Limitations Limitations include a focus on one parenting programme; the need to make assumptions in harmonising data; and the fact that data addressed equalities in the effectiveness of, not access to, the intervention. Conclusions There is no evidence that the benefits of the IY parenting intervention are reduced in disadvantaged or minority families; benefits are greater in the most distressed families, including parents who are depressed. Thus, the intervention is unlikely to widen socioeconomic inequalities in disruptive behaviour and may have effects in narrowing inequalities due to parent depression. It was as likely to be effective for older as for younger children. It has wider benefits for ADHD and parenting and is likely to be considered to be cost-effective. Researchers/funders should encourage data sharing to test equity and other moderator questions for other interventions; further research is needed on enhancing equality of access to interventions.

[1]  R. Edwards,et al.  The effectiveness of the Incredible Years pre-school parenting programme in the United Kingdom: a pragmatic randomised controlled trial , 2017 .

[2]  B. Orobio de Castro,et al.  Sustained, fade-out or sleeper effects? A systematic review and meta-analysis of parenting interventions for disruptive child behavior. , 2017, Clinical psychology review.

[3]  B. Orobio de Castro,et al.  Effectiveness of the Incredible Years Parenting Program for Families with Socioeconomically Disadvantaged and Ethnic Minority Backgrounds , 2017, Journal of clinical child and adolescent psychology : the official journal for the Society of Clinical Child and Adolescent Psychology, American Psychological Association, Division 53.

[4]  P. Montgomery,et al.  Transporting Evidence-Based Parenting Programs for Child Problem Behavior (Age 3–10) Between Countries: Systematic Review and Meta-Analysis , 2016, Journal of clinical child and adolescent psychology : the official journal for the Society of Clinical Child and Adolescent Psychology, American Psychological Association, Division 53.

[5]  G. Melendez‐Torres,et al.  Transported Versus Homegrown Parenting Interventions for Reducing Disruptive Child Behavior: A Multilevel Meta-Regression Study. , 2016, Journal of the American Academy of Child and Adolescent Psychiatry.

[6]  M. Sanders,et al.  Preventing child maltreatment in low- and middle-income countries: Parent support programs have the potential to buffer the effects of poverty. , 2016, Child abuse & neglect.

[7]  J. Weisz,et al.  Annual Research Review: Building a science of personalized intervention for youth mental health. , 2016, Journal of child psychology and psychiatry, and allied disciplines.

[8]  D. Hawes,et al.  Externalizing and Internalizing Comorbidity , 2015 .

[9]  C. Stride,et al.  Income gradients within child and adolescent antisocial behaviours. , 2015, The British journal of psychiatry : the journal of mental science.

[10]  M. C. Canavarro,et al.  Incredible Years Parent Training: Does it Improve Positive Relationships in Portuguese Families of Preschoolers with Oppositional/Defiant Symptoms? , 2015 .

[11]  Victoria Baker The Incredible Years , 2015 .

[12]  H. Meltzer,et al.  How do child and adolescent mental health problems influence public sector costs? Interindividual variations in a nationally representative British sample. , 2015, Journal of child psychology and psychiatry, and allied disciplines.

[13]  L. Stewart,et al.  Preferred Reporting Items for Systematic Review and Meta-Analyses of individual participant data: the PRISMA-IPD Statement. , 2015, JAMA.

[14]  Joerg Drechsler Multiple Imputation of Multilevel Missing Data—Rigor Versus Simplicity , 2015 .

[15]  R. Forehand,et al.  Is parenting the mediator of change in behavioral parent training for externalizing problems of youth? , 2014, Clinical psychology review.

[16]  Marina Danckaerts,et al.  Behavioral interventions in attention-deficit/hyperactivity disorder: a meta-analysis of randomized controlled trials across multiple outcome domains. , 2014, Journal of the American Academy of Child and Adolescent Psychiatry.

[17]  E. Taylor,et al.  Use of services and associated costs for young adults with childhood hyperactivity/conduct problems: 20-year follow-up , 2014, British Journal of Psychiatry.

[18]  S. Scott,et al.  Early prevention of antisocial personality: long-term follow-up of two randomized controlled trials comparing indicated and selective approaches. , 2014, The American journal of psychiatry.

[19]  M. Seabra-Santos,et al.  A parent-based intervention programme involving preschoolers with AD/HD behaviours: are children’s and mothers’ effects sustained over time? , 2014, European Child & Adolescent Psychiatry.

[20]  K. Sylva,et al.  Which type of parenting programme best improves child behaviour and reading? Follow-up of the Helping Children Achieve trial , 2014 .

[21]  S. McGilloway,et al.  Barriers and Facilitators to Implementing Evidence-Based Parenting Programs in Disadvantaged Settings: A qualitative Study , 2014, Journal of Child and Family Studies.

[22]  B. O. de Castro,et al.  A Trial of Parent Training for Mothers Being Released From Incarceration and Their Children , 2014, Journal of clinical child and adolescent psychology : the official journal for the Society of Clinical Child and Adolescent Psychology, American Psychological Association, Division 53.

[23]  M. Stevens The cost‐effectiveness of UK parenting programmes for preventing children's behaviour problems – a review of the evidence , 2014 .

[24]  S. McGilloway,et al.  Reducing child conduct disordered behaviour and improving parent mental health in disadvantaged families: a 12-month follow-up and cost analysis of a parenting intervention , 2014, European Child & Adolescent Psychiatry.

[25]  D. Shaw,et al.  Outcomes of Parenting Interventions for Child Conduct Problems: A Review of Differential Effectiveness , 2014, Child Psychiatry & Human Development.

[26]  E. Mayo-Wilson,et al.  Protocol for CONSORT-SPI: an extension for social and psychological interventions , 2013, Implementation Science.

[27]  H. Meltzer,et al.  Economic impact of childhood psychiatric disorder on public sector services in Britain: estimates from national survey data. , 2013, Journal of child psychology and psychiatry, and allied disciplines.

[28]  S. Stewart-Brown,et al.  Effectiveness and cost-effectiveness of a universal parenting skills programme in deprived communities: multicentre randomised controlled trial , 2013, BMJ Open.

[29]  M. Seabra-Santos,et al.  The Incredible Years Basic Parent Training for Portuguese Preschoolers with AD/HD Behaviors: Does it Make a Difference? , 2013 .

[30]  B. O. de Castro,et al.  Does Socioeconomic Status Matter? A Meta-Analysis on Parent Training Effectiveness for Disruptive Child Behavior , 2013, Journal of clinical child and adolescent psychology : the official journal for the Society of Clinical Child and Adolescent Psychology, American Psychological Association, Division 53.

[31]  J. Glennon,et al.  Conduct disorders , 2013, European Child & Adolescent Psychiatry.

[32]  David Coghill,et al.  Nonpharmacological interventions for ADHD: systematic review and meta-analyses of randomized controlled trials of dietary and psychological treatments. , 2013, The American journal of psychiatry.

[33]  S. McGilloway,et al.  A cost-effectiveness analysis of the Incredible Years parenting programme in reducing childhood health inequalities , 2013, The European Journal of Health Economics.

[34]  R. Taylor,et al.  The Impact of Three Evidence-Based Programmes Delivered in Public Systems in Birmingham, UK , 2012 .

[35]  T. O'Connor,et al.  An experimental test of differential susceptibility to parenting among emotionally-dysregulated children in a randomized controlled trial for oppositional behavior. , 2012, Journal of child psychology and psychiatry, and allied disciplines.

[36]  B. Orobio de Castro,et al.  ORCHIDS: an Observational Randomized Controlled Trial on Childhood Differential Susceptibility , 2012, BMC Public Health.

[37]  S. McGilloway,et al.  The Incredible Years Parenting program in Ireland: A qualitative analysis of the experience of disadvantaged parents , 2012, Clinical child psychology and psychiatry.

[38]  David Moher,et al.  PRISMA-Equity 2012 Extension: Reporting Guidelines for Systematic Reviews with a Focus on Health Equity , 2012, PLoS medicine.

[39]  C. Whitaker,et al.  Improvements in Maternal Depression as a Mediator of Child Behaviour Change , 2012 .

[40]  Peter Tugwell,et al.  What types of interventions generate inequalities? Evidence from systematic reviews , 2012, Journal of Epidemiology & Community Health.

[41]  Stephen Scott Parenting quality and children's mental health: biological mechanisms and psychological interventions , 2012, Current opinion in psychiatry.

[42]  Ulf Axberg,et al.  Evaluation of "the incredible years" in Sweden: the transferability of an American parent-training program to Sweden. , 2012, Scandinavian journal of psychology.

[43]  S. McGilloway,et al.  Behavioural and cognitive-behavioural group-based parenting programmes for early-onset conduct problems in children aged 3 to 12 years. , 2012, The Cochrane database of systematic reviews.

[44]  S. McGilloway,et al.  A parenting intervention for childhood behavioral problems: a randomized controlled trial in disadvantaged community-based settings. , 2012, Journal of consulting and clinical psychology.

[45]  H. van Engeland,et al.  Sustained Effects of Incredible Years as a Preventive Intervention in Preschool Children with Conduct Problems , 2011, Journal of abnormal child psychology.

[46]  J. Beecham,et al.  Costs and longer-term savings of parenting programmes for the prevention of persistent conduct disorder: a modelling study , 2011, BMC public health.

[47]  A. Pickles,et al.  An emerging income differential for adolescent emotional problems. , 2011, Journal of child psychology and psychiatry, and allied disciplines.

[48]  D. King,et al.  Economic outcomes in adulthood and their associations with antisocial conduct, attention deficit and anxiety problems in childhood. , 2011, The journal of mental health policy and economics.

[49]  C. Webster-Stratton,et al.  The impact of the Incredible Years parent, child, and teacher training programs on children's co-occurring internalizing symptoms. , 2011, School psychology quarterly : the official journal of the Division of School Psychology, American Psychological Association.

[50]  A. Pickles,et al.  Do changes in parent mental health explain trends in youth emotional problems? , 2011, Social science & medicine.

[51]  A. Piquero,et al.  Impact of offending trajectories on health: disability, hospitalisation and death in middle-aged men in the Cambridge Study in Delinquent Development. , 2011, Criminal behaviour and mental health : CBMH.

[52]  Sandy Oliver,et al.  Damned if you do, damned if you don't: subgroup analysis and equity , 2011, Journal of Epidemiology & Community Health.

[53]  M. Marmot,et al.  What role for the home learning environment and parenting in reducing the socioeconomic gradient in child development? Findings from the Millennium Cohort Study , 2011, Archives of Disease in Childhood.

[54]  R. Calam,et al.  Intention to attend parenting programmes: does ethnicity make a difference? , 2011 .

[55]  S. Goodman,et al.  Maternal Depression and Child Psychopathology: A Meta-Analytic Review , 2011, Clinical child and family psychology review.

[56]  C. Webster-Stratton,et al.  Combining Parent and Child Training for Young Children with ADHD , 2011, Journal of clinical child and adolescent psychology : the official journal for the Society of Clinical Child and Adolescent Psychology, American Psychological Association, Division 53.

[57]  I. White,et al.  Multiple imputation using chained equations: Issues and guidance for practice , 2011, Statistics in medicine.

[58]  Stephen Scott,et al.  Impact of a parenting program in a high-risk, multi-ethnic community: the PALS trial. , 2010, Journal of child psychology and psychiatry, and allied disciplines.

[59]  D. Farrington,et al.  Risk Factors for Conduct Disorder and Delinquency: Key Findings from Longitudinal Studies , 2010, Canadian journal of psychiatry. Revue canadienne de psychiatrie.

[60]  J. Higgins,et al.  Cochrane Handbook for Systematic Reviews of Interventions , 2010, International Coaching Psychology Review.

[61]  C. Whitaker,et al.  Who Benefits and How Does It Work? Moderators and Mediators of Outcome in an Effectiveness Trial of a Parenting Intervention , 2010, Journal of clinical child and adolescent psychology : the official journal for the Society of Clinical Child and Adolescent Psychology, American Psychological Association, Division 53.

[62]  Douglas G Altman,et al.  Reporting and interpretation of randomized controlled trials with statistically nonsignificant results for primary outcomes. , 2010, JAMA.

[63]  C. Webster-Stratton,et al.  Adapting The Incredible Years, an evidence‐based parenting programme, for families involved in the child welfare system , 2010 .

[64]  R. Riley,et al.  Meta-analysis of individual participant data: rationale, conduct, and reporting , 2010, BMJ : British Medical Journal.

[65]  J. Heckman,et al.  The Rate of Return to the High/Scope Perry Preschool Program , 2009, Journal of public economics.

[66]  R. Edwards,et al.  Long-term effectiveness of a parenting intervention for children at risk of developing conduct disorder , 2009, British Journal of Psychiatry.

[67]  J. Belsky,et al.  The intergenerational transmission of parenting: introduction to the special section. , 2009, Developmental psychology.

[68]  T. Dishion,et al.  Moderators of outcome in a brief family-centered intervention for preventing early problem behavior. , 2009, Journal of consulting and clinical psychology.

[69]  Harris Cooper,et al.  The relative benefits of meta-analysis conducted with individual participant data versus aggregated data. , 2009, Psychological methods.

[70]  J. Anthony,et al.  "Queremos aprender": Latino immigrants' call to integrate cultural adaptation with best practice knowledge in a parenting intervention. , 2009, Family process.

[71]  Peter Heywood,et al.  How and why do interventions that increase health overall widen inequalities within populations , 2009 .

[72]  H. Kim,et al.  Intergenerational transmission of internalising and externalising behaviours across three generations: gender-specific pathways. , 2009, Criminal behaviour and mental health : CBMH.

[73]  T. Dishion,et al.  Improvements in maternal depression as a mediator of intervention effects on early childhood problem behavior , 2009, Development and Psychopathology.

[74]  G. Dunn,et al.  Cost variation in child and adolescent psychiatric inpatient treatment , 2009, European Child and Adolescent Psychiatry.

[75]  J. Gerris,et al.  The Relationship Between Parenting and Delinquency: A Meta-analysis , 2009, Journal of abnormal child psychology.

[76]  Cheri J. Shapiro,et al.  Population-Based Prevention of Child Maltreatment: The U.S. Triple P System Population Trial , 2009, Prevention Science.

[77]  Matthew A. Jarrett,et al.  Comorbidity as a predictor and moderator of treatment outcome in youth with anxiety, affective, attention deficit/hyperactivity disorder, and oppositional/conduct disorders. , 2008, Clinical psychology review.

[78]  David Moher,et al.  Addressing Reporting Biases , 2008 .

[79]  Lesley A. Stewart,et al.  Reviews of Individual Patient Data , 2008 .

[80]  T. Dishion,et al.  The family check-up with high-risk indigent families: preventing problem behavior by increasing parents' positive behavior support in early childhood. , 2008, Child development.

[81]  J. Ioannidis,et al.  Systematic Review of the Empirical Evidence of Study Publication Bias and Outcome Reporting Bias , 2008, PloS one.

[82]  J. Ermisch Origins of Social Immobility and Inequality: Parenting and Early Child Development , 2008, National Institute Economic Review.

[83]  S. Stewart-Brown,et al.  Parenting and health in mid-childhood: a longitudinal study. , 2008, European journal of public health.

[84]  D. Daley,et al.  Efficacy of the Incredible Years Programme as an early intervention for children with conduct problems and ADHD: long-term follow-up. , 2008, Child: care, health and development.

[85]  Antonio J. Polo,et al.  Evidence-Based Psychosocial Treatments for Ethnic Minority Youth , 2008, Journal of clinical child and adolescent psychology : the official journal for the Society of Clinical Child and Adolescent Psychology, American Psychological Association, Division 53.

[86]  Heidemarie K. Laurent,et al.  Prevention of Behavior Problems for Children in Foster Care: Outcomes and Mediation Effects , 2008, Prevention Science.

[87]  J. Barlow,et al.  Parenting programmes: a systematic review and synthesis of qualitative research. , 2007, Child: care, health and development.

[88]  M. Knapp,et al.  “The trouble with QALYs…” , 2007, Epidemiology and Psychiatric Sciences.

[89]  T. Dishion,et al.  The Ethnic Context of Child and Adolescent Problem Behavior: Implications for Child and Family Interventions , 2007, Clinical child and family psychology review.

[90]  Richie Poulton,et al.  Prediction of differential adult health burden by conduct problem subtypes in males. , 2007, Archives of general psychiatry.

[91]  R. Edwards,et al.  Parenting programme for parents of children at risk of developing conduct disorder: cost effectiveness analysis , 2007, BMJ : British Medical Journal.

[92]  R. Edwards,et al.  Parenting intervention in Sure Start services for children at risk of developing conduct disorder: pragmatic randomised controlled trial , 2007, BMJ : British Medical Journal.

[93]  Jon Davies Is Sure Start an Effective Preventive Intervention? , 2007, Child and adolescent mental health.

[94]  F. Gardner,et al.  Randomised controlled trial of a parenting intervention in the voluntary sector for reducing child conduct problems: outcomes and mechanisms of change. , 2006, Journal of child psychology and psychiatry, and allied disciplines.

[95]  S. van Buuren,et al.  Multiple Imputation of Multilevel Data , 2006 .

[96]  M. Rutter,et al.  Is Sure Start an Effective Preventive Intervention? , 2006, Child and adolescent mental health.

[97]  S. Stewart-Brown,et al.  Individual and group-based parenting programmes for the treatment of physical child abuse and neglect. , 2006, The Cochrane database of systematic reviews.

[98]  J. Heckman Skill Formation and the Economics of Investing in Disadvantaged Children , 2006, Science.

[99]  M. Knapp,et al.  Economic cost of severe antisocial behaviour in children - and who pays it , 2006, British Journal of Psychiatry.

[100]  Jerome P. Reiter,et al.  The importance of modeling the sampling design in multiple imputation for missing data , 2006 .

[101]  David B. Wilson,et al.  The Strengthening Washington D.C. Families Project: A Randomized Effectiveness Trial of Family-Based Prevention , 2006, Prevention Science.

[102]  P. Tugwell,et al.  Applying clinical epidemiological methods to health equity: the equity effectiveness loop , 2006, BMJ : British Medical Journal.

[103]  David P. Mackinnon,et al.  Demonstration and evaluation of a method for assessing mediated moderation , 2006, Behavior research methods.

[104]  Lauren H. Supplee,et al.  Randomized trial of a family-centered approach to the prevention of early conduct problems: 2-year effects of the family check-up in early childhood. , 2006, Journal of consulting and clinical psychology.

[105]  S. Stewart-Brown,et al.  The effectiveness and cost-effectiveness of parent training/education programmes for the treatment of conduct disorder, including oppositional defiant disorder, in children. , 2005, Health technology assessment.

[106]  M. Nock,et al.  Randomized controlled trial of a brief intervention for increasing participation in parent management training. , 2005, Journal of consulting and clinical psychology.

[107]  D. Fergusson,et al.  Show me the child at seven: the consequences of conduct problems in childhood for psychosocial functioning in adulthood. , 2005, Journal of child psychology and psychiatry, and allied disciplines.

[108]  C. Webster-Stratton,et al.  Mediators, moderators, and predictors of 1-year outcomes among children treated for early-onset conduct problems: a latent growth curve analysis. , 2005, Journal of consulting and clinical psychology.

[109]  Risto Lehtonen,et al.  Multilevel Statistical Models , 2005 .

[110]  J. Brooks-Gunn,et al.  The Contribution of Parenting to Ethnic and Racial Gaps in School Readiness , 2005, The Future of children.

[111]  Simon G Thompson,et al.  Can meta-analysis help target interventions at individuals most likely to benefit? , 2005, The Lancet.

[112]  R. Edwards,et al.  Economic evaluation of treatments for children with severe behavioural problems. , 2004, The journal of mental health policy and economics.

[113]  P. Royston,et al.  A new approach to modelling interactions between treatment and continuous covariates in clinical trials by using fractional polynomials , 2004, Statistics in medicine.

[114]  David P MacKinnon,et al.  How did it work? Who did it work for? Mediation in the context of a moderated prevention effect for children of divorce. , 2004, Journal of consulting and clinical psychology.

[115]  C. Webster-Stratton,et al.  Halting the Development of Conduct Problems in Head Start Children: The Effects of Parent Training , 2004, Journal of clinical child and adolescent psychology : the official journal for the Society of Clinical Child and Adolescent Psychology, American Psychological Association, Division 53.

[116]  Thomas J. Dishion,et al.  The family check-up with high-risk young adolescents: Preventing early-onset substance use by parent monitoring , 2003 .

[117]  J. Henry,et al.  The Depression Anxiety Stress Scales (DASS): normative data and latent structure in a large non-clinical sample. , 2003, The British journal of clinical psychology.

[118]  Mark W. Lipsey,et al.  Those Confounded Moderators in Meta-Analysis: Good, Bad, and Ugly , 2003 .

[119]  J. Coid,et al.  Early Prevention of Adult Antisocial Behaviour: Contents , 2003 .

[120]  S. Stewart-Brown,et al.  Improving mental health through parenting programmes: block randomised controlled trial , 2002, Archives of disease in childhood.

[121]  K. Kumpfer,et al.  Cultural Sensitivity and Adaptation in Family-Based Prevention Interventions , 2002, Prevention Science.

[122]  K. Bierman Predictor Variables Associated with Positive Fast Track Outcomes at the End of Third Grade , 2002, Journal of abnormal child psychology.

[123]  C. Webster-Stratton,et al.  Parent Training in Head Start: A Comparison of Program Response Among African American, Asian American, Caucasian, and Hispanic Mothers , 2001, Prevention Science.

[124]  P. McGuffin,et al.  Examining the comorbidity of ADHD-related behaviours and conduct problems using a twin study design , 2001, British Journal of Psychiatry.

[125]  Stephen Scott,et al.  Multicentre controlled trial of parenting groups for childhood antisocial behaviour in clinical practice , 2001, BMJ : British Medical Journal.

[126]  M Knapp,et al.  Financial cost of social exclusion: follow up study of antisocial children into adulthood , 2001, BMJ : British Medical Journal.

[127]  B. Cobb,et al.  Parental monitoring: association with adolescents' risk behaviors. , 2001, Pediatrics.

[128]  C. Victora,et al.  Explaining trends in inequities: evidence from Brazilian child health studies , 2000, The Lancet.

[129]  F. Gardner Methodological Issues in the Direct Observation of Parent–Child Interaction: Do Observational Findings Reflect the Natural Behavior of Participants? , 2000, Clinical child and family psychology review.

[130]  M. Lovejoy,et al.  Maternal depression and parenting behavior: a meta-analytic review. , 2000, Clinical psychology review.

[131]  S. Eyberg,et al.  A Consumer Satisfaction Measure for Parent-Child Treatments and Its Relation to Measures of Child Behavior Change , 1999 .

[132]  T. Dishion,et al.  When interventions harm. Peer groups and problem behavior. , 1999, The American psychologist.

[133]  J. Williams,et al.  Parental autobiographical memory: is this a helpful clinical measure in behavioural child management? , 1998, The British journal of clinical psychology.

[134]  J. Dumas,et al.  The effectiveness of behavioral parent training to modify antisocial behavior in children: A meta-analysis , 1996 .

[135]  J. Weisz,et al.  Effects of psychotherapy with children and adolescents revisited: a meta-analysis of treatment outcome studies. , 1995, Psychological bulletin.

[136]  M J Al,et al.  Costs, effects and C/E-ratios alongside a clinical trial. , 1994, Health economics.

[137]  S. Schwartz The fallacy of the ecological fallacy: the potential misuse of a concept and the consequences. , 1994, American journal of public health.

[138]  G. Howe,et al.  Mothers' attributions and expectancies regarding their conduct-disordered children , 1992, Journal of abnormal child psychology.

[139]  W. Shadish,et al.  Mediators and moderators in meta-analysis: there's a reason we don't let dodo birds tell us which psychotherapies should have prizes. , 1991, Journal of consulting and clinical psychology.

[140]  E. Taylor,et al.  The Epidemiology of Childhood Hyperactivity , 1991 .

[141]  R. Wahler,et al.  The monitoring skills of troubled mothers: Their problems in defining child deviance , 1990, Journal of abnormal child psychology.

[142]  N. Turner,et al.  British community norms for the Brief Symptom Inventory. , 1990, The British journal of clinical psychology.

[143]  C. Johnston,et al.  A Measure of Parenting Satisfaction and Efficacy , 1989 .

[144]  C. Edelbrock,et al.  Reliability and validity of the direct observation form of the child behavior checklist , 1983, Journal of abnormal child psychology.

[145]  G. Patterson,et al.  Coercive Family Process , 1982 .

[146]  S. Eyberg,et al.  The standardization of an inventory of child conduct problem behaviors , 1980 .

[147]  S. Eyberg,et al.  Assessment of child behavior problems: The validation of a new inventory , 1978 .

[148]  A. Beck,et al.  An inventory for measuring depression. , 1961, Archives of general psychiatry.

[149]  M. E. Williams,et al.  Evaluating the Incredible Years Toddler Parenting Programme with parents of toddlers in disadvantaged (Flying Start) areas of Wales , 2017, Child: care, health and development.

[150]  Stephen A. Mistler A SAS ® Macro for Applying Multiple Imputation to Multilevel Data , 2013 .

[151]  F. Gardner,et al.  Support from the Start: effective programmes for three to eight year‐olds , 2012 .

[152]  N. Smailagic,et al.  Group-based parent training programmes for improving parental psychosocial health. , 2012, The Cochrane database of systematic reviews.

[153]  K. Witkiewitz,et al.  Issues and Challenges in the Design of Culturally Adapted Evidence-Based Interventions , 2012 .

[154]  Wei Wang,et al.  Methods for Synthesizing Findings on Moderation Effects Across Multiple Randomized Trials , 2011, Prevention Science.

[155]  J. Higgins Cochrane handbook for systematic reviews of interventions. Version 5.1.0 [updated March 2011]. The Cochrane Collaboration , 2011 .

[156]  G. Allen,et al.  Early Intervention: The Next Steps , 2011 .

[157]  A. Sacker,et al.  Health over the life course: associations between age, employment status and well-being , 2011 .

[158]  S. Landau,et al.  Randomised controlled trial of parent groups for child antisocial behaviour targeting multiple risk factors: the SPOKES project. , 2010, Journal of child psychology and psychiatry, and allied disciplines.

[159]  C. Webster-Stratton Affirming diversity: Multi-cultural collaboration to deliver the incredible years parent programs. , 2009 .

[160]  Bo Larsson,et al.  Treatment of oppositional defiant and conduct problems in young Norwegian children , 2008, European Child & Adolescent Psychiatry.

[161]  D. Daley,et al.  Early prevention of conduct disorder: how and why did the North and Mid Wales Sure Start study work? , 2007 .

[162]  M. Kenward,et al.  An Introduction to the Bootstrap , 2007 .

[163]  Brad Lundahl,et al.  A meta-analysis of parent training: moderators and follow-up effects. , 2006, Clinical psychology review.

[164]  P. McGrath,et al.  Predictors of parent training efficacy for child externalizing behavior problems--a meta-analytic review. , 2006, Journal of child psychology and psychiatry, and allied disciplines.

[165]  H. Meltzer,et al.  Mental Health of Children and Young People in Great Britain, 2004 , 2005 .

[166]  P C Lambert,et al.  A comparison of summary patient-level covariates in meta-regression with individual patient data meta-analysis. , 2002, Journal of clinical epidemiology.

[167]  A. Petrosino,et al.  "Scared Straight" and other juvenile awareness programs for preventing juvenile delinquency. , 2002, The Cochrane database of systematic reviews.

[168]  Michael Rempel,et al.  What Works and What Does Not , 2002 .

[169]  Jennifer Beecham,et al.  Unit costs: not exactly child's play. A guide to estimating unit costs for children’s social care , 2000 .

[170]  P. Lovibond,et al.  Manual for the Depression Anxiety Stress Scales. 2 , 1995 .

[171]  Martin Knapp,et al.  Costing psychiatric interventions. , 1992 .

[172]  M. Whitehead,et al.  The concepts and principles of equity and health. , 1992, International journal of health services : planning, administration, evaluation.

[173]  A. Beck,et al.  Psychometric properties of the Beck Depression Inventory: Twenty-five years of evaluation , 1988 .

[174]  Paul D. Williams,et al.  A user's guide to the General Health Questionnaire , 1988 .