Quantifying ADHD classroom inattentiveness, its moderators, and variability: a meta-analytic review.

BACKGROUND Most classroom observation studies have documented significant deficiencies in the classroom attention of children with attention-deficit/hyperactivity disorder (ADHD) compared to their typically developing peers. The magnitude of these differences, however, varies considerably and may be influenced by contextual, sampling, diagnostic, and observational differences. METHODS Meta-analysis of 23 between-group classroom observation studies using weighted regression, publication bias, goodness of fit, best case, and original metric analyses. RESULTS Across studies, a large effect size (ES = .73) was found prior to consideration of potential moderators. Weighted regression, best case, and original metric estimation indicate that this effect may be an underestimation of the classroom visual attention deficits of children with ADHD. Several methodological factors-classroom environment, sample characteristics, diagnostic procedures, and observational coding schema-differentially affect observed rates of classroom attentive behavior for children with ADHD and typically developing children. After accounting for these factors, children with ADHD were on-task approximately 75% of the time compared to 88% for their classroom peers (ES = 1.40). Children with ADHD were also more variable in their attentive behavior across studies. CONCLUSIONS The present study confirmed that children with ADHD exhibit deficient and more variable visual attending to required stimuli in classroom settings and provided an aggregate estimation of the magnitude of these deficits at the group level. It also demonstrated the impact of situational, sampling, diagnostic, and observational variables on observed rates of on-task behavior.

[1]  S. Faraone,et al.  Absence of gender effects on attention deficit hyperactivity disorder: findings in nonreferred subjects. , 2005, The American journal of psychiatry.

[2]  N. Fagley Methodological issues & strategies in clinical research , 2004, Psychotherapy research : journal of the Society for Psychotherapy Research.

[3]  S. Campbell,et al.  Continuities in maternal reports and child behaviors over time in hyperactive and comparison groups , 1978, Journal of abnormal child psychology.

[4]  S. Forness,et al.  Classroom Observation of Children with Learning ond Behavior Problems , 1975 .

[5]  C. Carlson,et al.  Gender differences in ADHD: a meta-analysis and critical review. , 1997, Journal of the American Academy of Child and Adolescent Psychiatry.

[6]  C. Begg,et al.  Operating characteristics of a rank correlation test for publication bias. , 1994, Biometrics.

[7]  W. Pelham,et al.  A comparison of objective classroom measures and teacher ratings of attention deficit disorder , 1985, Journal of abnormal child psychology.

[8]  H. Kraemer,et al.  Observed Classroom Behavior of Children with ADHD: Relationship to Gender and Comorbidity , 2002, Journal of abnormal child psychology.

[9]  John E. Cooper,et al.  Diagnostic and Statistical Manual of Mental Disorders (4th edn, text revision) (DSM-IV-TR) , 2001 .

[10]  H. Abikoff,et al.  The normalizing effects of methylphenidate on the classroom behavior of ADDH children , 1985, Journal of abnormal child psychology.

[11]  R. Barkley,et al.  Young adult outcome of hyperactive children: adaptive functioning in major life activities. , 2006, Journal of the American Academy of Child and Adolescent Psychiatry.

[12]  L. Siegel,et al.  Peer interactions of normal and attention-deficit-disordered boys during free-play, cooperative task, and simulated classroom situations , 1987, Journal of abnormal child psychology.

[13]  B. Lahey,et al.  Direct assessment of the cognitive correlates of attention deficit disorders with and without hyperactivity , 1986 .

[14]  D R Ismond,et al.  A naturalistic assessment of the motor activity of hyperactive boys. I. Comparison with normal controls. , 1983, Archives of general psychiatry.

[15]  A Radosh,et al.  The effect of appealing distractors on the performance of hyperactive children , 1981, Journal of abnormal child psychology.

[16]  Brooks Applegate,et al.  Developmental change in attention-deficit hyperactivity disorder in boys: A four-year longitudinal study , 1995, Journal of abnormal child psychology.

[17]  Susan M. Shecket,et al.  Behaviors of Children Referred by Classroom Teachers as Hyperactive. , 1976 .

[18]  Stephen P. Hinshaw,et al.  Behavioral versus Behavioral and Pharmacological Treatment in ADHD Children Attending a Summer Treatment Program , 2000, Journal of abnormal child psychology.

[19]  M. Rapport,et al.  Attention-deficit/hyperactivity disorder and scholastic achievement: a model of dual developmental pathways. , 1999, Journal of child psychology and psychiatry, and allied disciplines.

[20]  R. Rosenthal Meta-analytic procedures for social research , 1984 .

[21]  G W Lauth,et al.  Observation of children with attention-deficit hyperactivity (ADHD) problems in three natural classroom contexts. , 2006, The British journal of educational psychology.

[22]  H. Quay,et al.  Observing the Classroom Behavior of Elementary School Children , 1969, Exceptional children.

[23]  E. Waters,et al.  How much observational data is enough? An empirical test using marital interaction coding. , 2001, Behavior therapy.

[24]  C. Bell Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, Text Revision: DSM-IV-TR Quick Reference to the Diagnostic Criteria from DSM-IV-TR , 2001 .

[25]  G. Leonard Burns,et al.  Comparison of DSM-IV ADHD Combined and Predominantly Inattention Types: Correspondence Between Teacher Ratings and Direct Observations of Inattentive, Hyperactivity/Impulsivity, Slow Cognitive Tempo, Oppositional Defiant, and Overt Conduct Disorder Symptoms , 1998 .

[26]  H. Abikoff,et al.  Classroom observation code for hyperactive children: a replication of validity. , 1980, Journal of consulting and clinical psychology.

[27]  M. Rapport,et al.  Does methylphenidate normalize the classroom performance of children with attention deficit disorder? , 1993, Journal of the American Academy of Child and Adolescent Psychiatry.

[28]  K. Amrami,et al.  A perspective on the attention-deficit disorders. , 1992, Hospital & community psychiatry.

[29]  G. Holmbeck Toward terminological, conceptual, and statistical clarity in the study of mediators and moderators : examples from the child-clinical and pediatric psychology literatures , 1997 .

[30]  B. Tabachnick,et al.  Using Multivariate Statistics , 1983 .

[31]  Joseph Biederman,et al.  Intellectual performance and school failure in children with attention deficit hyperactivity disorder and in their siblings. , 1993, Journal of abnormal psychology.

[32]  R. Klein,et al.  Error patterns on the continuous performance test in non-medicated and medicated samples of children with and without ADHD: a meta-analytic review. , 1996, Journal of child psychology and psychiatry, and allied disciplines.

[33]  V. Douglas,et al.  Attention in hyperactive children and the effect of methylphenidate (ritalin). , 1971, Journal of child psychology and psychiatry, and allied disciplines.

[34]  A Dietz,et al.  Expectation biases in observational evaluation of therapeutic change. , 1974, Journal of consulting and clinical psychology.

[35]  S. Luk Direct observation studies of hyperactive behaviors. , 1985, Journal of the American Academy of Child Psychiatry.

[36]  V. Douglas Stop, look and listen: The problem of sustained attention and impulse control in hyperactive and normal children. , 1972 .

[37]  Steven Muncer,et al.  Meta-analysis and power : some suggestions for the use of power in research synthesis. , 2003 .

[38]  L. Hedges Estimation of effect size from a series of independent experiments. , 1982 .

[39]  S. Zentall,et al.  Behavioral comparisons of hyperactive and normally active children in natural settings , 1980, Journal of abnormal child psychology.

[40]  Larry J. Seidman,et al.  Attention-Deficit/Hyperactivity Disorder Endophenotypes , 2005, Biological Psychiatry.

[41]  Daniel J. Reschly,et al.  Assessment in School Psychology Training and Practice. , 1996 .

[42]  Randy W. Kamphaus,et al.  Differential Validity of the BASC Student Observation System and the BASC Teacher Rating Scale , 1997 .

[43]  B. Tabachnick,et al.  Using multivariate statistics, 5th ed. , 2007 .

[44]  H. Abikoff,et al.  Does behavior therapy normalize the classroom behavior of hyperactive children? , 1984, Archives of general psychiatry.

[45]  Benjamin B. Lahey,et al.  Recording system bias in direct observational methodology: A review and critical analysis of factors causing inaccurate coding behavior , 1982 .

[46]  R. Book,et al.  Behavioral observations of disruptive behaviors with referred and nonreferred elementary school students , 1987 .

[47]  Robert Rosenthal,et al.  WRITING META-ANALYTIC REVIEWS , 1995 .

[48]  I. K. Wood,et al.  Neuroscience: Exploring the brain , 1996 .

[49]  Larry V Hedges,et al.  The power of statistical tests for moderators in meta-analysis. , 2004, Psychological methods.

[50]  F. Castellanos,et al.  Varieties of Attention-Deficit/Hyperactivity Disorder-Related Intra-Individual Variability , 2005, Biological Psychiatry.

[51]  Cheng-Sheng Chen,et al.  Gender differences in a clinic‐referred sample of Taiwanese attention‐deficit/hyperactivity disorder children , 2004, Psychiatry and clinical neurosciences.

[52]  G. DuPaul,et al.  Peer tutoring for children with attention deficit hyperactivity disorder: effects on classroom behavior and academic performance. , 1998, Journal of applied behavior analysis.

[53]  A. Kazdin Methodological issues & strategies in clinical research , 1992 .

[54]  T. Achenbach Manual for ASEBA School-Age Forms & Profiles , 2001 .

[55]  S. Zentall,et al.  Effects of classroom noise on performance and activity of second-grade hyperactive and control children. , 1980, Journal of educational psychology.

[56]  G. Holmbeck Toward terminological, conceptual, and statistical clarity in the study of mediators and moderators: examples from the child-clinical and pediatric psychology literatures. , 1997, Journal of consulting and clinical psychology.

[57]  R. Klein,et al.  Adult outcome of hyperactive boys. Educational achievement, occupational rank, and psychiatric status. , 1993, Archives of general psychiatry.

[58]  Heinz Katschnig,et al.  Diagnostic and statistical manual of mental disorders, third edition, revised (DSM-III-R) , 1992 .

[59]  S Duval,et al.  Trim and Fill: A Simple Funnel‐Plot–Based Method of Testing and Adjusting for Publication Bias in Meta‐Analysis , 2000, Biometrics.

[60]  M. Paradiso,et al.  Neuroscience: Exploring the brain, 3rd ed. , 2007 .

[61]  M. Rapport,et al.  Attention deficit disorder and methylphenidate: normalization rates, clinical effectiveness, and response prediction in 76 children. , 1994, Journal of the American Academy of Child and Adolescent Psychiatry.

[62]  J S Bailey,et al.  Ritalin vs. response cost in the control of hyperactive children: a within-subject comparison. , 1982, Journal of applied behavior analysis.

[63]  D. Fergusson,et al.  Early disruptive behavior, IQ, and later school achievement and delinquent behavior , 1995, Journal of abnormal child psychology.

[64]  W. Pelham,et al.  Behavioral and stimulant treatment of hyperactive children: a therapy study with methylphenidate probes in a within-subject design. , 1980, Journal of applied behavior analysis.

[65]  B. Collins,et al.  Behavior Observations of Hyperactive Children and Methylphenidate (Ritalin) Effects In Systematically Structured Classroom Environments: Now You See Them, Now You Don’ , 1978 .

[66]  G. Salmon,et al.  Attention deficit hyperactivity disorder. , 2018, British journal of hospital medicine.

[67]  J. Epstein,et al.  Revision and Restandardization of the Conners Teacher Rating Scale (CTRS-R): Factor Structure, Reliability, and Criterion Validity , 1998, Journal of abnormal child psychology.

[68]  Greta M. Massetti,et al.  Evidence-Based Assessment of Attention Deficit Hyperactivity Disorder in Children and Adolescents , 2005, Journal of clinical child and adolescent psychology : the official journal for the Society of Clinical Child and Adolescent Psychology, American Psychological Association, Division 53.

[69]  K. O’leary,et al.  Formal and informal classroom settings: Effects on hyperactivity , 1978, Journal of abnormal child psychology.

[70]  Edward S. Shapiro,et al.  Observing Students in Classroom Settings: A Review of Seven Coding Schemes , 2005 .

[71]  L. Abramson,et al.  Is there a universal positivity bias in attributions? A meta-analytic review of individual, developmental, and cultural differences in the self-serving attributional bias. , 2004, Psychological bulletin.

[72]  Gordon D. Logan,et al.  The Ecological Validity of Delay Aversion and Response Inhibition as Measures of Impulsivity in AD/HD: A Supplement to the NIMH Multimodal Treatment Study of AD/HD , 2001, Journal of abnormal child psychology.

[73]  Sydney S. Zentall,et al.  Research on the Educational Implications of Attention Deficit Hyperactivity Disorder , 1993 .

[74]  G. August,et al.  The nosology of attention-deficit hyperactivity disorder. , 1993, Journal of the American Academy of Child and Adolescent Psychiatry.

[75]  R. Schachar,et al.  Agreement between teachers' ratings and observations of hyperactivity, inattentiveness, and defiance , 1986, Journal of abnormal child psychology.

[76]  Mark W. Lipsey,et al.  Practical Meta-Analysis , 2000 .

[77]  S. Maxwell,et al.  The proof of the pudding: an illustration of the relative strengths of null hypothesis, meta-analysis, and Bayesian analysis. , 2000, Psychological methods.

[78]  R. D. Young,et al.  Hyperactive boys in their classroom: Assessment of teacher and peer perceptions, interactions, and classroom behaviors , 1979, Journal of abnormal child psychology.

[79]  H. Abikoff,et al.  Validation of a classroom observation code for hyperactive children. , 1977, Journal of consulting and clinical psychology.

[80]  R. Barkley,et al.  Comprehensive evaluation of attention deficit disorder with and without hyperactivity as defined by research criteria. , 1990, Journal of consulting and clinical psychology.

[81]  M. A. Roberts A behavioral observation method for differentiating hyperactive and aggressive boys , 1990, Journal of abnormal child psychology.

[82]  S. Faraone,et al.  The Massachusetts General Hospital studies of gender influences on attention-deficit/hyperactivity disorder in youth and relatives. , 2004, The Psychiatric clinics of North America.

[83]  K. Gadow,et al.  Children with ADHD and tic disorder and their classmates: behavioral normalization with methylphenidate. , 1997, Journal of the American Academy of Child and Adolescent Psychiatry.