A Selective Synthesis of the Experimental Literature on Dynamic Assessment

Dynamic assessment is a procedure that determines whether substantive changes occur in examinee behavior if feedback is provided across an array of increasingly complex or challenging tasks. This procedure contrasts with traditional models of assessment in which there is no feedback from the examiner on student performance. This article summarizes a meta-analysis of published studies on dynamic assessment. Thirty studies, which yielded 170 effect sizes (ESs), were reviewed. An analysis of main effects showed that ESs varied significantly as a function of ability group (underachievers yielded higher and children with learning disabilities yielded lower ESs than average, hearing-impaired, and mentally retarded participants did), chronological age (younger students yield higher ESs than older students do), sample size (studies with moderate sample sizes yielded larger ESs than did studies with small or large sample sizes), and type of assessment procedure (scaffolding and general strategies yielded larger ESs than did coaching). Mixed regression modeling indicated that the magnitude of the ES was best predicted by the type of assessment (ESs are higher for general strategies than for scaffolding, and scaffolding yields higher ESs than coaching does) and assessment domain (ESs are higher on visual-spatial than on verbal measures). None of the ability group classifications predicted ES in the complete regression model. These results were discussed within the context of the assumptions related to dynamic assessment and its current limitations.

[1]  Asha K. Jitendra,et al.  Dynamic Assessment as a Compensatory Assessment Approach , 1993 .

[2]  H. Carl Haywood,et al.  Dynamic Approaches to Psychoeducational Assessment. , 1990 .

[3]  M. Budoff,et al.  Demographic and psychometric factors related to improved performance on the Kohs learning-potential procedure. , 1974, American journal of mental deficiency.

[4]  Susan E. Embertson.  Improving the measurement of spatial aptitude by dynamic testing , 1987 .

[5]  L. Wright,et al.  Identifying Young, Potentially Gifted, Economically Disadvantaged Students1 , 1994 .

[6]  G. Larson,et al.  Dynamic Administration of a General Intelligence Test. , 1991 .

[7]  M. Budoff,et al.  "LEARNING POTENTIAL" AS AN ASSESSMENT APPROACH TO THE ADOLESCENT MENTALLY RETARDED. , 1964, Journal of consulting psychology.

[8]  J. Elliot,et al.  Assessing potential : the search for the philosophers stone? , 1997 .

[9]  Dynamic Assessment of Preschool Children with Special Needs , 1989 .

[10]  R. Rosenthal.  The file drawer problem and tolerance for null results , 1979 .

[11]  D. Speece,et al.  Dynamic assessment, individual differences, and academic achievement. , 1990 .

[12]  Carol S. Lidz,et al.  Dynamic assessment: An interactional approach to evaluating learning potential. , 1987 .

[13]  Ingram Olkin,et al.  Stochastically dependent effect sizes. , 1994 .

[14]  R. Hanka.  The Handbook of Research Synthesis , 1994 .

[15]  S. Raudenbush,et al.  A multivariate mixed linear model for meta-analysis. , 1996 .

[16]  Mark Gluck,et al.  Memory and cognition , 2000, Clinical Neurophysiology.

[17]  A. Hayes.  Within-study meta-analysis : Pooling the significance of doubly nonindependent (nonoverlapping) correlations , 1998 .

[18]  M. Lipsey,et al.  The efficacy of psychological, educational, and behavioral treatment. Confirmation from meta-analysis. , 1993, American Psychologist.

[19]  C. Missiuna,et al.  Dynamic Assessment: Review and Critique , 1989 .

[20]  Kevin D. Carlson,et al.  Impact of Experimental Design on Effect Size: Findings From the Research Literature on Training , 1999 .

[21]  Arthur L. Costa,et al.  Envisioning Process as Content: Toward a Renaissance Curriculum. , 1996 .

[22]  P. Sleight,et al.  Publication bias , 1991, The Lancet.

[23]  J. Hamers,et al.  Learning Potential in Ethnic Minority Children , 1996 .

[24]  Susan E. Embretson,et al.  Measuring and Validating Cognitive Modifiability as an Ability: A Study in the Spatial Domain , 1992 .

[25]  J. Day,et al.  Static and dynamic measures of ability: An experimental comparison. , 1993 .

[26]  Anthony S. Bryk,et al.  Hierarchical Linear Models: Applications and Data Analysis Methods , 1992 .

[27]  Measuring Intellectual Capabilities of Hearing-Impaired Children: Effects of Testing-the-Limits Procedures. , 1978 .

[28]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[29]  R. Kretschmer,et al.  Effect of Mediated Learning Intervention on Cognitive Task Performance with a Deaf Population. , 1987 .

[30]  R. Sternberg,et al.  "Dynamic testing": Erratum. , 1998 .

[31]  Robert J. Kirschenbaum.  Dynamic Assessment and Its Use With Underserved Gifted and Talented Populations , 1998 .

[32]  M. Budoff.  Measures for assessing learning potential. , 1987 .

[33]  David Wechsler,et al.  Manual for the Wechsler intelligence scale for children , 1974 .

[34]  H. Lee Swanson,et al.  Effects of Dynamic Testing on the Classification of Learning Disabilities: The Predictive and Discriminant Validity of the Swanson-Cognitive Processing Test (S-CPT) , 1995 .

[35]  J. Carlson,et al.  The effects of dynamic assessment procedures on Raven Matrices performance, visual search behavior, test anxiety and test orientation , 1982 .

[36]  Edward L. Thorndike,et al.  Intelligence and its measurement: A symposium--I. , 1921 .

[37]  J. Das,et al.  Two experiments on the dynamic assessment of planning , 1993 .

[38]  J. Carlson,et al.  Toward a differential testing approach: Testing-the-limits employing the Raven matrices☆ , 1979 .

[39]  D Tzuriel,et al.  The assessment of analogical thinking modifiability among regular, special education, disadvantaged, and mentally retarded children , 1985, Journal of abnormal child psychology.

[40]  Jerry S. Carlson.  European contributions to dynamic assessment , 1995 .

[41]  Paul M. Wortman,et al.  Judging research quality. , 1994 .

[42]  Pamela Laughon.  The Dynamic Assessment of Intelligence: A Review of Three Approaches. , 1990 .

[43]  K. Harris.  Learning Disabilities Research , 1988, Journal of learning disabilities.

[44]  H. Swanson,et al.  Learning-disabled readers' working memory as a function of processing demands. , 1996, Journal of experimental child psychology.

[45]  R. Feuerstein.  Instrumental Enrichment: An Intervention Program for Cognitive Modifiability , 1980 .

[46]  J. Campione.  Assisted Assessment , 1989, Journal of learning disabilities.

[47]  Ingram Olkin,et al.  Estimation of a Single Effect Size: Parametric and Nonparametric Methods , 1985 .

[48]  R. Rosenthal.  Parametric measures of effect size. , 1994 .

[49]  H. Swanson,et al.  Individual and age-related differences in children’s working memory , 1996, Memory & cognition.

[50]  P. Lachenbruch.  Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[51]  J. Das,et al.  Planning ability and cognitive performance: The compensatory effects of a dynamic assessment approach , 1990 .

[52]  M. Budoff,et al.  Educational test of the learning-potential hypothesis. , 1971, American journal of mental deficiency.

[53]  P Gangadharan,et al.  Statistical considerations. , 1973, Indian journal of cancer.

[54]  R. Feuerstein,et al.  Cognitive Modifiability in Adolescence: Cognitive Structure and the Effects of Intervention , 1981 .

[55]  Ann L. Brown,et al.  Breakdowns in flexible use of information: Intelligence-related differences in transfer following equivalent learning performance , 1985 .

[56]  T. Sewell,et al.  The Relationship of Estimated Learning Potential to Performance on a Learning Task and Achievement. , 1985 .

[57]  J. Carlson,et al.  Testing for Competence in Three Ethnic Groups , 1978 .

[58]  H. Swanson.  The Role of Working Memory and Dynamic Assessment in the Classification of Children with Learning Disabilities. , 1994 .

[59]  Aquiles Iglesias,et al.  The Application of Dynamic Methods to Language Assessment , 1992 .

[60]  John E. Hunter,et al.  Methods of Meta-Analysis , 1989 .

[61]  D. Tzuriel,et al.  Cognitive Modifiability and Cognitive Performance of Deaf and Hearing Preschool Children , 1992 .

[62]  D. Wechsler.  Manual of the Wechsler Intelligence Scale for Children-Revised , 1974 .

[63]  G. Glass,et al.  Meta-analysis in social research , 1981 .

[64]  Betsy Jane Becker,et al.  Examining explanatory models through research synthesis. , 1994 .

[65]  S. Maxwell,et al.  Comparison of Static and Dynamic Assessment Procedures and Their Relation to Independent Performance. , 1997 .

[66]  Betsy Jane Becker,et al.  Coaching for the Scholastic Aptitude Test: Further Synthesis and Appraisal , 1990 .

[67]  Jeffrey Pope,et al.  State of the art and future directions , 2001 .

[68]  Use of testing-the-limits procedures in the assessment of intellectual capabilities in children with learning difficulties. , 1978, American journal of mental deficiency.

[69]  T. Huberty,et al.  A Test of the Learning Potential Hypothesis with Hearing and Deaf Students. , 1984 .

[70]  T. Schack,et al.  Dynamic testing , 2003 .

[71]  Effectiveness of a learning potential procedure in improving problem-solving skills of retarded and nonretarded children. , 1976, American journal of mental deficiency.

[72]  H. Lee Swanson,et al.  Generality and modifiability of working memory among skilled and less skilled readers , 1992 .