The Umbrella That Is Too Wide and Yet Too Small: Why Dynamic Testing Has Still Not Delivered on the Promise That Was Never Made

In this article, I reflect on potential reasons for the seemingly persistent impression that dynamic testing has not delivered on its promise. Potential reasons are embedded in a paradox. On the one hand, validity-related expectations toward dynamic tests seem too broad. This includes fuzziness in defining the diagnostic target constructs, simplistic quantitative focus on conventional validity indices, and overgeneralized expectations regarding incremental validity. At the same time, the focus on dynamic testing seems too narrow. By introducing three tests of cognitive flexibility, I exemplify that dynamic testing has potential which goes beyond the assessment of learning potential in specific subpopulations. My ambition is to help in addressing potential users’ misconceptions about dynamic testing productively.

[1]  F. O. Volle.  A proposal for testing the limits with mental defectives for purposes of subtest analysis of the WISC verbal scale. , 1957, Journal of clinical psychology.

[2]  Alex Kozulin,et al.  Experience of mediated learning : an impact of Feuerstein's theory in education and psychology , 2000 .

[3]  Robert J. Sternberg,et al.  Expertise and Intelligent Thinking: When is it Worse to Know Better , 1989 .

[4]  W. A. Scott.  Cognitive Complexity and Cognitive Flexibility , 1962 .

[5]  Oliver Hirsch,et al.  Dynamisches Testen - Zur Psychodiagnostik der intraindividuellen Variabilität. Grundlagen, Verfahren und Anwendungsfelder , 1999 .

[6]  J. Elshout.  Human cognitive abilities. A survey of factoranalytic studies: John B. Carroll, Cambridge University Press, 1993. Pp. 819. ISBN-0-521-38712-4 paperback , 1995 .

[7]  V. Suteev,et al.  Mushroom in the rain , 1974 .

[8]  L. Cronbach.  Essentials of psychological testing , 1960 .

[9]  J. Guthke,et al.  The learning test concept—an alternative to the traditional static intelligence test. , 1982 .

[10]  Quinn McNemar,et al.  Lost: Our intelligence? Why? , 1964 .

[11]  Maite Garaigordobil,et al.  Intervention in Creativity With Children Aged 10 and 11 Years: Impact of a Play Program on Verbal and Graphic–Figural Creativity , 2006 .

[12]  D. Tzuriel.  Mediated Learning Experience and Cognitive Modifiability , 2013, Journal of Cognitive Education and Psychology.

[13]  The Rorschach Technique , 1942 .

[14]  M. Chi.  Creativity: Shifting across ontological categories flexibly. , 1997 .

[15]  S. Urbina.  Essentials of Psychological Testing , 2005, PsyPag Quarterly.

[16]  Jens F. Beckmann,et al.  Dynamic assessment with diagnostic programs. , 2003 .

[17]  R. Sternberg,et al.  If dancers ate their shoes: Inductive reasoning with factual and counterfactual premises , 1989, Memory & cognition.

[18]  M. Lezak.  Neuropsychological assessment, 3rd ed. , 1995 .

[19]  R. Sternberg,et al.  Analogical reasoning with novel concepts: Differential attention of intellectually gifted and nongifted children to relevant and irrelevant novel stimuli , 1986 .

[20]  Psychodiagnostik des schlußfolgernden Denkens , 1999 .

[21]  Michael C. Pyryt.  Human cognitive abilities: A survey of factor analytic studies , 1998 .

[22]  G. Whipple,et al.  The Psychological Methods of Testing Intelligence , 1915, The Psychological Clinic.

[23]  Use of testing-the-limits procedures in the assessment of intellectual capabilities in children with learning difficulties. , 1978, American journal of mental deficiency.

[24]  Wm. Stephenson,et al.  The Range of Human Capacities , 1936, Mental Welfare.

[25]  J. Guthke,et al.  Dynamik im dynamischen Testen , 2003 .

[26]  J. Beckmann,et al.  Zur Validierung der Diagnostik intellektueller Lernfähigkeit , 2000 .

[27]  Reinhold Kliegl,et al.  Theory-guided analysis of mechanisms of development and aging through testing-the-limits and research on expertise , 1985 .

[28]  Jodie M. Plumert,et al.  The stability and flexibility of spatial categories , 2005, Cognitive Psychology.

[29]  Susy Macqueen,et al.  Validity , 1973, Just Algorithms.

[30]  Carol S. Lidz,et al.  Dynamic assessment : prevailing models and applications , 2000 .

[31]  M. G. Hessels.  Estimation of the Predictive Validity of the HART by Means of a Dynamic Test of Geography , 2009, Journal of Cognitive Education and Psychology.

[32]  D. Borsboom,et al.  The concept of validity. , 2004, Psychological review.

[33]  Educational Evaluation.  Standards for Educational and Psychological Testing , 1999 .