Illusions of Meaning in the Ipsative Assessment of Children's Ability

In this study, we analyze the relative efficacy of normative and ipsative measures for the study of intra- and interindividual differences in child ability. With the use of representative data sets, including the WISC-R national standardization sample, purely ipsatized (or deviational ipsative) subtest scores were contrasted with conventional norm-based scores in terms of the evidential and consequential bases for validity. Internal and external evidence for validity was assessed for relative convergence of ability attributes, short- and long-term stability, and predictive efficiency. Comparative utility of each type of measure was explored for theoretical relevance, applicability in measurement work, and assessment of individualized intervention outcomes. Ipsative ability measures were found to be uniformly inferior to their normative counterparts, with ipsative measures conveying no uniquely useful information and otherwise impeding the versatility of assessment.

[1]  D. Reschly.  Obstacles, starting points, and doldrums notwithstanding: Reform/revolution from outcomes criteria. , 1988 .

[2]  A. Bannatyne.  Diagnosis : A note on recategorization of the WISC scaled scores. , 1974 .

[3]  J. P. Guilford,et al.  The analysis of intelligence , 1971 .

[4]  J. Fantuzzo,et al.  Just Say No to Subtest Analysis: A Critique on Wechsler Theory and Practice , 1990 .

[5]  K. A. Heller,et al.  Placing children in special education : a strategy for equity , 1982 .

[6]  J. Simpson.  WECHSLER'S MEASUREMENT AND APPRAISAL OF ADULT INTELLIGENCE , 1974 .

[7]  R. Hale,et al.  Profile Analysis of the Wechsler Intelligence Scale for Children-Revised , 1983 .

[8]  R. Hale,et al.  Utility of WISC--R subtest analysis in discriminating among groups of conduct problem, withdrawn, mixed, and nonproblem boys. , 1981, Journal of consulting and clinical psychology.

[9]  John V. Noonan,et al.  Typology and prevailing composition of core profiles in the WAIS—R standardization sample. , 1989 .

[10]  J. Guilford.  ZERO CORRELATIONS AMONG TESTS OF INTELLECTUAL ABILITIES. , 1964, Psychological bulletin.

[11]  F. Borgen,et al.  Applying Cluster Analysis in Counseling Psychology Research. , 1987 .

[12]  R. Linn.  Educational measurement, 3rd ed. , 1989 .

[13]  F. F. Stephan,et al.  Statistical Procedures and their Mathematical Bases. , 1936 .

[14]  J. A. Radcliffe.  SOME PROPERTIES OF IPSATIVE SCORE MATRICES AND THEIR RELEVANCE FOR SOME CURRENT INTEREST TESTS1 , 1963 .

[15]  A Computer Program for Measuring Levels of Overall and Partial Congruence Among Multiple Observers on Nominal Scales , 1979 .

[16]  J. Guilford,et al.  The nature of human intelligence. , 1968 .

[17]  William Vance Clemans,et al.  An analytical and empirical examination of some properties of ipsative measures , 1967 .

[18]  Robert J. Fogelin,et al.  The History of Western Philosophy , 1953, PsyPag Quarterly.

[19]  J. Fleiss.  Measuring nominal scale agreement among many raters. , 1971 .

[20]  Raymond B. Cattell,et al.  Psychological measurement: normative, ipsative, interactive. , 1944 .

[21]  Brenda Rogers,et al.  Woodcock-Johnson Psycho-Educational Battery , 1982 .

[22]  A. Silverstein.  VARIANCE COMPONENTS IN THE SUBTESTS OF THE WISC-R1 , 1976 .

[23]  L. E. Hicks,et al.  Some properties of ipsative, normative, and forced-choice normative measures. , 1970 .

[24]  S. Cahan.  Significance Testing of Subtest Score Differences: the Rules of the Game , 1986 .

[25]  A. Kaufman.  Factor analysis of the WISC-R at 11 age levels between 61/2 and 161/2 years. , 1975 .

[26]  A. Kaufman,et al.  Confirmatory analysis of simultaneous, sequential, and achievement factors on the K-ABC at 11 age levels ranging from 212 to 1212 years , 1985 .

[27]  Penelope L. Peterson,et al.  The Social Context of Instruction. Group Organization and Group Processes. [Papers Presented at a Conference Held at The Wisconsin Center for Education Research (Madison, May 1982).]. , 1987 .

[28]  Marley W. Watkins,et al.  Core profile types in the WISC-R national sample: structure, membership, and applications , 1989 .

[29]  Irwin A. Berg.  Personality and Motivation Structure and Measurement. , 1960 .

[30]  J P GUILFORD,et al.  When not to factor analyze. , 1952, Psychological bulletin.

[31]  R. P. Rugel.  WISC Subtest Scores of Disabled Readers: , 1974 .

[32]  C. Spearman,et al.  "THE ABILITIES OF MAN". , 1928, Science.

[33]  A. Kaufman,et al.  Assessing Adolescent and Adult Intelligence , 1990 .

[34]  L. Cronbach,et al.  Aptitudes and instructional methods: A handbook for research on interactions , 1977 .

[35]  R. Savage.  Wechsler's Measurement and Appraisal of Adult Intelligence, 5th ed , 1974 .

[36]  G. McCloskey.  Wide Range Achievement Test-Revised , 1987 .

[37]  H. Hotelling.  Analysis of a complex of statistical variables into principal components. , 1933 .

[38]  R. J. Thompson.  The diagnostic utility of Bannatyne's recategorized WISC‐R scores with children referred to a developmental evaluation center , 1981 .

[39]  R. Zachary.  Wechsler's Intelligence Scales: Theoretical and Practical Considerations , 1990 .

[40]  R. Hale.  The Utility Of WISC-R Subtest Scores In Discriminating Among Adequate And Underachieving Children. , 1979, Multivariate behavioral research.

[41]  P. F. Miller.  Statistical Procedures and their Mathematical Bases , 1941, Nature.

[42]  W. Tryon.  The test–trait fallacy. , 1979 .

[43]  W. F. Vonderhaar.  A COMPARATIVE STUDY OF PERFORMANCE SCALE IQ'S AND SUBTEST SCORES OF DEAF CHILDREN ON THE WECHSLER INTELLIGENCE SCALE FOR CHILDREN AND THE WECHSLER INTELLIGENCE SCALE FOR CHILDREN-REVISED , 1977 .

[44]  J. Sattler.  Assessment of children, 3rd ed. , 1988 .

[45]  Mark R. Raymond,et al.  Wechsler Intelligence Scale for Children — Revised (WISC-R) Patterns of Strengths and Weaknesses as Predictors of the Intelligence-Achievement Relationship , 1981 .

[46]  Richard E. Snow,et al.  Individual differences and the design of educational programs , 1986 .

[47]  C. Harris.  Relations among Factors of Raw, Deviation, and Double-Centered Score Matrices , 1953 .

[48]  R. Cattell,et al.  Abilities : Their Structure , Growth , and Action , 2015 .

[49]  Charles Wrigley.  Objectivity in Factor Analysis , 1958 .

[50]  D. Broverman.  Effects of score transformations in Q and R factor analysis techniques. , 1961 .

[51]  A. Kaufman.  Intelligent testing with the WISC-R , 1979 .

[52]  A. Anastasi.  Psychological testing, 6th ed. , 1988 .

[53]  R. J. Thompson.  The diagnostic utility of WISC-R measures with children referred to a developmental evaluation center. , 1980, Journal of consulting and clinical psychology.