FOCUS ARTICLE: The Second Century of Ability Testing: Some Predictions and Speculations

The last century was marked by dazzling changes in many areas, such as technology and communications. Predictions into the second century of testing are seemingly difficult in such a context. Yet, looking back to the turn of the last century, Kirkpatrick (1900), in his American Psychological Association presidential address, presented fundamental desiderata for ability testing that in fact guides major testing research even today (normative age standards, emphasis on culture-general tasks, simultaneous measurement of many persons and adult ability measurement). An overview of the last century, presented in this address, shows that most fundamental principles in psychometrics and testing were available by 1930. With a few notable exceptions, the remainder of the last century of testing was devoted to applying or refining these principles. It is predicted that the same pattern will occur in this century of testing. Further developments in model-based measurement and in applying cognitive psychology principles in testing, intermingled with technology, will guide ability testing throughout the next century. These changes, to be elaborated in detail, include fundamental changes in test development procedures, the nature of the measuring tasks, aspects of ability that are measured, and types of interpretations given to ability.

[1]  Georg Rasch,et al.  Probabilistic Models for Some Intelligence and Attainment Tests , 1981, The SAGE Encyclopedia of Research Design.

[2]  Russell G. Almond,et al.  On the Structure of Educational Assessments, CSE Technical Report. , 2003 .

[3]  Isaac I. Bejar,et al.  A FEASIBILITY STUDY OF ON‐THE‐FLY ITEM GENERATION IN ADAPTIVE TESTING , 2002 .

[4]  Randy Elliot Bennett,et al.  Item generation and beyond: Applications of schema theory to mathematics assessment. , 2002 .

[5]  Russell G. Almond,et al.  A Four-Process Architecture for Assessment Delivery, with Connections to Assessment Design , 2002 .

[6]  Joanna S. Gorin,et al.  Improving Construct Validity with Cognitive Psychology Principles. , 2001 .

[7]  Susan E. Embretson,et al.  Generating items during testing: Psychometric issues and models , 1999 .

[8]  S. Embretson,et al.  Behind the Scenes: Using New Measurement Methods on DAS and KAIT , 1999 .

[9]  Russell G. Almond,et al.  On the Roles of Task Model Variables in Assessment Design. , 1999 .

[10]  S. Embretson A cognitive design system approach to generating valid tests : Application to abstract reasoning , 1998 .

[11]  Michael C. Pyryt Human cognitive abilities: A survey of factor analytic studies , 1998 .

[12]  Brandon Bennett,et al.  Reinventing Assessment: Speculations on the Future of Large Scale Educational Testing , 1998 .

[13]  Kathleen M. Sheehan A TREE‐BASED APPROACH TO PROFICIENCY SCALING & DIAGNOSTIC ASSESSMENT , 1997 .

[14]  Randy Elliot Bennett,et al.  VALIDITY AND AUTOMATED SCORING: IT'S NOT ONLY THE SCORING , 1997 .

[15]  J. Guthke,et al.  Dynamic testing—problems, uses, trends and evidence of validity. , 1997 .

[16]  R. J. Mokken,et al.  Handbook of modern item response theory , 1997 .

[17]  Isaac I. Bejar GENERATIVE RESPONSE MODELING: LEVERAGING THE COMPUTER AS A TEST DELIVERY MEDIUM , 1996 .

[18]  Klaas Sijtsma,et al.  Learning potential assessment: Theoretical, methodological and practical issues , 1993 .

[19]  Susan E. Embretson,et al.  A multidimensional latent trait model for measuring learning and change , 1991 .

[20]  Fritz Drasgow,et al.  Appropriateness Measurement for Some Multidimensional Test Batteries , 1991 .

[21]  Jürgen Rost,et al.  Rasch Models in Latent Classes: An Integration of Two Approaches to Item Analysis , 1990 .

[22]  Issac I. Bejar A Generative Analysis of a Three-Dimensional Spatial Task , 1990 .

[23]  M A Just,et al.  From the SelectedWorks of Marcel Adam Just 1990 What one intelligence test measures : A theoretical account of the processing in the Raven Progressive Matrices Test , 2016 .

[24]  Isaac I. Bejar,et al.  A sentence-based automated approach to the assessment of writing: a feasibility study , 1987 .

[25]  R. Sternberg,et al.  What is Intelligence?: Contemporary Viewpoints on its Nature and Definition , 1986 .

[26]  Kikumi K. Tatsuoka,et al.  A Probabilistic Model for Diagnosing Misconceptions By The Pattern Classification Approach , 1985 .

[27]  S. Whitely Construct validity: Construct representation versus nomothetic span. , 1983 .

[28]  G. Masters A rasch model for partial credit scoring , 1982 .

[29]  B Krause,et al.  On problems in measuring change. , 1982, Zeitschrift fur Psychologie mit Zeitschrift fur angewandte Psychologie.

[30]  O. K. Buros Fifty Years in Testing: Some Reminiscences, Criticisms, and Suggestions , 1977 .

[31]  Robert J. Sternberg,et al.  Component Processes in Analogical Reasoning. , 1977 .

[32]  G. H. Fischer,et al.  The linear logistic test model as an instrument in educational research , 1973 .

[33]  C. Adcock,et al.  Primary Mental Abilities. , 1971, The Journal of general psychology.

[34]  M. R. Novick,et al.  Statistical Theories of Mental Test Scores. , 1971 .

[35]  Wells HivelyII,et al.  A “UNIVERSE‐DEFINED” SYSTEM OF ARITHMETIC ACHIEVEMENT TESTS1 , 1968 .

[36]  J. Horn Organization of abilities and the development of intelligence. , 1968, Psychological review.

[37]  J. Guilford,et al.  The nature of human intelligence. , 1968 .

[38]  R. C. Durfee,et al.  MULTIPLE FACTOR ANALYSIS. , 1967 .

[39]  Frederic M. Lord THE RELATION OF TEST SCORE TO THE TRAIT UNDERLYING THE TEST , 1952 .

[40]  H. Gulliksen Theory of mental tests , 1952 .

[41]  D. Lawley,et al.  XXIII.—On Problems connected with Item Selection and Test Construction , 1943, Proceedings of the Royal Society of Edinburgh. Section A. Mathematical and Physical Sciences.

[42]  G. Lawton THE MEASUREMENT OF ADULT INTELLIGENCE , 1939 .

[43]  J. Zubin The method of internal consistency for selecting test items. , 1934 .

[44]  M. W. Richardson,et al.  A Note on the Use of Bi-Serial R in Test Research , 1933 .

[45]  H. Hotelling Analysis of a complex of statistical variables into principal components. , 1933 .

[46]  Truman Lee Kelley,et al.  Crossroads in the Mind of Man. , 1930 .

[47]  C. Spearman,et al.  "THE ABILITIES OF MAN". , 1928, Science.

[48]  C. SPEARMAN,et al.  The Measurement of Intelligence , 1927, Nature.

[49]  L. L. Thurstone,et al.  A method of scaling psychological and educational tests. , 1925 .

[50]  J. Laird,et al.  The Nature of “Intelligence” and the Principles of Cognition , 1923, Nature.

[51]  Robert M. Yerkes,et al.  Psychological examining in the United States army. , 1921 .

[52]  S. Pressey,et al.  Group point scale for measuring general intelligence with first results from 1,100 school children. , 1918 .

[53]  A. S. Otis A criticism of the Yerkes-Bridges Point Scale, with alternative suggestions. , 1917 .

[54]  A. Binet,et al.  New investigation upon the measure of the intellectual level among school children. (L'Année Psych., 1911, pp. 145-201). , 1916 .

[55]  Th. Simon,et al.  The development of intelligence in the child. (L'Année Psych., 1908, pp. 1-90). , 1916 .

[56]  R. Yerkes,et al.  The importance of social status as indicated by the results of the Point-Scale method of measuring mental capacity. , 1915 .

[57]  Colin A. Scott General intelligence or 'school brightness'. , 1913 .

[58]  C. Spearman,et al.  GENERAL ABILITY, ITS EXISTENCE AND NATURE , 1912 .

[59]  Karl Pearson,et al.  ON A NEW METHOD OF DETERMINING CORRELATION BETWEEN A MEASURED CHARACTER A, AND A CHARACTER B, OF WHICH ONLY THE PERCENTAGE OF CASES WHEREIN B EXCEEDS (OR FALLS SHORT OF) A GIVEN INTENSITY IS RECORDED FOR EACH GRADE OF A , 1909 .

[60]  C. Spearman,et al.  Demonstration of Formulae for True Measurement of Correlation , 1907 .

[61]  Wm. R. Wright General Intelligence, Objectively Determined and Measured. , 1905 .

[62]  A. Binet,et al.  Méthodes nouvelles pour le diagnostic du niveau intellectuel des anormaux , 1904 .

[63]  Karl Pearson F.R.S. LIII. On lines and planes of closest fit to systems of points in space , 1901 .

[64]  E. A. Kirkpatrick Individual tests of school children. , 1900 .