Ability Measurement: Conventional or Adaptive.

Abstract : Research to date on adaptive (sequential, branched, individualized, tailored, programmed, response-contingent) ability testing is reviewed and summarized, following a brief review of problems inherent in conventional individual and group approaches to ability measurement. Research reviewed includes empirical, simulation and theoretical studies of adaptive testing strategics. A number of new psychometric problems raised by adaptive testing are discussed, as is the criterion problem in evaluating the utility of adaptive testing. Problems of implementing adaptive testing in a paper and pencil mode, or using special testing machines are reviewed; the advantages of computer-controlled adaptive test administration are described. (Author Modified Abstract)

[1]  Julian C. Stanley,et al.  Differential Weighting: A Review of Methods and Empirical Studies1 , 1970 .

[2]  H. Angelino,et al.  The effects of item difficulty sequencing and anxiety reaction type on aptitude test performance. , 1969, The Journal of psychology.

[3]  William J. Moonan.  Some Empirical Aspects of the Sequential Analysis Technique as Applied to an Achievement Examination , 1950 .

[4]  R. N. Marso.  Test Item Arrangement, Testing Time, and Performance. , 1970 .

[5]  S. Guze,et al.  The relationship between anxiety level and several measures of intelligence. , 1954, Journal of consulting psychology.

[6]  M. L. Schwartz.  The scoring of WAIS comprehension responses by experienced and inexperienced judges. , 1966, Journal of clinical psychology.

[7]  Examiner expectancy: Effects on the scoring of the wisc , 1969 .

[8]  P. H. Dubois.  A history of psychological testing , 1970 .

[9]  C. Hoyt.  Test reliability estimated by analysis of variance , 1941 .

[10]  W. A. Hunt,et al.  The difficulty of WAIS comprehension scoring. , 1965, Journal of clinical psychology.

[11]  Jerome M. Sattler,et al.  Halo effect in examiner scoring of intelligence test responses. , 1970 .

[12]  C. A. Clark.  THE USE OF SEPARATE ANSWER SHEETS IN TESTING SLOW‐LEARNING PUPILS , 1968 .

[13]  F. Lord.  DO TESTS OF THE SAME LENGTH HAVE THE SAME STANDARD ERROR OF MEASUREMENT , 1956 .

[14]  A G Bayroff,et al.  AN EXPLORATORY STUDY OF BRANCHING TESTS , 1967 .

[15]  Gilbert Sax,et al.  THE EFFECTS OF VARIOUS FORMS OF ITEM ARRANGEMENTS ON TEST PERORMANCE , 1966 .

[16]  J. A. Thomas,et al.  Construction of an Experimental Sequential Item Test. , 1960 .

[17]  Study of Linearity and Homoscedasticity of Test Scores in the Chance Range , 1968 .

[18]  G. Rasch,et al.  An item analysis which takes individual differences into account. , 1966, The British journal of mathematical and statistical psychology.

[19]  Frederic M. Lord,et al.  The relation of the reliability of multiple-choice tests to the distribution of item difficulties , 1952 .

[20]  M. A. Merrill,et al.  Stanford-Binet Intelligence Scale , 1972 .

[21]  D. Wechsler.  Manual for the Wechsler Adult Intelligence Scale. , 1955 .

[22]  Milton A. Whitcomb.  The IBM Answer Sheet as a Major Source of Variance on Highly Speeded Tests , 1958 .

[23]  Rebecca Bryson.  Shortening Test: Effects of Method Used, Length, and Internal Consistency on Correlation with Total Score: (465522008-005) , 1973 .

[24]  F. Baker.  AN INTERSECTION OF TEST SCORE INTERPRETATION AND ITEM ANALYSIS1 , 1964 .

[25]  G. Mandler,et al.  The effect of differential instructions on anxiety and learning. , 1952, Journal of abnormal psychology.

[26]  M. L. Hutt.  A clinical study of consecutive and adaptive testing with the revised Stanford-Binet. , 1947, Journal of consulting psychology.

[27]  Clyde H. Coombs,et al.  The Assessment of Partial Knowledge1 , 1956 .

[28]  W. May,et al.  Influence of the Examiner on the Itpa Scores of Negro Children , 1967, Psychological reports.

[29]  M. R. Novick,et al.  Statistical Theories of Mental Test Scores. , 1971 .

[30]  Test difficulty, reliability, and discrimination as functions of item difficulty order. , 1964 .

[31]  M. Stocking.  SHORT TAILORED TESTS. , 1969 .

[32]  Carrie Wherry Waters,et al.  A Comparison of Computer-Simulated Conventional and Branching Tests , 1971 .

[33]  G. Mandler,et al.  A study of anxiety and learning. , 1952, Journal of abnormal psychology.

[34]  Donald A. Rock,et al.  REPRODUCTION OF TOTAL TEST SCORE THROUGH THE USE OF SEQUENTIAL PROGRAMMED TESTS1 , 1968 .

[35]  Frederick B. Davis,et al.  The Effect on Test Reliability and Validity of Scoring Aptitude and Achievement Tests With Weights for Every Choice , 1959 .

[36]  D. C. Charles,et al.  Scoring difficulty of Wechsler comprehension responses. , 1955 .

[37]  Richard L. Ferguson,et al.  The Application of Item Generators for Individualizing Mathematics Testing and Instruction. , 1971 .

[38]  D. R. Stone,et al.  Serial versus consecutive order administration of the Stanford-Binet Intelligence Scales. , 1950, Journal of consulting psychology.

[39]  S. Huck,et al.  ITEM DIFFICULTY LEVEL AND SEQUENCE EFFECTS IN MULTIPLE-CHOICE ACHIEVEMENT TESTS , 1972 .

[40]  Frederic M. Lord,et al.  THE SELF‐SCORING FLEXILEVEL TEST1 , 1971 .

[41]  Robert B. Frary,et al.  Effect of Variation in Probability of Guessing Correctly on Reliability of Multiple-Choice Tests , 1970 .

[42]  W. Roth,et al.  An on-line computer system for initial psychiatric inventory. , 1969, The American journal of psychiatry.

[43]  R. Nichols.  The effect of ego involvement and success experience on intelligence test results. , 1959 .

[44]  The effects of anxiety and item difficulty sequence on achievement testing scores. , 1968, The Journal of psychology.

[45]  Edith Lucille Marine.  The effect of familiarity with the examiner upon Stanford-Binet test performance , 1929 .

[46]  F. Lord.  A theory of test scores. , 1952 .

[47]  D. Peters,et al.  The Effects of Question Sequence Upon Objective Test Performance. , 1970 .

[48]  Gilbert Sax,et al.  An Investigation of Response Sets on Altered Parallel Forms , 1962 .

[49]  J. J. Hedl.  An Evaluation of a Computer-Based Intelligence Test. , 1971 .

[50]  Frederic M. Lord,et al.  SOME TEST THEORY FOR TAILORED TESTING , 1968 .

[51]  Roger J. Owen.  A BAYESIAN APPROACH TO TAILORED TESTING , 1969 .

[52]  Donald A. Rock,et al.  An Exploratory Study of Programmed Tests , 1968 .

[53]  J. Sattler,et al.  Personality variables affecting WAIS scores. , 1971, Journal of consulting and clinical psychology.

[54]  J. Sattler.  Statistical Reanalysis of Canady's “The Effect of ‘Rapport’ on the I. Q.: A New Approach to the Problem of Racial Psychology” , 1966, Psychological reports.

[55]  F. Davis,et al.  Item analysis in relation to educational and psychological testing. , 1952, Psychological bulletin.

[56]  C. Taylor,et al.  ADAPTIVE TESTING IN AN OLDER POPULATION. , 1965, The Journal of psychology.

[57]  G. Spache.  SERIAL TESTING WITH THE REVISED STANFORD‐BINET SCALE, FORM L, IN THE TEST RANGE II‐XIV , 1942 .

[58]  M. Y. Quereshi.  Intelligence test scores as a function of sex of experimenter and sex of subject. , 1968, The Journal of psychology.

[59]  J. Masling.  The effects of warm and cold interaction on the administration and scoring of an intelligence test. , 1959 .

[60]  P. Armitage.  Sequential Analysis with More than Two Alternative Hypotheses, and its Relation to Discriminant Function Analysis , 1950 .

[61]  J. Sattler,et al.  Intelligence testing procedures as affected by expectancy and IQ , 1970 .

[62]  W. Simon.  EXPECTANCY EFFECTS IN THE SCORING OF VOCABULARY ITEMS: A STUDY OF SCORER BIAS1 , 1969 .

[63]  Variations in Wisc Performances as Influenced by Differences in Pretest Rapport. , 1966, The Journal of general psychology.

[64]  H. Stevenson,et al.  ADULT PERFORMANCE AS A FUNCTION OF SEX OF EXPERIMENTER AND SEX OF SUBJECT. , 1964, Journal of abnormal psychology.

[65]  Frederic M. Lord.  THE SELF‐SCORING FLEXILEVEL TEST* , 1970 .

[66]  S. Baratz.  Effect of race of experimenter, instructions, and comparison population upon level of reported anxiety in negro subjects. , 1967 .

[67]  Richard L. Ferguson.  A Model for Computer-Assisted Criterion- Referenced Measurement. , 1970 .

[68]  David L. Elwood,et al.  Individual Intelligence Testing Without the Examiner: Reliability of an Automated Method. , 1972 .

[69]  Leonard C Seeley,et al.  EXPLORATORY STUDY OF A SEQUENTIAL ITEM TEST , 1962 .

[70]  Gary Echternacht,et al.  The Use of Confidence Testing In Objective Tests , 1971 .

[71]  F. Lord.  Tests of the Same Length do Have the Same Standard Error of Measurement , 1957 .

[72]  Robert L. Ebel,et al.  Expected Reliability as a Function of Choices Per Item , 1969 .

[73]  E S Johnson,et al.  The computer as experimenter. , 1967, Behavioral science.

[74]  L. Morris,et al.  Effects of anxiety on timed and untimed intelligence tests: another look. , 1969, Journal of Consulting and Clinical Psychology.

[75]  Dudley J. Cowden,et al.  An Application of Sequential Sampling to Testing Students , 1946 .

[76]  Rebecca Bryson.  A Comparison of Four Methods of Selecting Items for Computer Assisted Testing , 1971 .

[77]  A. W. Siegman.  The effect of manifest anxiety on a concept formation task, a nondirected learning task and on timed and untimed intelligence tests. , 1956, Journal of consulting psychology.

[78]  Melvin R. Novick.  BAYESIAN METHODS IN PSYCHOLOGICAL TESTING , 1969 .

[79]  Wayne H. Holtzman,et al.  Computer-assisted instruction, testing, and guidance , 1970 .

[80]  E. Sacks.  Intelligence scores as a function of experimentally established social relationships between child and examiner. , 1952, Journal of abnormal psychology.

[81]  R. Evans.  A SUGGESTED USE OF SEQUENTIAL ANALYSIS IN PERFORMANCE ACCEPTANCE TESTING , 1953 .

[82]  L. Cronbach,et al.  Psychological tests and personnel decisions , 1958 .

[83]  D. Gilman,et al.  INCREASING TEST RELIABILITY THROUGH SELF-SCORING PROCEDURES , 1972 .

[84]  V. Cieutat,et al.  Examiner Differences with the Stanford-Binet IQ , 1965, Perceptual and motor skills.

[85]  D. Feldman,et al.  Systematic Scoring of Ranked Distractors for the Assessment of Piagetian Reasoning Levels 1 , 1971 .

[86]  C. Greenbaum,et al.  Effects of anxiety, threat, and racial environment on task performance of Negro college students. , 1963, Journal of abnormal and social psychology.