Evaluation of Implied Orders as a Basis for Tailored Testing with Simulation Data

Monte carlo research with TAILOR, a program using Implied Orders as a basis for tailored testing, is reported. Birnbaum's (1968) three-parameter logistic model was used to generate data matrices under a variety of simulated conditions. It was found that TAILOR typically required about half the available items to estimate for each simulated examinee the responses on the remainder. Validity of Tailored score with True score was found to be within a few points of True score with Complete test score. Increasing item discrimination affected the efficiency of the tailored test, but the procedure was little affected by any of a variety of other fac tors.

[1]  Norman Cliff,et al.  Test theory without true scores? , 1979 .

[2]  Douglas McCormick,et al.  Monte Carlo Evaluation of Implied Orders As a Basis for Tailored Testing , 1978 .

[3]  Norman Cliff,et al.  Tailor-Apl: An Interactive Computer Program for Individual Tailored Testing , 1977 .

[4]  Norman Cliff,et al.  Tailor: A Fortran Procedure for Interactive Tailored Testing , 1977 .

[5]  Norman Cliff.  Evaluations of Implied Orders as a Basis for Tailored Testing Using Simulations. Technical Report No. 4. , 1977 .

[6]  David J. Weiss.  Proceedings of the 1977 Computerized Adaptive Testing Conference , 1977 .

[7]  Vern W. Urry,et al.  TAILORED TESTING: A SUCCESSFUL APPLICATION OF LATENT TRAIT THEORY* , 1977 .

[8]  James R. McBride.  Some Properties of a Bayesian Adaptive Ability Testing Strategy , 1977 .

[9]  Norman Cliff,et al.  Complete orders from incomplete data: Interactive ordering and tailored testing. , 1975 .

[10]  Carl J. Jensema,et al.  The Validity of Bayesian Tailored Testing , 1974 .

[11]  Vern W. Urry,et al.  Approximations to Item Parameters of Mental Test Models and Their Uses1 , 1974 .

[12]  Frederic M. Lord,et al.  A Theoretical Study of Two-Stage Testing. , 1971 .

[13]  Wayne H. Holtzman,et al.  Computer-assisted instruction, testing, and guidance , 1970 .

[14]  M. R. Novick,et al.  Statistical Theories of Mental Test Scores. , 1971 .

[15]  Frederic M. Lord,et al.  SOME TEST THEORY FOR TAILORED TESTING , 1968 .

[16]  Donald Ervin Knuth,et al.  The Art of Computer Programming , 1968 .

[17]  Melvin R. Novick,et al.  Some latent train models and their use in inferring an examinee's ability , 1966 .

[18]  J. Loevinger,et al.  The attenuation paradox in test theory. , 1954, Psychological bulletin.