An Overview of Computerized Adaptive Testing

In this chapter, we present a brief overview of computerized adaptive testing theory, including test design, test assembly, item bank, item selection, scoring and equating, content balance, item exposure and security. We also provide a summary of the IRT-based item selection process with a list of the commonly used item selection methods, as well as a brief outline of the tree-based adaptive testing.

[1]  David Magis,et al.  Computerized adaptive testing with R: Recent updates of the package catR , 2017 .

[2]  Chun Wang,et al.  Overview of test assembly methods in multistage testing , 2016 .

[3]  Cornelis A.W. Glas,et al.  Computerized adaptive testing : theory and practice , 2000 .

[4]  F. Lord.  A Broad-Range Tailored Test of Verbal Ability , 1975 .

[5]  Hua-Hua Chang,et al.  Computerized Adaptive Testing: A Comparison of Three Content Balancing Methods , 2003 .

[6]  Wim J. van der Linden,et al.  Bayesian Procedures for Identifying Aberrant Response-Time Patterns in Adaptive Testing , 2008 .

[7]  Julio Olea,et al.  Item Selection Rules in Computerized Adaptive Testing: Accuracy and Security , 2009 .

[8]  David Magis,et al.  Random Generation of Response Patterns under Computerized Adaptive Testing with the R Package catR , 2012 .

[9]  C. Lewis,et al.  Using Bayesian Decision Theory to Design a Computerized Mastery Test , 1990 .

[10]  Duanli Yan,et al.  Adaptive Testing With Regression Trees in the Presence of Multidimensionality , 2004 .

[11]  Duanli Yan,et al.  Computerized multistage testing : theory and applications , 2014 .

[12]  Hua-Hua Chang,et al.  A Global Information Approach to Computerized Adaptive Testing , 1996 .

[13]  Terry A. Ackerman.  Unidimensional IRT Calibration of Compensatory and Noncompensatory Multidimensional Items , 1989 .

[14]  Juan Ramón Barrada,et al.  New Item Selection Methods for Cognitive Diagnosis Computerized Adaptive Testing , 2015, Applied psychological measurement.

[15]  van der Linden,et al.  Constrained adaptive testing with shadow tests , 2000 .

[16]  Bernard P. Veldkamp.  Item Pool Design and Maintenance for Multistage Testing , 2014 .

[17]  Rebecca D. Hetter,et al.  Item exposure control in CAT-ASVAB. , 1997 .

[18]  Kelly L. Rulison,et al.  I've Fallen and I Can't Get Up: Can High-Ability Students Recover From Early Mistakes in CAT? , 2009, Applied psychological measurement.

[19]  Hua-Hua Chang,et al.  Restrictive Stochastic Item Selection Methods in Cognitive Diagnostic Computerized Adaptive Testing. , 2011 .

[20]  M. Stocking,et al.  A Model and Heuristic For Solving Very Large Item Selection Problems , 1993 .

[21]  Fumiko Samejima,et al.  A Use of the Information Function in Tailored Testing , 1977 .

[22]  Martha L. Stocking,et al.  Controlling Item Exposure Conditional on Ability in Computerized Adaptive Testing , 1998 .

[23]  Seung W. Choi,et al.  Firestar: Computerized Adaptive Testing Simulation Program for Polytomous Item Response Theory Models , 2009 .

[25]  Cornelis A.W. Glas,et al.  Modeling Rule-Based Item Generation , 2011 .

[26]  Vicente Ponsoda,et al.  A Comparison of Item Exposure Control Methods in Computerized Adaptive Testing , 1998 .

[27]  Maximum information stratification method for controlling item exposure in computerized adaptive testing. , 2006, Psicothema.

[28]  C. Glas,et al.  Elements of adaptive testing , 2010 .

[29]  V. Ponsoda,et al.  A Method for the Comparison of Item Selection Rules in Computerized Adaptive Testing , 2010 .

[30]  R. Luecht.  Computer-Assisted Test Assembly Using Optimization Heuristics , 1998 .

[31]  Wim J. van der Linden,et al.  Computerized Adaptive Testing With Item Cloning , 2003 .

[32]  Barbara G. Dodd,et al.  Computerized Adaptive Testing With Polytomous Items , 1995 .

[33]  Bor-Yaun Twu,et al.  A Comparative Study of Item Exposure Control Methods in Computerized Adaptive Testing , 1998 .

[34]  D. Magis.  A Note on the Item Information Function of the Four-Parameter Logistic Model , 2013 .

[35]  Wei-Yin Loh,et al.  Classification and regression trees , 2011, WIREs Data Mining Knowl. Discov..

[36]  Bernard P. Veldkamp,et al.  An Integer Programming Approach to Item Bank Design , 2000 .

[37]  Cornelis A.W. Glas,et al.  Adaptive mastery testing using a multidimensional IRT model , 2000 .

[38]  Willem J. van der Linden.  A Comparison of Item-Selection Methods for Adaptive Tests with Content Constraints , 2005 .

[39]  Chun Wang,et al.  Mutual Information Item Selection Method in Cognitive Diagnostic Computerized Adaptive Testing With Short Test Length , 2013 .

[40]  Bernard P. Veldkamp,et al.  Assembling a Computerized Adaptive Testing Item Pool as a Set of Linear Tests , 2006 .

[41]  Peter J. Pashley,et al.  Chapter 1 Item Selection and Ability Estimation in Adaptive Testing , 2000 .

[42]  Theo J. H. Eggen,et al.  Three-category adaptive classification testing , 2009 .

[43]  Ronald D. Armstrong,et al.  Direct and Inverse Problems of Item Pool Design for Computerized Adaptive Testing , 2009 .

[44]  M. Dennis,et al.  A Comparison of Content-Balancing Procedures for Estimating Multiple Clinical Domains in Computerized Adaptive Testing: Relative Precision, Validity, and Detection of Persons With Misfitting Responses , 2010, Applied psychological measurement.

[45]  Willem J. van der Linden,et al.  Bayesian item selection criteria for adaptive testing , 1998 .

[46]  Melvin R. Novick,et al.  Some latent train models and their use in inferring an examinee's ability , 1966 .

[47]  Peter J. Pashley,et al.  Item selection and ability estimation adaptive testing , 2010 .

[48]  Wen-Chung Wang,et al.  Variable-Length Computerized Adaptive Testing Based on Cognitive Diagnosis Models , 2013 .

[49]  M. Reckase.  Multidimensional Item Response Theory , 2009 .

[50]  Bernard P. Veldkamp,et al.  Designing Item Pools for Adaptive Testing , 2009 .

[51]  J. Mcbride,et al.  Reliability and Validity of Adaptive Ability Tests in a Military Setting , 1983 .

[52]  Daniel O. Segall.  A Sharing Item Response Theory Model for Computerized Adaptive Testing , 2004 .

[53]  Hua-Hua Chang,et al.  The maximum priority index method for severely constrained item selection in computerized adaptive testing. , 2009, The British journal of mathematical and statistical psychology.

[54]  Seung W Choi,et al.  Comparison of CAT Item Selection Criteria for Polytomous Items , 2009, Applied psychological measurement.

[55]  Hua-Hua Chang,et al.  Constraint-Weighted a-Stratification for Computerized Adaptive Testing With Nonstatistical Constraints , 2009 .

[56]  Isaac I. Bejar,et al.  A FEASIBILITY STUDY OF ON‐THE‐FLY ITEM GENERATION IN ADAPTIVE TESTING , 2002 .

[57]  N. Verhelst,et al.  On the Finiteness of the Weighted Likelihood Estimator of Ability , 2017, Psychometrika.

[58]  Angela J. Verschoor,et al.  Infeasibility in automated test assembly models: A comparison study of different methods , 2005 .

[59]  Qi Diao,et al.  Using a Universal Shadow-Test Assembler with Multistage Testing , 2014 .

[60]  Willem J. van der Linden,et al.  Optimal Assembly of Psychological and Educational Tests , 1998 .

[61]  W. J. J. Veerkamp,et al.  Some New Item Selection Criteria for Adaptive Testing , 1994 .

[62]  Anthony R. Zara,et al.  A Comparison of Procedures for Content-Sensitive Item Selection in Computerized Adaptive Tests. , 1991 .

[63]  D. Segall.  Principles of Multidimensional Adaptive Testing , 2000 .

[64]  Anthony R. Zara,et al.  Procedures for Selecting Items for Computerized Adaptive Tests. , 1989 .

[65]  David Magis,et al.  A Note on the Equivalence Between Observed and Expected Information Functions With Polytomous IRT Models , 2015 .