Exploiting Computerized Adaptive Testing for Self-Directed Learning

Self-directed learning enables learners to take responsibility for and to design their own learning-related activities. Frequent assessments facilitate self-directed learners to monitor learning regularly. Often, quizzes with multiple-choice (MC), true-false, or fill-in-the-gap items are a quick way of gathering information on the strengths and weakness of learners. Although with limitations, such kinds of items can assess both low-level (e.g., fact recall and comprehension) and high-level (e.g., application, analysis, and evaluation) thinking and are particularly suitable for online computerized testing, largely because they can be scored by computers. This chapter starts with an introduction to traditional paper-and-pencil testing, followed by computer-based testing, and six commonly used test delivery models. Then, key features, underlying measurement theory, major steps, and constructions of computerized adaptive testing, are described. This chapter ends with some concluding remarks and discussion of future developments of CAT.

[1]  Melvin R. Novick,et al.  Some latent train models and their use in inferring an examinee's ability , 1966 .

[2]  M. R. Novick,et al.  Statistical Theories of Mental Test Scores. , 1971 .

[3]  F. Lord A Broad-Range Tailored Test of Verbal Ability , 1975 .

[4]  D. Andrich A rating formulation for ordered response categories , 1978 .

[5]  F. Lord Applications of Item Response Theory To Practical Testing Problems , 1980 .

[6]  Georg Rasch,et al.  Probabilistic Models for Some Intelligence and Attainment Tests , 1981, The SAGE Encyclopedia of Research Design.

[7]  R. D. Bock,et al.  Adaptive EAP Estimation of Ability in a Microcomputer Environment , 1982 .

[8]  G. Masters A rasch model for partial credit scoring , 1982 .

[9]  David J. Weiss,et al.  Book Review : New Horizons in Testing: Latent Trait Test Theory and Computerized Adaptive Testing David J. Weiss (Ed.) New York: Academic Press, 1983, 345 pp., $35.00 , 1984 .

[10]  J. Mcbride,et al.  Reliability and Validity of Adaptive Ability Tests in a Military Setting , 1983 .

[11]  David J. Weiss,et al.  A Comparison of IRT-Based Adaptive Mastery Testing and a Sequential Mastery Testing Procedure , 1983 .

[12]  R. Hambleton,et al.  Item Response Theory: Principles and Applications , 1984 .

[13]  R. Hambleton,et al.  Item Response Theory , 1984, The History of Educational Measurement.

[14]  Howard Wainer,et al.  Item Clusters and Computerized Adaptive Testing: A Case for Testlets , 1987 .

[15]  Anthony R. Zara,et al.  Procedures for Selecting Items for Computerized Adaptive Tests. , 1989 .

[16]  C. Lewis,et al.  Using Bayesian Decision Theory to Design a Computerized Mastery Test , 1990 .

[17]  H. Wainer,et al.  Toward a Psychometrics for Testlets , 1989 .

[18]  Kathleen M. Sheehan,et al.  Computerized Mastery Testing With Nonequivalent Testlets , 1990 .

[19]  Martha L. Stocking,et al.  A New Method of Controlling Item Exposure in Computerized Adaptive Testing. , 1995 .

[20]  Cynthia G. Parshall,et al.  New Algorithms for Item Selection and Exposure Control with Computerized Adaptive Testing. , 1995 .

[21]  Walter D. Way Protecting the Integrity of Computerized Testing Item Pools , 1998 .

[22]  Martin Chodorow,et al.  Computer Analysis of Essay Content for Automated Score Prediction , 1998 .

[23]  Vicente Ponsoda,et al.  A Comparison of Item Exposure Control Methods in Computerized Adaptive Testing , 1998 .

[24]  Richard M. Luecht,et al.  Some Practical Examples of Computer‐Adaptive Sequential Testing , 1998 .

[25]  Z. Ying,et al.  a-Stratified Multistage Computerized Adaptive Testing , 1999 .

[26]  Howard Wainer,et al.  Computerized Adaptive Testing: A Primer , 2000 .

[27]  B. Junker,et al.  Cognitive Assessment Models with Few Assumptions, and Connections with Nonparametric Item Response Theory , 2001 .

[28]  Z. Ying,et al.  a-Stratified Multistage Computerized Adaptive Testing with b Blocking , 2001 .

[29]  Hua-Hua Chang,et al.  Item Selection in Computerized Adaptive Testing: Improving the a-Stratified Design with the Sympson-Hetter Algorithm , 2002 .

[30]  Ronald K. Hambleton,et al.  Comparison of the Psychometric Properties of Several Computer-Based Test Designs for Credentialing Exams With Multiple Purposes , 2002 .

[31]  Wim J van der Linden,et al.  Constraining Item Exposure in Computerized Adaptive Testing With Shadow Tests , 2002 .

[32]  Hua-Hua Chang,et al.  Optimal Stratification of Item Pools in α-Stratified Computerized Adaptive Testing , 2003 .

[33]  Shu-ying Chen,et al.  Effects of Practical Constraints on Item Selection Rules at the Early Stages of Computerized Adaptive Testing , 2004 .

[34]  Anastasios A. Economides,et al.  A Review of Item Exposure Control Strategies for Computerized Adaptive Testing Developed from 1983 to 2005 , 2007 .

[35]  Hua-Hua Chang,et al.  Combining computer adaptive testing technology with cognitively diagnostic assessment , 2008, Behavior research methods.

[36]  Theo J. H. Eggen,et al.  Three-category adaptive classification testing , 2009 .

[37]  Ying Cheng When Cognitive Diagnosis Meets Computerized Adaptive Testing: CD-CAT , 2009 .

[38]  James W Pellegrino,et al.  Technology and Testing , 2009, Science.

[39]  Ronald K. Hambleton,et al.  Multistage Testing: Issues, Designs, and Research , 2009 .

[40]  Nathan A. Thompson Item Selection in Computerized Classification Testing , 2009 .

[41]  Jonathan Templin,et al.  Diagnostic Measurement: Theory, Methods, and Applications , 2010 .

[42]  Wen-Chung Wang,et al.  Computerized Classification Testing Under the Generalized Graded Unfolding Model , 2011 .

[43]  C. Glas,et al.  Elements of adaptive testing , 2010 .

[44]  Yigal Attali A Differential Word Use Measure for Content Analysis in Automated Essay Scoring. Research Report. ETS RR-11-36. , 2011 .

[45]  Wen-Chung Wang,et al.  Computerized Classification Testing Under the One-Parameter Logistic Response Model With Ability-Based Guessing , 2011 .