Validity and Automad Scoring: It's Not Only the Scoring

What are the validity issues involved in automated scoring of tests? What is the nature of the interplay among construct definition, task design, examinee interface, tutorial, test development tools, and automated scoring and reporting?

[1]  Anne Ruggles Gere.  Written Composition: Toward a Theory of Evaluation. , 1980 .

[2]  Valen E. Johnson,et al.  On Bayesian Analysis of Multirater Ordinal Data: An Application to Automated Essay Grading , 1996 .

[3]  Marc M. Sebrechts,et al.  The Accuracy of Expert-System Diagnoses of Mathematical Problem Solutions , 1996 .

[4]  Henry Braun,et al.  Scoring Constructed Responses Using Expert Systems , 1990 .

[5]  Isaac I. Bejar,et al.  A sentence-based automated approach to the assessment of writing: a feasibility study , 1987 .

[6]  Isaac I. Bejar,et al.  A methodology for scoring open-ended architectural design problems. , 1991 .

[7]  Marc M. Sebrechts,et al.  Agreement between expert-system and human raters' scores on complex constructed-response quantitative items. , 1991 .

[8]  Martin Chodorow,et al.  Computer Analysis of Essay Content for Automated Score Prediction , 1998 .

[9]  Terry A. Ackerman,et al.  A Comparison of the Information Provided by Essay, Multiple-Choice, and Free-Response Writing Tests , 1988 .

[10]  Kathleen Blake Yancey,et al.  On the nature of holistic scoring: An inquiry composed on email , 1994 .

[11]  C. Hirsch.  Curriculum and Evaluation Standards for School Mathematics , 1988 .

[12]  L. Crocker,et al.  Validation Methods for Direct Writing Assessment , 1990 .

[13]  William Wresch,et al.  The Imminence of Grading Essays by Computer-25 Years Later , 1993 .

[14]  E. B. Page,et al.  The Computer Moves into Essay Grading: Updating the Ancient Test. , 1995 .

[15]  Randy Elliot Bennett,et al.  Evaluating an Automatically Scorable, Open-Ended Response Type for Measuring Mathematical Reasoning in Computer-Adaptive Tests. , 1997 .

[16]  Geoffrey R. Norman,et al.  Performance-Based Assessment: Lessons From the Health Professions , 1995 .

[17]  Stephen G. Clyman,et al.  Scoring a Performance-Based Assessment by Modeling the Judgments of Experts , 1995 .

[18]  S. Whitely.  Construct validity: Construct representation versus nomothetic span. , 1983 .

[19]  A. Laduca,et al.  Item modelling procedure for constructing content‐equivalent multiple choice questions , 1986, Medical education.