Automated evaluation of essays and short answers

Essay questions designed to measure writing ability, along with open-ended questions requiring short answers, are highly-valued components of effective assessment programs, but the expense and logistics of scoring them reliably often present a barrier to their use. Extensive research and development efforts at Educational Testing Service (ETS) over the past several years (see http://www.ets.org/research/erater.html) in natural language processing have produced two applications with the potential to dramatically reduce the difficulties associated with scoring these types of assessments.

[1]  Martin Chodorow,et al.  Automated Scoring Using A Hybrid Feature Identification Technique , 1998, ACL.

[2]  E. White.  Teaching and assessing writing , 1996 .

[3]  Daniel Marcu,et al.  Toward Using Text Summarization for Essay-Based Feedback , 2000 .

[4]  Gerard Salton,et al.  Automatic Text Processing: The Transformation, Analysis, and Retrieval of Information by Computer , 1989 .

[5]  Fred I. Godshalk.  The Measurement of Writing Ability. , 1966 .

[6]  Steven Abney,et al.  Part-of-Speech Tagging and Partial Parsing , 1997 .

[7]  Karen Kukich,et al.  Beyond Automated Essay Scoring , 2000 .

[8]  Ralph Grishman,et al.  Comlex Syntax: Building a Computational Lexicon , 1994, COLING.

[9]  Jan Svartvik,et al.  A __ comprehensive grammar of the English language , 1988 .

[10]  Marc Moens,et al.  Argumentative Classification of Extracted Sentences as a First Step Towards Flexible Abstracting , 1999 .

[11]  Edith M. Huddleston.  MEASUREMENT OF WRITING ABILITY AT THE COLLEGE-ENTRANCE LEVEL: OBJECTIVE VS. SUBJECTIVE TESTING TECHNIQUES , 1952 .

[12]  Kevin Knight,et al.  Automating Knowledge Acquisition for Machine Translation , 1997, AI Mag..

[13]  Daniel Marcu,et al.  Towards Automatic Classification of Discourse Elements in Essays , 2001, ACL.

[14]  Eric Brill,et al.  Unsupervised Learning of Disambiguation Rules for Part of Speech Tagging , 1995, VLC@ACL.

[15]  Kathleen R. McKeown,et al.  Cut-and-paste text summarization , 2002 .

[16]  Martin Chodorow,et al.  An Unsupervised Method for Detecting Grammatical Errors , 2000, ANLP.

[17]  Ann F. Coward.  THE METHOD OF READING THE FOREIGN SERVICE EXAMINATION IN ENGLISH COMPOSITION , 1950 .