Exploring the Feedback and Revision Features of Criterion

Criterion online essay evaluation application provides students with immediate feedback about their essay with Critique writing analysis tools. The feedback is related to grammar, usage, mechanics, style, and organization and development. The major research question in this study is whether the feedback report is helpful for students in subsequent revisions of their essays. Helpful feedback can guide students in revising an essay, and will result in a better feedback report for the essay in subsequent resubmissions (i.e., one that has fewer critical comments). A positive feedback report has significant instructional implications and it also supports the validity of Criterion, since an iterative feedback and revision process is natural to the writing process. Criterion provides a way of automating and speeding up this process with its diagnostic feedback and essay scoring capabilities.

[1]  Barbara J. Grosz,et al.  Natural-Language Processing , 1982, Artificial Intelligence.

[2]  Robert L. Bangert-Drowns,et al.  The Word Processor as an Instructional Tool: A Meta-Analysis of Word Processing in Writing Instruction , 1993 .

[3]  Douglas J. Hacker,et al.  Environmental, cognitive, and metacognitive influences on text revision: Assessing the evidence , 1996 .

[4]  Marilyn Cochran-Smith,et al.  Word Processing and Writing in Elementary Classrooms: A Critical Review of Related Literature , 1991 .

[5]  Martin Chodorow,et al.  CriterionSM Online Essay Evaluation: An Application for Automated Evaluation of Student Essays , 2003, IAAI.

[6]  Gavriel Salomon,et al.  Enhancing Writing-Related Metacognitions Through a Computerized Writing Partner , 1991 .

[7]  Sarah Warshauer Freedman,et al.  The Acquisition of Written Language: Response and Revision. Writing Research: Multidisciplinary Inquiries into the Nature of Writing Series. , 1985 .

[8]  Hayes.  identifying the organization of wi iiing processes , 1980 .

[9]  Martin Chodorow,et al.  An Unsupervised Method for Detecting Grammatical Errors , 2000, ANLP.

[10]  Paul W. H. Chung,et al.  A 'computer tutor' to assist children develop their narrative writing skills: conferencing with HARRY , 2003, Int. J. Hum. Comput. Stud..

[11]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[12]  Daniel Marcu,et al.  Finding the WRITE Stuff: Automatic Identification of Discourse Structure in Student Essays , 2003, IEEE Intell. Syst..

[13]  P. S. Gingrich,et al.  The writer's workbench: Computer aids for text analysis , 1982 .

[14]  J. Hayes.  A new framework for understanding cognition and affect in writing. , 1996 .

[15]  G. Hillocks,et al.  Research on written composition , 1986 .

[16]  D. Perkins.  The Fingertip Effect: How Information-Processing Technology Shapes Thinking , 1985 .

[17]  P. Lachenbruch.  Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[18]  Amie Goldberg,et al.  The Effect of Computers on Student Writing: A Meta-analysis of Studies from 1992 to 2002 , 2003 .

[19]  Donald H. Graves.  Research Update: One Child, One Teacher, One Classroom: The Story of One Piece of Writing--Barbara Kamler. , 1980 .

[20]  M. Scardamalia,et al.  The psychology of written composition , 1987 .

[21]  Jill Fitzgerald,et al.  Research on Revision in Writing , 1987 .