The influence of word processing on English placement test results

Abstract A study was conducted to consider two issues: (a) whether differences might emerge in writing quality when students wrote examinations by hand or on a computer and (b) whether raters differed in their evaluation of essays written by hand, on a computer, or by hand and then transcribed to typed form before scoring. A total of 480 students from a large Midwestern university were randomly assigned into one of three essay groups: (a) those who composed their responses in a traditional bluebook, (b) those who wrote in a bluebook, then had their essays transcribed into a computer, and (c) those who wrote their essays on the computer. A one-way ANOVA revealed no statistically significant differences in ratings among the three groups [F(2,475) = 1.21, ns]. The discussion centers on the need for testing programs to examine the relationship between assessment and prior writing experiences, student preferences for testing medium, and rater training regarding the possible impact of technology on scores.

[1]  C. I. Chase.  ESSAY TEST SCORING: INTERACTION OF RELEVANT VARIABLES , 1986 .

[2]  Helen J. Schwartz,et al.  The computer medium in writing for discovery , 1994 .

[3]  David K. Dickinson.  Cooperation, Collaboration, and a Computer: Integrating a Computer into a First-Second Grade Writing Program , 1986, Research in the Teaching of English.

[4]  Edward W. Wolfe,et al.  A Study of Word Processing Experience and its Effects on Student Essay Writing , 1996 .

[5]  Gail E. Hawisher.  The Effects of Word Processing on the Revision Strategies of College Freshmen , 1987 .

[6]  Edward W. Wolfe,et al.  The influence of student experience with word processors on the quality of essays written for a direct writing assessment , 1996 .

[7]  L. Barritt,et al.  Researching Practice: Evaluating Assessment Essays. , 1986 .

[8]  Hansel Burley,et al.  Postsecondary Novice and Better Than Novice Writers: Effects of Word Processing and a Very Special Computer Assisted Writing Lab. , 1994 .

[9]  Karen E. Black,et al.  Assessment in Practice: Putting Principles to Work on College Campuses , 1995 .

[10]  Donald E. Powers,et al.  Will They Think Less of My Handwritten Essay If Others Word Process Theirs? Effects on Essay Scores of Intermingling Handwritten and Word-Processed Essays. , 1994 .

[11]  Marilyn Cochran-Smith,et al.  Word Processing and Writing in Elementary Classrooms: A Critical Review of Related Literature , 1991 .

[12]  Michael Russell,et al.  Testing Writing on Computers , 1997 .

[13]  C. Haas.  How the writing medium shapes the writing process: Effects of word processing on planning , 1989 .

[14]  L. R. Markham,et al.  Influences of Handwriting Quality on Teacher Evaluation of Written Work1 , 1976 .

[15]  Susanmarie Harrington.  New Visions of Authority in Placement Test Rating. , 1998 .

[16]  Christine M. Neuwirth.  Does Word Processing Improve Students' Writing? A Critical Appraisal and Assessment. Final Report to FIPSE. , 1990 .

[17]  Barbara K. Rhodes,et al.  Computers and Revisions--Wishful Thinking or Reality?. , 1991 .

[18]  B. Huot,et al.  The Literature of Direct Writing Assessment: Major Concerns and Prevailing Trends , 1990 .

[19]  Howard Kaplan,et al.  Computers and composition : improving students' written performance. , 1986 .

[20]  Michael Russell,et al.  Testing Writing on Computers: An Experiment Comparing Student Performance on Tests Conducted via Computer and via Paper-and-Pencil , 1997 .

[21]  Cynthia L. Selfe,et al.  Critical perspectives on computers and composition instruction , 1990 .

[22]  B. Huot.  Toward a New Theory of Writing Assessment , 1996 .

[23]  Sandra Murphy,et al.  Designing Writing Tasks for the Assessment of Writing , 1988 .

[24]  E. White.  Teaching and assessing writing , 1996 .

[25]  Mike Brown,et al.  Computerized Adaptive Testing through the World Wide Web. , 1997 .

[26]  Richard H. Haswell.  Dark Shadows: The Fate of Writers at the Bottom , 1988 .

[27]  R. Linn.  Educational measurement, 3rd ed. , 1989 .

[28]  Linda Clarke,et al.  The Effect of Computer Technology on Composing Processes and Written Products of Grade 8 and Grade 12 Students. Education and Technology Series. , 1988 .

[29]  Donald A. Daiker,et al.  New Directions in Portfolio Assessment: Reflective Practice, Critical Theory, and Large-Scale Scoring , 1994 .

[30]  Richard M. Collier.  The Word Processor and Revision Strategies , 1983 .

[31]  C. Daiute,et al.  The Computer as Stylus and Audience. , 1983 .

[32]  J. B. Olsen,et al.  THE FOUR GENERATIONS OF COMPUTERIZED EDUCATIONAL MEASUREMENT , 1988 .

[33]  Gail E. Hawisher,et al.  Research into Word Processing and the Basic Writer. , 1988 .

[34]  Sarah E. Peterson.  A Comparison of Student Revisions When Composing with Pen and Paper versus Word-Processing. , 1993 .