Assessing writing: Are we bound by only one method?

Abstract The present study describes the way one institution operationalized the notion of process-oriented writing assessment in its entry placement testing context. In an attempt to enhance how it assesses academic writing ability, a workshop-based essay test was proposed in place of the existing, traditional timed essay test. The study looked at how the tests from the two different approaches in writing assessment (product-oriented and process-oriented) affected examinees’ test performance by comparing both the textual quality of the test essays and the placement results. Content-area faculty evaluations of the examinees’ writing ability and the examinees’ view on the tests were also used in evaluating the quality of the tests. The results suggested that assessment methods have an impact on the examinees’ test performance. Even though further evidence is needed for a better understanding of the result, a traditional method of direct writing assessment seemed to put examinees at a disadvantage. The new test was implemented in the given research context and implications of writing assessment in general are discussed.

[1]  Mary K. Ruetten.  Evaluating ESL Students' Performance on Proficiency Exams. , 1994 .

[2]  Ann Raimes,et al.  Language Proficiency, Writing Ability, and Composing Strategies: A Study of ESL College Student Writers† , 1987 .

[3]  Liz Hamp-Lyons,et al.  Questioning Assumptions about Portfolio-Based Assessment , 1993 .

[4]  Hiroe Kobayashi,et al.  Effects of First Language on Second Language Writing: Translation versus Direct Composition† , 1992 .

[5]  E. White.  An Apologia for the Timed Impromptu Essay Test , 1995 .

[6]  Barbara Kroll.  Second Language Writing. Research Insights for the Classroom. , 1990 .

[7]  J. Bartko,et al.  On Various Intraclass Correlation Reliability Coefficients , 1976 .

[8]  Linda Flower,et al.  Problem-Solving Strategies and the Writing Process , 1977 .

[9]  R. Sternberg,et al.  Complex Problem Solving : Principles and Mechanisms , 1992 .

[10]  Barbara Kroll,et al.  Second Language Writing: What does time buy? ESL student performance on home versus class compositions , 1990 .

[11]  C. Michael Levy,et al.  The Science of Writing : Theories, Methods, Individual Differences and Applications , 1996 .

[12]  Barbara Kroll,et al.  Guidelines for designing writing prompts: Clarifications, caveats, and cautions , 1994 .

[13]  Vivian Zamel.  The Composing Processes of Advanced ESL Students: Six Case Studies , 1983 .

[14]  Susan D. Bosher,et al.  The composing processes of three Southeast Asian writers at the post-secondary level: An exploratory study , 1998 .

[15]  Chris Hall,et al.  Managing the Complexity of Revising Across Languages , 1990 .

[16]  A. Piolat,et al.  STUDENTS' DRAFTING STRATEGIES AND TEXT QUALITY , 1996 .

[17]  David L. Wallace,et al.  Better revision in eight minutes? Prompting first-year college writers to revise globally. , 1996 .

[18]  K. McGraw,et al.  Forming inferences about some intraclass correlation coefficients. , 1996 .

[19]  J. Hayes,et al.  A Cognitive Process Theory of Writing , 1981, College Composition & Communication.

[20]  A. Anastasi.  Evolving Concepts of Test Validation , 1986 .

[21]  R. Abbott,et al.  Assessment of planning, translating, and revising in junior high writers , 1996 .

[22]  B. Huot.  Toward a New Theory of Writing Assessment , 1996 .

[23]  S. Freedman.  Linking Large-Scale Testing and Classroom Portfolio Assessments of Student Writing , 1993 .

[24]  D. McCutchen.  A capacity theory of writing: Working memory in composition , 1996 .

[25]  Lillian S. Bridwell,et al.  Revising Strategies in Twelfth Grade Students’ Transactional Writing , 1980, Research in the Teaching of English.

[26]  Alexander Friedlander.  Second Language Writing: Composing in English: effects of a first language on writing in English as a second language , 1990 .

[27]  Ann Raimes,et al.  WHAT UNSKILLED ESL STUDENTS DO AS THEY WRITE: A CLASSROOM STUDY OF COMPOSING , 1985 .

[28]  Charlene Polio,et al.  ESL writing assessment prompts: How students choose , 1996 .

[29]  Yeonsuk Cho.  Examining a Process -Oriented Writing Assessment in a Large -Scale ESL Testing Context , 2001 .

[30]  Angie H. C. Liu,et al.  Constructing and Validating Parallel Forms of Performance-Based Writing Tasks in Academic Settings. , 1997 .

[31]  T. Lumley.  Assessment criteria in a large-scale writing test: what do they really mean to the raters? , 2002 .

[32]  M. Scardamalia,et al.  The psychology of written composition , 1987 .

[33]  M. Fayol,et al.  From sentence production to text production: Investigating fundamental processes , 1991 .

[34]  Pat Belanoff,et al.  Portfolios : process and product , 1992 .

[35]  N. Sommers.  Revision Strategies of Student Writers and Experienced Adult Writers , 1980, College Composition & Communication.

[36]  G. Wiggins.  The constant danger of sacrificing validity to reliability: Making writing assessment serve writers , 1994 .

[37]  R. T. Kellogg.  A model of working memory in writing. , 1996 .

[38]  Donald E. Powers,et al.  Effects of Applying Different Time Limits to a Proposed GRE Writing Test , 1996 .