The Difficulties of Difficulty: Prompts in Writing Assessment.

This study investigated the effect of writing task topic on learner performance in a second-language writing test, in this case the Michigan English Language Assessment Battery designed to test proficiency in English as a Second Language. The 64 topics or "prompts" used in the test (offered as pairs of options) were categorized according to writing task type (expository/private; expository/public; argumentative/private; argumentative/public; and a combination of two or more of the previous types) and the categories assigned a level of difficulty. Scores received on the test were then correlated with topic iffizulty. Contrary to expectation, the mean writing score increased rather than decreased as topic difficulty increased. Implications for test construction and for rater judgment are examined. (MSE) *********************************************************************** Ic Reproductions supplied by EDRS are the best that can be made from the original document. *********************************************************************** THE DIFFICULTIES OF DIFFICULTY: PROMPTS IN WRITING ASSESSMENT Liz Hamp-Lyons an,' Sheila Prochnow

[1]  Karen L. Greenberg.  The Development and Validation of the TOEFL Writing Test: A Discussion of TOEFL Research Reports 15 and 19 , 1986 .

[2]  A. Pollitt.  What makes exam questions difficult? : an analysis of "0"grade questions and answers , 1985 .

[3]  K. Chiste,et al.  Patterns of Question Selection and Writing Performance of ESL Students , 1988 .

[4]  James Hoetker,et al.  A Procedure for Writing Content-Fair Essay Examination Topics for Large- Scale Writing Assessments , 1986 .

[5]  Marion Crowhurst,et al.  AUDIENCE AND MODE OF DISCOURSE EFFECTS ON SYNTACTIC COMPLEXITY IN WRITING AT TWO GRADE LEVELS , 1979 .

[6]  Sandra Murphy,et al.  Designing Topics for Writing Assessment: Problems of Meaning. , 1984 .

[7]  James Hoetker,et al.  The Effects of Systematic Variations in Essay Topics on the Writing Performance of College Freshmen. , 1989 .

[8]  A. Purves,et al.  Towards a Domain-Referenced System for Classifying Composition Assignments. , 1984 .

[9]  Paul J. Blohm,et al.  Effect of Question Type and Position on Measures of Conceptual Elaboration in Writing. , 1986 .

[10]  Harvey S. Wiener,et al.  Writing Assessment: Issues and Strategies , 1987 .

[11]  V. H. Meredith,et al.  Issues in Direct Writing Assessment: Problem Identification and Control. , 1984 .

[12]  Sybil B. Carlson,et al.  SURVEY OF ACADEMIC WRITING TASKS REQUIRED OF GRADUATE AND UNDERGRADUATE FOREIGN STUDENTS , 1983 .

[13]  Ronald A. Berk,et al.  A Consumer’s Guide to Setting Performance Standards on Criterion-Referenced Tests , 1986 .

[14]  E. Hamp-Lyons.  Testing second language writing in academic settings. , 1987 .

[15]  Gordon Brossell.  Rhetorical Specification in Essay Examination Topics. , 1983 .

[16]  Sarah Warshauer Freedman,et al.  Student Characteristics and Essay Test Writing Performance. , 1983 .

[17]  Bernard Mohan,et al.  Academic Writing and Chinese Students: Transfer and Developmental Factors , 1985 .

[18]  Sandra Murphy,et al.  Designing Writing Tasks for the Assessment of Writing , 1988 .

[19]  Edys S. Quellmalz,et al.  EFFECTS OF DISCOURSE AND RESPONSE MODE ON THE MEASUREMENT OF WRITING COMPETENCE , 1982 .

[20]  Edys S. Quellmalz,et al.  Toward Successful Large-Scale Writing Assessment: Where are we now? Where do we go from here? , 1984 .

[21]  Alister Cumming,et al.  WRITING EXPERTISE AND SECOND LANGUAGE PROFICIENCY , 1989 .