Discourse synthesis in integrated second language writing assessment

As integrated tasks become more common in assessing writing for academic purposes, it is necessary to investigate how test takers approach these tasks. The present study explores the processes of test takers undertaking reading-to-write tasks developed for a university English placement exam. Think-aloud protocols and interviews of university-level non-native writers of English were collected to capture the writers’ composing processes. These data were analysed to determine if the tasks elicited an academic writing process of discourse synthesis and to identify what language issues were present. The results revealed some writers use discourse synthesis subprocesses in composing responses to the reading-to-write tasks, with apparent d ifferences across writers. Language difficulties that emerged for writers were vocabulary knowledge and use, as well as stylistic concerns. The implications of the study suggest that reading-to-write tasks may elicit a discourse synthesis process that could be used for validity evidence in some contexts and lead to more appropriate placement into academic writing courses.

[1]  Hameed Esmaeili,et al.  Integrated Reading and Writing Tasks and ESL Students' Reading and Writing Performance in an English Language Test , 2002 .

[2]  Tony Silva.  Toward an Understanding of the Distinct Nature of L2 Writing: The ESL Research and Its Implications , 1993 .

[3]  Alister Cumming,et al.  WRITING EXPERTISE AND SECOND LANGUAGE PROFICIENCY , 1989 .

[4]  N. Spivey,et al.  Readers as Writers Composing from Sources. , 1989 .

[5]  Nancy Nelson Spivey,et al.  The Constructivist Metaphor: Reading, Writing, and the Making of Meaning , 1996 .

[6]  C. Parkhurst.  The composition process of science writers , 1990 .

[7]  Ling Shi,et al.  Textual Borrowing in Second-Language Writing , 2004 .

[8]  Alister Cumming,et al.  Differences in written discourse in independent and integrated prototype tasks for next generation TOEFL , 2005 .

[9]  Lia Plakans,et al.  Comparing Composing Processes in Writing-Only and Reading-to-Write Test Tasks. , 2008 .

[10]  Christine B. Feak,et al.  Building on the Impromptu: A Source-Based Academic Writing Assessment. , 1996 .

[11]  Eric J. Johnson,et al.  The validity of verbal protocols , 1989, Memory & cognition.

[12]  Yuly Asención Delaney.  Investigating the reading-to-write construct , 2008 .

[13]  Lyle F. Bachman.  Statistical analyses for language assessment , 2004 .

[14]  Liz Hamp-Lyons,et al.  Issues in ESL Writing Assessment: An Overview. , 1996 .

[15]  Andrew D. Cohen.  Interfaces between Second Language Acquisition and Language Testing Research: Strategies and processes in test taking and SLA , 1999 .

[16]  Andrew D. Cohen,et al.  `I want to go back to the text': Response strategies on the reading subtest of the new TOEFL® , 2007 .

[17]  Alison Green,et al.  Verbal Protocol Analysis in Language Testing Research: A Handbook , 1998 .

[18]  Alister Cumming,et al.  Analysis of Discourse Features and Verification of Scoring Levels for Independent and Integrated Prototype Written Tasks for the New TOEFL®. TOEFL® Monograph Series. MS-30. ETS RM-05-13. , 2005 .

[19]  André A. Rupp,et al.  How assessing reading comprehension with multiple-choice questions shapes the construct: a cognitive processing perspective , 2006 .

[20]  L. Flower.  The Construction of Negotiated Meaning: A Social Cognitive Theory of Writing , 1994 .

[21]  Susan D. Bosher,et al.  The composing processes of three Southeast Asian writers at the post-secondary level: An exploratory study , 1998 .

[22]  John Read.  Providing Relevant Content in an EAP Writing Test. , 1990 .

[23]  Elana Shohamy,et al.  The test-takers' choice: an investigation of the effect of topic on language-test performance , 1999 .

[24]  P. Green.  Contrastive Rhetoric: Cross-cultural Aspects of Second-language Writing , 1997 .

[25]  Sara Cushing Weigle,et al.  Integrating reading and writing in a competency test for non-native speakers of English , 2004 .

[26]  A. Pennycook.  Borrowing Others' Words: Text, Ownership, Memory, and Plagiarism , 1996 .

[27]  J. Wilson.  Connecting Speaking and Writing in Second Language Writing Instruction , 2008 .

[28]  S. Lenski.  Strategic Knowledge when Reading in Order to Write. , 1998 .

[29]  Lyle F. Bachman.  Some reflections on task-based language performance assessment , 2002 .

[30]  Philip Shaw,et al.  Science research students' composing processes , 1991 .

[31]  Vivian Zamel.  The Composing Processes of Advanced ESL Students: Six Case Studies , 1983 .

[32]  J. Hayes,et al.  A Cognitive Process Theory of Writing , 1981, College Composition & Communication.

[33]  Miyuki Sasaki,et al.  Toward an Empirical Model of EFL Writing Processes: An Exploratory Study , 2000 .

[34]  Andrew D. Cohen,et al.  The Coming of Age of Research on Test-Taking Strategies , 2006 .

[35]  Lia Plakans,et al.  The role of reading strategies in integrated L2 writing tasks , 2009 .

[36]  Marilyn M. Cooper,et al.  Talking About Protocols. , 1983 .

[37]  Stuart Greene,et al.  The Role of Task in the Development of Academic Thinking through Reading and Writing in a College History Course. , 1993 .

[38]  George Braine,et al.  Writing in science and technology: An analysis of assignments from ten undergraduate courses , 1989 .

[39]  Andrew D. Cohen,et al.  On taking language tests , 1984 .

[40]  Liz Murphy,et al.  The use of restructuring strategies in EFL writing: A study of Spanish learners of English as a foreign language , 1999 .

[41]  Ron Scollon.  As a matter of fact: The changing ideology of authorship and responsibility in discourse , 1994 .

[42]  J. Ackerman,et al.  Reading, Writing, and Knowing: The Role of Disciplinary Knowledge in Comprehension and Composing. , 1991 .

[43]  K. A. Ericsson,et al.  Protocol Analysis: Verbal Reports as Data , 1984 .

[44]  D. Horowitz.  What Professors Actually Require: Academic Tasks for the ESL Classroom , 1986 .

[45]  Lyle F. Bachman,et al.  语言测试实践 = Language testing in practice , 1998 .