Washback to learning outcomes: a comparative study of IELTS preparation and university pre‐sessional language courses

This study investigated whether dedicated test preparation classes gave learners an advantage in improving their writing test scores. Score gains following instruction on a measure of academic writing skills—the International English Language Testing System (IELTS) academic writing test—were compared across language courses of three types; all designed for international students preparing for entry to UK universities. Course types included those with a test preparation focus, those designed to introduce students to academic writing in the university setting and those combining the two. In addition to IELTS academic writing test scores, data relating to differences in participants and practices across courses were collected through supplementary questionnaire and test instruments. To take account of the large number of moderating variables and non‐linearity in the data, a neural network approach was used in the analysis. Findings indicated no clear advantage for focused test preparation.

[1]  Joan Turner,et al.  Language as academic purpose , 2004 .

[2]  C. Snyder,et al.  Can high stakes national testing improve instruction: reexamining conventional wisdom , 2000 .

[3]  D. Horowitz.  What Professors Actually Require: Academic Tasks for the ESL Classroom , 1986 .

[4]  Tim Moore,et al.  Authenticity in the IELTS Academic Module Writing Test: a comparative study of Task 2 items and university assignments , 1999 .

[5]  James E. Purpura,et al.  Investigating the effects of strategy use and second language test performance with high- and low-ability test takers: a structural equation modelling approach , 1998 .

[6]  B. Rosenshine.  High-stakes Testing: Another Analysis , 2003 .

[7]  Anthony Green,et al.  Ielts Washback in Context: Preparation for Academic Writing in Higher Education , 2007 .

[8]  Peter Mickan,et al.  Text analysis and the assessment of academic writing , 2003 .

[9]  J. Read,et al.  IELTS Test Preparation in New Zealand: Preparing Students for the IELTS Academic Module , 2004 .

[10]  Caroline Clapham,et al.  Assessment for Academic Purposes: Where Next?. , 2000 .

[11]  Yoshino Watanabe.  Teacher Factors Mediating Washback , 2004 .

[12]  Roger Hawkey,et al.  Impact theory and practice : studies of the IELTS test and Progetto Lingue 2000 , 2006 .

[13]  Jose C. Principe,et al.  Neural and adaptive systems : fundamentals through simulations , 2000 .

[14]  Christine Pearson Casanave,et al.  Writing Games: Multicultural Case Studies of Academic Literacy Practices in Higher Education , 2002 .

[15]  G. David Garson,et al.  Neural Networks: An Introductory Guide for Social Scientists , 1999 .

[16]  Kim Hughes,et al.  Use of an expert system to predict language learning success , 1997 .

[17]  R. K. Johnson,et al.  L2 Learner Variables and English Achievement: A Study of Tertiary-level English Majors in China , 1997 .

[18]  Caroline Coffin,et al.  Arguing about How the World Is or How the World Should Be: The Role of Argument in IELTS Tests. , 2004 .

[19]  George M. Blue,et al.  Assessing English for academic purposes , 2000 .

[20]  G. Fulcher.  Assessment in English for academic purposes: putting content validity in its place , 1999 .

[21]  Bernard Spolsky,et al.  第二語言學習的條件 = Conditions for second language learning : introduction to a general theory , 1989 .

[22]  P. Skehan.  Individual Differences in Second Language Learning , 1989 .

[23]  Dianne Wall,et al.  The Impact of High-Stakes Examinations on Classroom Teaching: A case study using insights from testing and innovation theory , 2006 .

[24]  Paul Nation,et al.  Teaching and learning vocabulary , 1994 .

[25]  Willis Edmondson,et al.  The study of second language acquisition , 1995 .

[26]  V. Kvasnicka,et al.  Neural and Adaptive Systems: Fundamentals Through Simulations , 2001, IEEE Trans. Neural Networks.

[27]  Rod Ellis,et al.  The Study of Second Language Acquisition , 1994 .

[28]  J. Charles Alderson,et al.  Does Washback Exist , 1993 .

[29]  The British Council , 1945, Nature.

[30]  Fred Genesee,et al.  Individual differences in second language learning , 1978, Applied Psycholinguistics.

[31]  D. Berliner,et al.  High-stakes testing, uncertainty, and student learning , 2002 .

[32]  Elana Shohamy,et al.  Test impact revisited: washback effect over time , 1996 .

[33]  David C. Berliner,et al.  High-Stakes Testing & Student Learning , 2002 .

[34]  L. Qi.  Has a High-Stakes Test Produced the Intended Changes? , 2004 .

[35]  Liying Cheng,et al.  Changing Language Teaching through Language Testing: A Washback Study , 2006 .