Task Type and Prompt Effect on Test Performance: A Focus on IELTS Academic Writing Tasks

Recent versions of international high-stakes tests like TOEFL and IELTS have made use of integrated tasks in addition to the traditional independent tasks in a claim to provide a more realistic estimation of the test takers’ language abilities. The present study aimed to investigate how test takers’ performance may differ on such tasks. As such, the test takers’ performance was compared on IELTS Academic Writing Tasks 1 and 2. Whereas Task 1 is an integrated task which calls for graphic interpretation and description, Task 2 is an independent task of writing an argumentative essay. Furthermore, the study also aimed to investigate the effect of writing prompts on the test takers’ performance on such tasks. The study adopted a quasi-experimental design in the form of posttest-only group. Fifty six Iranian EFL learners at Shiraz University were selected based on their availability. After receiving instruction in a semester on how to do the two tasks, they received 4 writing tasks (2 versions of each task with different prompts). The data collected were analyzed through two-way repeated-measures ANOVA. The results indicated that task type did not have a significant effect on the test takers’ writing performance; that is, there were no significant differences between the participants’ performance on the independent and integrated writing tasks. Furthermore, the effect of prompts was only found to be significant on the participants’ performance on task 2 (independent task). The findings provide evidence for higher consistency of scores obtained from different versions of the integrated task.

[1]  Carolyn E. Turner,et al.  Systematic effects in the rating of second-language speaking ability: test method and learner discourse , 1999 .

[2]  Rob Schoonen,et al.  Generalizability of writing scores: an application of structural equation modeling , 2005 .

[3]  B. Tabachnick,et al.  Using multivariate statistics, 5th ed. , 2007 .

[4]  Hui-Chun Yang.  Modeling the Relationships between Test-Taking Strategies and Test Performance on a Graph-Writing Task: Implications for EAP. , 2012 .

[5]  Atta Gebril,et al.  Score generalizability of academic writing tasks: Does one test method fit it all? , 2009 .

[6]  A. Green.  EAP study recommendations and score gains on the IELTS Academic Writing test , 2005 .

[7]  Liang Guo,et al.  Product and Process in Toefl iBT Independent and Integrated Writing Tasks: A Validation Study , 2011 .

[8]  J. Read,et al.  The impact of IELTS on preparation for academic study in New Zealand , 2003 .

[9]  P. Lachenbruch.  Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[10]  Sara Cushing Weigle,et al.  Integrating reading and writing in a competency test for non-native speakers of English , 2004 .

[11]  Elana Shohamy,et al.  The test-takers' choice: an investigation of the effect of topic on language-test performance , 1999 .

[12]  Lia Plakans,et al.  Discourse synthesis in integrated second language writing assessment , 2009 .

[13]  Gillian Wigglesworth,et al.  Task.design in IELTS academic writing task 1: The effect of quantity and manner of presentation of information on candidate writing , 2003 .

[14]  Yong-Won Lee,et al.  DEPENDABILITY OF NEW ESL WRITING TEST SCORES: EVALUATING PROTOTYPE TASKS AND ALTERNATIVE RATING SCHEMES , 2005 .

[15]  Barbara Kroll,et al.  Guidelines for designing writing prompts: Clarifications, caveats, and cautions , 1994 .

[16]  B. Tabachnick,et al.  Using Multivariate Statistics , 1983 .

[17]  Yeonsuk Cho,et al.  Assessing writing: Are we bound by only one method? , 2003 .

[18]  Ling Shi,et al.  Topical knowledge and ESL writing , 2012 .

[19]  Sylvia A. Holladay.  Integrating Reading and Writing. , 1988 .

[20]  Liz Hamp-Lyons,et al.  Issues in ESL Writing Assessment: An Overview. , 1996 .

[21]  Anthony Green,et al.  Washback to learning outcomes: a comparative study of IELTS preparation and university pre‐sessional language courses , 2007 .

[22]  Sam McCarter.  Academic Writing Practice for IELTS , 2008 .

[23]  Yeonsuk Cho,et al.  Investigating the effects of prompt characteristics on the comparability of TOEFL iBT™ integrated writing tasks , 2013 .

[24]  Susan M. Gass,et al.  Second Language Research: Methodology and Design , 2021 .

[25]  Katherine Golder,et al.  Determination of Appropriate IELTS Writing and Speaking Band Scores for Admission into Two Programs at a Canadian Post-Secondary Polytechnic Institution , 2011 .

[26]  Janna Fox,et al.  From Products to Process: An Ecological Approach to Bias Detection , 2003 .

[27]  Lia Plakans.  Second language writing and reading -to -write assessment tasks: A process study , 2007 .

[28]  h.c. August-Wilhelm Scheer.  Modeling the Relationships between the Views (Control View) , 2000 .

[29]  Janne Morton,et al.  Authenticity in the IELTS academic writing & module test: a comparative study of Task 2 items & University research , 1999 .

[30]  Atta Gebril,et al.  Investigating Source Use, Discourse Features, and Process in Integrated Writing Tests , 2009 .

[31]  N. Charge,et al.  Recent developments in IELTS , 1997 .

[32]  Janne Morton,et al.  Dimensions of difference: a comparison of university writing and IELTS writing , 2005 .

[33]  Xiaohong Gao,et al.  Variability of Estimated Variance Components and Related Statistics in a Performance Assessment , 2001 .

[34]  Peter Mickan,et al.  Study of response validity of the IELTS writing subtest , 2000 .

[35]  Tim Moore,et al.  Authenticity in the IELTS Academic Module Writing Test: a comparative study of Task 2 items and university assignments , 1999 .

[36]  S. Chong,et al.  IELTS as an indicator of written proficiency levels: A study of student teachers at the National Institute of Education, Singapore , 2013 .

[37]  Priti Shah,et al.  Bar and Line Graph Comprehension: An Interaction of Top-Down and Bottom-Up Processes , 2011, Top. Cogn. Sci..

[38]  Susan N. Friel,et al.  Making sense of graphs: Critical factors influencing comprehension and instructional implications. , 2001 .

[39]  H. Uysal.  A critical review of the IELTS writing test , 2010 .