A multifaceted approach to investigating pre-task planning effects on paired oral test performance

Despite the growing popularity of paired format speaking assessments, the effects of pre-task planning time on performance in these formats are not yet well understood. For example, some studies have revealed the benefits of planning but others have not. Using a multifaceted approach including analysis of the process of speaking performance, the aim of this paper is to investigate the effect of pre-task planning in a paired format. Data were collected from 32 students who carried out two decision-making tasks in pairs, under planned and unplanned conditions. The study used analyses of rating scores, discourse analytic measures, and conversation analysis (CA) of test-taker discourse to gain insight into co-constructing processes. A post-test questionnaire was also administered to understand the participants’ perceptions toward planned and unplanned interactions. The results from rating scores and discourse analytic measures revealed that planning had limited effect on performance, and analysis of the questionnaires did not indicate clear differences between the two conditions. CA, however, identified the possibility of a contrastive mode of discourse under the two planning conditions, raising concerns that planning might actually deprive test-takers of the chance to demonstrate their abilities to interact collaboratively.

[1]  Uta Mehnert,et al.  THE EFFECTS OF DIFFERENT LENGTHS OF TIME FOR PLANNING ON SECOND LANGUAGE PERFORMANCE , 1998, Studies in Second Language Acquisition.

[2]  John R. Bormuth,et al.  CLOZE TEST READABILITY: CRITERION REFERENCE SCORES , 1968 .

[3]  R. Ellis The Differential Effects of Three Types of Task Planning on the Fluency, Complexity, and Accuracy in L2 Oral Production , 2009 .

[4]  Virginia Samuda,et al.  Tasks in Second Language Learning , 2007 .

[5]  吉島 茂,et al.  文化と言語の多様性の中のCommon European Framework of Reference for Languages: Learning, teaching, assessment (CEFR)--それは基準か? (第10回明海大学大学院応用言語学研究科セミナー 講演) , 2008 .

[6]  P. Skehan 语言学习认知法 = A cognitive approach to language learning , 1998 .

[7]  B. Wright Reasonable mean-square fit values , 1994 .

[8]  Jack Whalen,et al.  Sociology as a Natural Observational Science@@@Structures of Social Action: Studies in Conversation Analysis. , 1987 .

[9]  Richard Young,et al.  Interactional Competence: Challenges for Validity. , 2000 .

[10]  Patricia A. Duff Another Look at Interlanguage Talk: Taking Task to Task , 1985 .

[11]  Gillian Wigglesworth,et al.  An Investigation of the Effectiveness and Validity of Planning Time in Speaking Test Tasks , 2010 .

[12]  Xiaoming Xi Do visual chunks and planning impact performance on the graph description task in the SPEAK exam? , 2005 .

[13]  Rod Ellis,et al.  Planning and task performance in a second language , 2005 .

[14]  Philip M. McCarthy,et al.  MTLD, vocd-D, and HD-D: A validation study of sophisticated approaches to lexical diversity assessment , 2010, Behavior research methods.

[15]  Annie Brown,et al.  Interviewer variation and the co-construction of speaking proficiency , 2003 .

[16]  Noriko Iwashita,et al.  Estimating the difficulty of oral proficiency tasks: what does the test-taker have to offer? , 2002 .

[17]  Alan Tonkyn,et al.  Measuring spoken language: a unit for all reasons , 2000 .

[18]  C. Weir Language Testing and Validation: An Evidence-Based Approach , 2004 .

[19]  Fumiyo Nakatsuhara Effects of test-taker characteristics and the number of participants in group oral tests , 2011 .

[20]  Peter Skehan,et al.  7. Strategic and on-line planning: The influence of surprise information and task time on second language performance , 2005 .

[21]  Cyril J. Weir,et al.  Language Testing and Validation , 2005 .

[22]  Gillian Wigglesworth,et al.  Influences on performance in task-based oral assessments , 2001 .

[23]  Evelina D. Galaczi,et al.  Peer–Peer Interaction in a Speaking Test: The Case of the First Certificate in English Examination , 2008 .

[24]  B. Vanpatten,et al.  Talking to learn : conversation in second language acquisition , 1987 .

[25]  Zhengdong Gan,et al.  Interaction in group oral assessment: A case study of higher- and lower-scoring students , 2010 .

[26]  Lynda Taylor,et al.  Examining speaking : research and practice in assessing second language speaking , 2011 .

[27]  Anne Lazaraton,et al.  A qualitative approach to the validation of oral language tests , 2002 .

[28]  Michael McCarthy,et al.  Spoken fluency revisited , 2010 .

[29]  Gillian Wigglesworth,et al.  An investigation of planning time and proficiency level on oral test discourse , 1997 .

[30]  Peter Skehan,et al.  The Influence of Planning and Task Type on Second Language Performance , 1996, Studies in Second Language Acquisition.

[31]  Edward W Wolfe,et al.  Detecting and measuring rater effects using many-facet Rasch measurement: part I. , 2003, Journal of applied measurement.

[32]  Noriko Iwashita,et al.  Can We Predict Task Difficulty in an Oral Proficiency Test? Exploring the Potential of an Information‐Processing Approach to Task Design , 2001 .

[33]  Barry O'Sullivan,et al.  Exploring difficulty in speaking tasks: An intra-task perspective , 2006 .