Testing L2 Talk: A Review of Empirical Studies on Second-Language Oral Proficiency Testing

In this review article, empirical studies published from 2004 through 2014 on second-language (L2) oral proficiency testing are analyzed, with a specific focus on discourse and social interaction in such tests. Taking three common test setups, oral proficiency interviews (OPIs), paired peer tests, and group peer tests as an organizing principle for the studies examined, recent developments in L2 oral proficiency testing research are situated, reviewed, and discussed, with a particular focus on tests conducted in face-to-face contexts. Findings from the review of selected journals, databases, monographs, and edited collections indicate (1) a prevalence of studies of the OPI format, but a growing research base on paired and group tests, (2) an absence of oral test studies in discourse journals, and (3) an emphasis on assessment, validation, and rater perspectives, as opposed to detailed analyses of interaction in L2 tests.

[1]  Dorry M. Kenyon,et al.  COMPARING EXAMINEE ATTITUDES TOWARD COMPUTER- ASSISTED AND OTHER ORAL PROFICIENCY ASSESSMENTS , 2001 .

[2]  Steven J. Ross,et al.  Assessing second language pragmatics: An overview and introductions , 2013 .

[3]  Steven J. Ross,et al.  Assessing Second Language Pragmatics , 2013 .

[4]  Barbara F. Freed,et al.  Confirmed Beliefs or False Assumptions? A Study of Home Stay Experiences in the French Study Abroad Context. , 2011 .

[5]  James Simpson.  Differing expectations in the assessment of the speaking skills of ESOL learners , 2006 .

[6]  Dorry M. Kenyon,et al.  Research on the comparability of the oral proficiency interview and the simulated oral proficiency interview , 1992 .

[7]  Yuko Goto Butler,et al.  Young Foreign Language Learners’ Interactions During Task-Based Paired Assessments , 2014 .

[8]  Margaret E. Malone,et al.  The Effect of Study Abroad Homestay Placements: Participant Perspectives and Oral Proficiency Gains , 2014 .

[9]  Liz Hamp-Lyons,et al.  Topic Negotiation in Peer Group Oral Assessment Situations: A Conversation Analytic Approach , 2009 .

[10]  Paul Seedhouse,et al.  Oral proficiency interviews as varieties of interaction , 2013 .

[11]  Elana Shohamy.  Discourse Analysis In Language Testing , 1990, Annual Review of Applied Linguistics.

[12]  Sally Sieloff Magnan,et al.  Social Interaction and Linguistic Gain During Study Abroad , 2007 .

[13]  Julia Hüttner,et al.  Agreeing to disagree: ‘doing disagreement’ in assessed oral L2 interactions , 2014 .

[14]  Annie Brown,et al.  Assessing paired orals: Raters' orientation to interaction , 2009 .

[15]  Evelina D. Galaczi,et al.  Peer–Peer Interaction in a Speaking Test: The Case of the First Certificate in English Examination , 2008 .

[16]  Noriko Iwashita,et al.  The Effect of Learner Proficiency on Interactional Moves and Modified Output in Nonnative-Nonnative Interaction in Japanese as a Foreign Language. , 2001 .

[17]  Evelina D. Galaczi,et al.  Interactional Competence across Proficiency Levels: How do Learners Manage Interaction in Paired Speaking Tests? , 2014 .

[18]  Andrea Tyler,et al.  Re-analyzing the OPI: How Much Does It Look Like Natural Conversation? , 1998 .

[19]  Torsten Lindblad,et al.  Oral tests in Swedish schools: A five-year experiment , 1992 .

[20]  Jorge Cubillos.  Computer-mediated Oral Proficiency Assessments , 2010 .

[21]  R. A. V. Compernolle,et al.  Chapter 6. Responding to Questions and L2 Learner Interactional Competence during Language Proficiency Interviews: A Microanalytic Study with Pedagogical Implications , 2011 .

[22]  Kimi Kondo-Brown,et al.  Investigating Interviewer‐Candidate Interactions During Oral Interviews for Child L2 Learners , 2004 .

[23]  Pamela S. H. Bogart,et al.  Perceptions of Examiner Behavior Modulate Power Relations in Oral Performance Testing , 2008 .

[24]  Lyn May,et al.  Co-constructed interaction in a paired speaking test: The rater's perspective , 2009 .

[25]  Amanda Edmonds,et al.  1. How to Assess L2 Proficiency? An Overview of Proficiency Assessment Research , 2014 .

[26]  J. Norton,et al.  The paired format in the Cambridge Speaking Tests , 2005 .

[27]  Eric A. Surface,et al.  Oral proficiency standards and foreign language teacher candidates: current findings and future research directions , 2013 .

[28]  Tim Greer,et al.  Turn-taking practices in multi-party EFL oral proficiency tests , 2012 .

[29]  Fumiyo Nakatsuhara,et al.  A multifaceted approach to investigating pre-task planning effects on paired oral test performance , 2014 .

[30]  Anne Lazaraton.  Process and Outcome in Paired Oral Assessment. , 2006 .

[31]  Gabriele Kasper,et al.  Managing task uptake in oral proficiency interviews , 2013 .

[32]  Fumiyo Nakatsuhara.  Inter-interviewer variation in oral interview tests , 2007 .

[33]  Suliko Liiv,et al.  Interviewer behaviour during oral proficiency interviews: A gender perspective , 2013 .

[34]  Roy Lyster,et al.  PEER INTERACTION AND CORRECTIVE FEEDBACK FOR ACCURACY AND FLUENCY DEVELOPMENT , 2012, Studies in Second Language Acquisition.

[35]  Tim McNamara.  Applied linguistics and measurement: A dialogue , 2011 .

[36]  Brigid M. Burke.  Looking Into a Crystal Ball: Is Requiring High‐Stakes Language Proficiency Tests Really Going to Improve World Language Education? , 2013 .

[37]  Glenn Fulcher,et al.  Tests of Oral Performance: The Need for Data-based Criteria. , 1987 .

[38]  Anne Lazaraton,et al.  A Microanalytic Perspective on Discourse, Proficiency, and Identity in Paired Oral Assessment , 2008 .

[39]  Steven J. Ross,et al.  A comparative task-in-interaction analysis of OPI backsliding , 2007 .

[40]  Janine Theiler,et al.  Spoken Spanish Language Development at the High School Level: A Mixed-Methods Study , 2014 .

[41]  A. Hasselgren,et al.  The assessment of the English ability of young learners in Norwegian schools: an innovative approach , 2000 .

[42]  Richard Young,et al.  Talking and Testing: Discourse Approaches to the Assessment of Oral Proficiency. Studies in Bilingualism, Volume 14. , 1998 .

[43]  Steve Issitt,et al.  Improving scores on the IELTS speaking test , 2006 .

[44]  Susan M. Gass,et al.  The Influence of Second Language Experience and Accent Familiarity on Oral Proficiency Rating: A Qualitative Investigation , 2013 .

[45]  Larry Davis,et al.  The influence of interlocutor proficiency in a paired oral assessment , 2009 .

[46]  Ewa Golonka.  Predictors Revised: Linguistic Knowledge and Metalinguistic Awareness in Second Language Gain in Russian , 2006 .

[47]  Yusuke Okada,et al.  Role-play in oral proficiency interviews: Interactive footing and interactional competencies , 2010 .

[48]  Judit Kormos.  Simulating conversations in oral-proficiency assessment: a conversation analysis of role plays and non-scripted interviews in language exams , 1999 .

[49]  Saman Ebadi,et al.  Variationist Perspective on the Role of Social Variables of Gender and Familiarity in L2 Learners' Oral Interviews , 2011 .

[50]  Lyn May,et al.  Interactional Competence in a Paired Speaking Test: Features Salient to Raters , 2011 .

[51]  E. Schegloff,et al.  A simplest systematics for the organization of turn-taking for conversation , 1974 .

[52]  Marysia Johnson,et al.  Interaction In The Oral Proficiency Interview: Problems Of Validity , 2000 .

[53]  María Luisa Roca-Varela,et al.  How Are Spoken Skills Assessed in Proficiency Tests of General English as a Foreign Language? A Preliminary Survey. , 2013 .

[54]  Scott Kissau,et al.  The Impact of the Oral Pro fi ciency Interview on One Foreign Language Teacher Education Program , 2014 .

[55]  Mehdi Riazi,et al.  The influence of prompt on group oral tests , 2014 .

[56]  Waka Tominaga,et al.  The development of extended turns and storytelling in the Japanese oral proficiency interview , 2013 .

[57]  Gabriele Kasper,et al.  When once is not enough: Politeness of multiple requests in oral proficiency interviews , 2006 .

[58]  Rita Bennett.  Is linguistic ability variation in paired oral language testing problematic , 2012 .

[59]  Scott Kissau,et al.  The Impact of the Oral Proficiency Interview on One Foreign Language Teacher Education Program , 2014 .

[60]  Gene B. Halleck.  Symposium article: Data generation through role-play: Assessing oral proficiency , 2007 .

[61]  Tim Farnsworth.  Effects of Targeted Test Preparation on Scores of Two Tests of Oral English as a Second Language , 2013 .

[62]  Gary J. Ockey,et al.  A many-facet Rasch analysis of the second language group oral discussion task , 2003 .

[63]  J. Norton,et al.  Performing Identities in Speaking Tests: Co-Construction Revisited , 2013 .

[64]  F. Scott Walters,et al.  A Conversation Analysis—Informed Test of L2 Aural Pragmatic Comprehension , 2009 .

[65]  Parviz Birjandi,et al.  From Face-to-Face to Paired Oral Proficiency Interviews: The Nut is Yet to be Cracked , 2011 .

[66]  Tim Greer,et al.  Pursuing a relevant response in oral proficiency interview role plays , 2013 .

[67]  Zhengdong Gan,et al.  Interaction in group oral assessment: A case study of higher- and lower-scoring students , 2010 .

[68]  Joanna Sullivan,et al.  Taking Charge: Teacher Candidates' Preparation for the Oral Proficiency Interview , 2011 .

[69]  Mary K. Enright.  Research Issues in High‐Stakes Communicative Language Testing: Reflections on TOEFL's New Directions , 2004 .

[70]  Annie Brown,et al.  Interviewer variation and the co-construction of speaking proficiency , 2003 .

[71]  Emanuel A. Schegloff,et al.  1. CONVERSATION ANALYSIS AND APPLIED LINGUISTICS , 2002, Annual Review of Applied Linguistics.

[72]  Carsten Roever.  Testing of second language pragmatics: Past and future , 2011 .

[73]  Lindsay Brooks,et al.  Interacting in pairs in a test of oral proficiency: Co-constructing a better performance , 2009 .

[74]  Fumiyo Nakatsuhara.  Effects of test-taker characteristics and the number of participants in group oral tests , 2011 .

[75]  F. Scott Walters,et al.  A conversation-analytic hermeneutic rating protocol to assess L2 oral pragmatic competence , 2007 .

[76]  Barbara F. Freed,et al.  CONTEXT, CONTACT, AND COGNITION IN ORAL FLUENCY ACQUISITION: Learning Spanish in At Home and Study Abroad Contexts , 2004, Studies in Second Language Acquisition.

[77]  Heng-Tsung Danny Huang,et al.  Comparing the Effects of Test Anxiety on Independent and Integrated Speaking Test Performance , 2013 .

[78]  Gillian Wigglesworth,et al.  An Investigation of the Effectiveness and Validity of Planning Time in Speaking Test Tasks , 2010 .

[79]  Leo Van Lier,et al.  Reeling, Writhing, Drawling, Stretching, and Fainting in Coils: Oral Proficiency Interviews as Conversation , 1989 .

[80]  Uta Mehnert,et al.  THE EFFECTS OF DIFFERENT LENGTHS OF TIME FOR PLANNING ON SECOND LANGUAGE PERFORMANCE , 1998, Studies in Second Language Acquisition.

[81]  Anthony Green,et al.  Washback in Language Assessment , 2020, The Encyclopedia of Applied Linguistics.

[82]  Jasmine Luk,et al.  Talking to Score: Impression Management in L2 Oral Assessment and the Co-Construction of a Test Discourse Genre , 2010 .

[83]  Hossein Farhady,et al.  Evaluation of the Usefulness of the Versant for English Test: A Response , 2008 .

[84]  Steven J. Ross,et al.  Multiple questions in oral proficiency interviews , 2007 .

[85]  Martina Lindseth.  The Development of Oral Proficiency During a Semester in Germany , 2010 .

[86]  Erica Sandlund,et al.  From paper to practice : Asking and responding to a standardized question item in performance appraisal interviews , 2014 .

[87]  Paul Meara,et al.  Examiner support strategies and test-taker vocabulary , 2005 .