Simulating conversations in oral-proficiency assessment: a conversation analysis of role plays and non-scripted interviews in language exams

Several recent studies have investigated the nature of interaction in oral proficiency exams and have concluded that the interview format obscures differences in the conversational competence of the candidates. The present paper examines what opportunities test takers have to display their knowledge of managing conversations in the L2 in two types of tasks: non-scripted interviews and guided role-play activities. The data for the study consists of 30 interviews and 30 role-play activities between near-native examiners and intermediate learners used in language exams in Hungary. The interviews and role-plays have been analysed for the number of topics introduced and ratified by the examiner and the candidate respectively, as well as for the number of interruptions, openings and closings produced by the examiner and the candidate. The findings show that the conversational interaction is more symmetrical in the guided role-play activity with the candidates introducing and ratifying approximately the same number of topics as the examiners. In addition, the examinees have the opportunity to interrupt and hold the floor more effectively during the role-play activity and can demonstrate their knowledge of how to open and close a conversation. These findings suggest that guided role-play activities used in the study exhibit several characteristics of real-life conversations and therefore can be used for assessing the candidates’ conversational competence.

[1]  E. E. Jones,et al.  Foundations of Social Psychology , 1967 .

[2]  David Silverman,et al.  Interview Talk: Bringing off a Research Instrument , 1973 .

[3]  E. Schegloff,et al.  A simplest systematics for the organization of turn-taking for conversation , 1974 .

[4]  J. Oller.  Language Tests at School: A Pragmatic Approach , 1979 .

[5]  D. Maynard.  Placement of topic changes in conversation , 1980 .

[6]  Lyle F. Bachman,et al.  The Evaluation of Communicative Language Proficiency: A Critique of the ACTFL Oral Interview , 1986 .

[7]  Lyle F. Bachman.  Problems in Examining the Validity of the ACTFL Oral Proficiency Interview , 1988, Studies in Second Language Acquisition.

[8]  Leo Van Lier,et al.  Reeling, Writhing, Drawling, Stretching, and Fainting in Coils: Oral Proficiency Interviews as Conversation , 1989 .

[9]  James C. McCroskey,et al.  Willingness to Communicate : A Cognitive View , 2004 .

[10]  Robert C. Gardner,et al.  Methods and Results in the Study of Anxiety and Language Learning: A Review of the Literature* , 1991 .

[11]  Steven J. Ross,et al.  The Discourse of Accommodation in Oral Proficiency Interviews , 1992, Studies in Second Language Acquisition.

[12]  Anne Lazaraton,et al.  The Structural Organization of a Language Interview: A Conversation Analytic Perspective. , 1992 .

[13]  Michael Milanovic,et al.  Discourse Variation in Oral Proficiency Interviews , 1992, Studies in Second Language Acquisition.

[14]  S. Ross.  Accommodative questions in oral proficiency interviews , 1992 .

[15]  Z. Dörnyei,et al.  Communicative Competence: A Pedagogically Motivated Model with Content Specifications , 1995 .

[16]  R. Young,et al.  Conversational Styles in Language Proficiency Interviews , 1995 .

[17]  Meaning Negociation in the Hungarian Oral Proficiency Examination of English , 1998 .

[18]  Lyle F. Bachman,et al.  语言测试实践 = Language testing in practice , 1998 .