Words that go together well: developing test formats for measuring learner knowledge of English collocations

This paper describes the development of two test formats, COLLEX and COLLMATCH, measuring receptive recognition knowledge of English verb +NP collocations, and reports findings from pilots and initial test administrations involving Swedish upper-secondaryschool and university level learners. Administrations of the test formats produced highly reliable scores and the performance of native speakers provided evidence of test validity. The tests discriminated significantly between upper secondary school learners, university learners, and native speakers. Significant differences were however not observed throughout between advanced learner groups only one term apart in terms of level of formal instruction. A vocabulary size measure was found to correlate highly with scores on both tests, which seems to suggest that learners with large vocabularies have a better receptive command of verb + NP collocations than learners with smaller vocabularies.

[1]  P. Meara,et al.  An alternative to multiple choice vocabulary tests , 1987 .

[2]  M. Farghal,et al.  COLLOCATIONS: A NEGLECTED VARIABLE IN EFL , 1995 .

[3]  M. Wesche,et al.  Assessing Second Language Vocabulary Knowledge: Depth Versus Breadth. , 1996 .

[4]  Paul Nation,et al.  Teaching and learning vocabulary , 1994 .

[5]  William J. Bonk,et al.  Testing ESL Learners' Knowledge of Collocations. , 2000 .

[6]  Maria Wiktorsson Learning Idiomaticity : A Corpus-Based Study of Idiomatic Expressions in Learners' Written Production , 2003 .

[7]  C. Chapelle Construct definition and validity inquiry in SLA research , 1999 .

[8]  Lyle F. Bachman Statistical analyses for language assessment , 2004 .

[9]  F. G. Brown,et al.  Principles of educational and psychological testing , 1970 .

[10]  L. Cameron Measuring vocabulary size in English as an additional language , 2002 .

[11]  N. Schmitt,et al.  Vocabulary in Language Teaching , 2000 .

[12]  Nadja Nesselhauf How learner corpus analysis can contribute to language teaching: A study of support verb constructions , 2004 .

[13]  Sylviane Granger,et al.  The grammatical and lexical patterning of MAKE in native and non-native student writing , 2001 .

[14]  D. Biskup,et al.  L1 Influence on Learners’ Renderings of English Collocations: A Polish/German Empirical Study , 1992 .

[15]  Averil Coxhead A New Academic Word List , 2000 .

[16]  Peter Howarth,et al.  Phraseology and Second Language Proficiency , 1998 .

[17]  Claude Baudoin Iic,et al.  Vocabulary , 2007, Selections from Horace Odes III.

[18]  Christina Gitsaki The Development of ESL Collocational Knowledge , 1996 .

[19]  Sylviane Granger,et al.  Prefabricated patterns in advanced EFL writing: collocations and formulae , 1998 .

[20]  Norbert Schmitt,et al.  Tracking the Incremental Acquisition of Second Language Vocabulary: A Longitudinal Study , 1998 .

[21]  B. Laufer,et al.  Testing Vocabulary Knowledge: Size, Strength, and Computer Adaptiveness. , 2004 .

[22]  Alison Wray,et al.  Formulaic Language and the Lexicon: List of Figures and Tables , 2002 .

[23]  N. Schmitt,et al.  Developing and exploring the behaviour of two new versions of the Vocabulary Levels Test , 2001 .

[24]  Richard Reviewer-Granger Unified Theories of Cognition , 1991, Journal of Cognitive Neuroscience.

[25]  J. Read The development of a new measure of L2 vocabulary knowledge , 1993 .

[26]  Lyle F. Bachman 语言测试要略 = Fundamental considerations in language testing , 1990 .

[27]  Nadja Nesselhauf,et al.  Collocations in a Learner Corpus , 2005 .

[28]  Marie Källkvist,et al.  Form-class and task-type effects in learner English : a study of advanced Swedish learners , 1999 .

[29]  B. Warren A Model of Idiomaticity , 2005 .

[30]  Jens Bahns,et al.  Should we teach EFL students collocations , 1993 .

[31]  Nick C. Ellis,et al.  Memory for language , 2001 .

[32]  Oliver Mason,et al.  Words And Phrases , 2002, Lit. Linguistic Comput..