Assessing L2 vocabulary depth with word associates format tests: issues, findings, and suggestions

Word Associates Format (WAF) tests are often used to measure second language learners’ vocabulary depth with a focus on their network knowledge. Yet, there were often many variations in the specific forms of the tests and the ways they were used, which tended to have an impact on learners’ response behaviors and, more importantly, the psychometric properties of the tests. This paper reviews the general practices, key issues, and research findings that pertain to WAF tests in four major areas, including the design features of WAF tests, conditions for test administration, scoring methods, and test-taker characteristics. In each area, a set of variables is identified and described with relevant research findings also presented and discussed. Around eight topics, the General Discussion section provides some suggestions and directions for the development of WAF tests and the use of them as research tools in the future. This paper is hoped to help researchers become better aware that the results generated by a WAF test may vary depending on what specific design the test has, how it is administered and scored, and who the learners are, and consequently, make better decisions in their research that involves a WAF test.

[1]  Doris R. Entwisle,et al.  Word associations of young children , 1966 .

[2]  Is’haaq Akbarian,et al.  The relationship between vocabulary size and depth for ESP/EAP learners , 2010 .

[3]  A. Wray,et al.  Establishing the Reliability of Word Association Data for Investigating Individual and Group Differences. , 2015 .

[4]  David D. Qian,et al.  Evaluation of an in-depth vocabulary knowledge measure for assessing reading performance , 2004 .

[5]  M. Wesche,et al.  Assessing Second Language Vocabulary Knowledge: Depth Versus Breadth. , 1996 .

[6]  Phillip Rowles.  Teaching and Learning Vocabulary , 2003 .

[7]  H. Nissen,et al.  Word class influence on word association test results1 , 2006 .

[8]  Paul Meara.  SIMULATING WORD ASSOCIATIONS IN AN L2: APPROACHES TO LEXICAL ORGANISATION , 2007 .

[9]  Brent Wolter,et al.  Collocational Links in the L2 Mental Lexicon and the Influence of L1 Intralexical Knowledge , 2011 .

[10]  Alysia D. Roehrig,et al.  Roles of General versus Second Language (L2) Knowledge in L2 Reading Comprehension. , 2011 .

[11]  C. Chapelle.  Are C-tests valid measures for L2 vocabulary research? , 1994 .

[12]  George Higginbotham.  Individual learner profiles from word association tests: The effect of word frequency , 2010 .

[13]  John Read,et al.  Assessing Vocabulary by John Read , 2000 .

[14]  Yukie Horiba.  Word Knowledge and Its Relation to Text Comprehension: A Comparative Study of Chinese- and Korean-Speaking L2 Learners and L1 Speakers of Japanese. , 2012 .

[15]  J. Read.  The development of a new measure of L2 vocabulary knowledge , 1993 .

[16]  S. Ehsanzadeh.  Depth versus Breadth of Lexical Repertoire: Assessing Their Roles in EFL Students' Incidental Vocabulary Acquisition. , 2012 .

[17]  A. Vermeer.  Breadth and depth of vocabulary in relation to L1/L2 acquisition and frequency of input , 2001, Applied Psycholinguistics.

[18]  Scott Jarvis,et al.  Crosslinguistic Influence in Language and Cognition , 2007 .

[19]  Constant Leung,et al.  The Companion to Language Assessment , 2013 .

[20]  Paul Meara,et al.  Learners' Word Associations in French. , 1978 .

[21]  Ari Nurweni,et al.  THE ENGLISH VOCABULARY KNOWLEDGE OF INDONESIAN UNIVERSITY STUDENTS , 1999 .

[22]  Cristina Izura,et al.  WORD ASSOCIATION IN L1 AND L2 , 2011, Studies in Second Language Acquisition.

[23]  Joshua B. Tenenbaum,et al.  The Large-Scale Structure of Semantic Networks: Statistical Analyses and a Model of Semantic Growth , 2001, Cogn. Sci..

[24]  K. Nelson,et al.  The syntagmatic-paradigmatic shift revisited: a review of research and theory. , 1977, Psychological bulletin.

[25]  J. Richards.  The Role of Vocabulary Teaching. , 1976 .

[26]  B. Henriksen.  Declarative Lexical Knowledge , 2008 .

[27]  Shidrokh Namei,et al.  Bilingual lexical development: a Persian–Swedish word association study , 2004 .

[28]  William E. Nagy,et al.  Vocabulary Processes , 2013 .

[29]  M. Verhallen,et al.  The assessment of deep word knowledge in young first and second language learners , 2008 .

[30]  James Milton,et al.  Measuring Second Language Vocabulary Acquisition , 2009 .

[31]  Dongbo Zhang.  Vocabulary and Grammar Knowledge in Second Language Reading Comprehension: A Structural Equation Modeling Study , 2012 .

[32]  I.S.P. Nation,et al.  Learning Vocabulary in Another Language , 2001 .

[33]  E. V. D. Linden,et al.  The construction and validation of a deep word knowledge test for advanced learners of French , 2004 .

[34]  T. Fitzpatrick.  Word association patterns: unpacking the assumptions , 2007 .

[35]  Norbert Schmitt,et al.  The Word Associates Format: Validation evidence , 2011 .

[36]  Lyle F. Bachman,et al.  Language testing in practice : designing and developing useful language tests , 1996 .

[37]  Paul Meara,et al.  Untangling word webs: graph theory and the notion of density in second language word association networks , 2002 .

[38]  Brent Wolter,et al.  Collocational Links in the L 2 Mental Lexicon and the Influence of L 1 Intralexical Knowledge , 2022 .

[39]  Abel Ekpo-Ufot,et al.  Word Associations , 1978 .

[40]  R. Schoonen,et al.  The role of accessibility of semantic word knowledge in monolingual and bilingual fifth-grade reading , 2012, Applied Psycholinguistics.

[41]  Birgit Henriksen,et al.  THREE DIMENSIONS OF VOCABULARY DEVELOPMENT , 1999, Studies in Second Language Acquisition.

[42]  David D. Qian,et al.  Assessing the Roles of Depth and Breadth of Vocabulary Knowledge in Reading Comprehension , 1999 .

[43]  Tine Greidanus,et al.  Testing the Quality of Word Knowledge in a Second Language by Means of Word Associations: Types of Distractors and Types of Associations , 2001 .

[44]  A. Batty.  Identifying Dimensions of Vocabulary Knowledge in the Word Associates Test , 2012 .

[45]  Norbert Schmitt,et al.  Size and Depth of Vocabulary Knowledge: What the Research Shows , 2014 .

[46]  David D. Qian,et al.  Investigating the Relationship Between Vocabulary Knowledge and Academic Reading Performance: An Assessment Perspective , 2002 .

[47]  J. Read,et al.  Validating a Test to Measure Depth of Vocabulary Knowledge , 2013 .

[48]  P. Meara.  Word Associations in a Foreign Language , 1982 .

[49]  John Read,et al.  11. Plumbing the depths: How should the construct of vocabulary knowledge be defined? , 2004 .

[50]  Vedran Dronjic,et al.  Fixed-choice word-association tasks as second-language lexical tests: What native-speaker performance reveals about their potential weaknesses , 2012, Applied Psycholinguistics.

[51]  Brent Wolter,et al.  The ‘promise’ of three methods of word association analysis to L2 lexical research , 2012 .

[52]  Terence Odlin,et al.  Language Transfer: Contents , 1989 .

[53]  Tine Greidanus,et al.  Testing the Development of French Word Knowledge by Advanced Dutch- and English-Speaking Learners and Native Speakers , 2006 .

[54]  Brent Wolter.  COMPARING THE L1 AND L2 MENTAL LEXICON , 2001, Studies in Second Language Acquisition.

[55]  Hossein Nassaji,et al.  The Relationship between Depth of Vocabulary Knowledge and L2 Learners' Lexical Inferencing Strategy Use and Success , 2004 .

[56]  Tess Fitzpatrick,et al.  Dimensions of Vocabulary Knowledge , 2013 .

[57]  沼本 健二.  A University Word ListからA Nursing Word Listへ , 1998 .

[58]  Alla Zareva.  Structure of the second language mental lexicon: how does it compare to native speakers' lexical organization? , 2007 .

[59]  J. Read.  Second language vocabulary assessment , 2012, Language Teaching.

[60]  N. Schmitt,et al.  Developing and exploring the behaviour of two new versions of the Vocabulary Levels Test , 2001 .

[61]  K. Koda.  Insights into Second Language Reading: References , 2005 .

[62]  Norbert Schmitt,et al.  Quantifying word association responses: what is native-like? , 1998 .

[63]  Christiane Fellbaum,et al.  Book Reviews: WordNet: An Electronic Lexical Database , 1999, CL.

[64]  Helmut Daller,et al.  Modelling and Assessing Vocabulary Knowledge: Fundamental issues , 2007 .

[65]  Andrea B. Hellman,et al.  Vocabulary size and depth of word knowledge in adult‐onset second language acquisition , 2011 .