Predicting Second Language Writing Proficiency: The Roles of Cohesion and Linguistic Sophistication

This study addresses research gaps in predicting second language (L2) writing proficiency using linguistic features. Key to this analysis is the inclusion of linguistic measures at the surface, textbase and situation model level that assess text cohesion and linguistic sophistication. The results of this study demonstrate that five variables (lexical diversity, word frequency, word meaningfulness, aspect repetition and word familiarity) can be used to significantly predict L2 writing proficiency. The results demonstrate that L2 writers categorised as highly proficient do not produce essays that are more cohesive, but instead produce texts that are more linguistically sophisticated. These findings have important implications for L2 writing development and L2 writing pedagogy.

[1]  M. Louwerse An analytic and cognitve parameterization of coherence relations , 2002 .

[2]  Terry Santos,et al.  Second Language Writing: Research Insights for the Classroom , 1991 .

[3]  Michael Wilson MRC Psycholinguistic Database , 2001 .

[4]  Philip M. McCarthy,et al.  Using temporal cohesion to predict temporal coherence in narrative and expository texts , 2007, Behavior research methods.

[5]  Christiane Fellbaum,et al.  Book Reviews: WordNet: An Electronic Lexical Database , 1999, CL.

[6]  Danielle S. McNamara,et al.  Reversing the Reverse Cohesion Effect: Good Texts Can Be Better for Strategic, High-Knowledge Readers , 2007 .

[7]  Birgit Harley,et al.  Verb Lexis in the Written Compositions of Young L2 Learners , 1989, Studies in Second Language Acquisition.

[8]  T. Landauer,et al.  A Solution to Plato's Problem: The Latent Semantic Analysis Theory of Acquisition, Induction, and Representation of Knowledge. , 1997 .

[9]  James H. Martin,et al.  Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition , 2000 .

[10]  Ryuko Kubota,et al.  An investigation of L1–L2 transfer in writing among Japanese university students: Implications for contrastive rhetoric , 1998 .

[11]  Danielle S. McNamara,et al.  Computational assessment of lexical differences in L1 and L2 writing , 2009 .

[12]  Karl Rihaczek,et al.  1. WHAT IS DATA MINING? , 2019, Data Mining for the Social Sciences.

[13]  Ellen Bialystok,et al.  A Theoretical Model of Second Language Learning , 1978 .

[14]  Nicola Brace,et al.  SPSS for psychologists: a guide to data analysis using SPSS for Windows (versions 9, 10 and 11). 2nd edition , 2007 .

[15]  Bernard Comrie,et al.  Time in language. , 2000 .

[16]  Bernadette Longo,et al.  The Role of Metadiscourse in Persuasion. , 1994 .

[17]  D. McNamara,et al.  A Linguistic Analysis of Simplified and Authentic Texts , 2007 .

[18]  L. Faigley,et al.  Coherence, Cohesion, and Writing Quality , 1981, College Composition & Communication.

[19]  G. Yule,et al.  Teaching the Spoken Language , 1986 .

[20]  Scott Jarvis,et al.  Short texts, best-fitting curves and new measures of lexical diversity , 2002 .

[21]  Jan Avent,et al.  Reciprocal scaffolding: A context for communication treatment in aphasia , 2003 .

[22]  E. Lavelle Approaches to writing , 2007 .

[23]  Danielle S. McNamara,et al.  Measuring L2 Lexical Growth Using Hypernymic Relationships , 2009 .

[24]  Sigrun Biesenbach-Lucas,et al.  Use of Cohesive Features in ESL Students' E-mail and Word-Processed Texts: A Comparative Study , 2000 .

[25]  M. C. Templin Certain language skills in children , 1957 .

[26]  Philip M. McCarthy,et al.  Linguistic Features of Writing Quality , 2010 .

[27]  R. Ellis Modified Oral Input and the Acquisition of Word Meanings. , 1995 .

[28]  Walter Kintsch,et al.  Toward a model of text comprehension and production. , 1978 .

[29]  W. F. Battig,et al.  Handbook of semantic word norms , 1978 .

[30]  Danielle S. McNamara,et al.  Psycholinguistic word information in second language oral discourse , 2011 .

[31]  Danielle S. McNamara,et al.  Using Latent Semantic Analysis to Explore Second Language Lexical Development , 2008, FLAIRS.

[32]  David Malvern,et al.  Lexical Diversity and Language Development , 2004 .

[33]  T. Santos Professors' Reactions to the Academic Writing of Nonnative-Speaking Students. , 1988 .

[34]  Tony Silva Toward an Understanding of the Distinct Nature of L2 Writing: The ESL Research and Its Implications , 1993 .

[35]  Joy Reid,et al.  A computer text analysis of four cohesion devices in english discourse by native and nonnative writers , 1992 .

[36]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[37]  Arthur C. Graesser,et al.  Using LSA to Automatically Identify Givenness and Newness of Noun Phrases in Written Discourse , 2005 .

[38]  Paul Meara,et al.  P-Lex: A Simple and Effective Way of Describing the lexical Characteristics of Short L2 Tests. , 2001 .

[39]  Kenneth S. Goodman,et al.  Learning to read in different languages , 1987 .

[40]  Priscilla Wald A God Who Is Later a Terror: (En)countering the National Plot in Stein's The Making of Americans , 1991 .

[41]  Arthur C. Graesser,et al.  Coh-Metrix: Analysis of text on cohesion and language , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[42]  Charles A. Perfetti,et al.  The Acquisition of Reading Comprehension Skill , 2008 .

[43]  M. C. Templin Certain language skills in children : their development and interrelationships , 1957 .

[44]  U. Connor A study of cohesion and coherence in English as a second language students’ writing , 1984 .

[45]  Danielle S. McNamara,et al.  The Development of Polysemy and Frequency Use in English Second Language Speakers , 2010 .

[46]  Max M. Louwerse Un modelo conciso de cohesión en el texto y coherencia en la comprensión , 2004 .

[47]  Rolf A. Zwaan,et al.  Discourse comprehension. , 1997, Annual review of psychology.

[48]  Ken Hyland,et al.  Second Language Writing , 2003 .

[49]  P. David Pearson The Effects of Grammatical Complexity on Children's Comprehension, Recall, and Conception of Certain Semantic Relations. , 1974 .

[50]  Leslie Grant,et al.  Using Computer-Tagged Linguistic Features to Describe L2 Writing Differences , 2000 .

[51]  Cheryl A. Engber The relationship of lexical proficiency to the quality of ESL compositions , 1995 .

[52]  C. A. Weaver,et al.  Psychology of Reading , 2012 .

[53]  Arthur C. Graesser,et al.  Dimensions of situation model construction in narrative comprehension. , 1995 .

[54]  Lawrence T. Frase,et al.  COMPUTER ANALYSIS OF THE TOEFL TEST OF WRITTEN ENGLISH , 1998 .

[55]  Andy P. Field,et al.  Discovering Statistics Using SPSS , 2000 .

[56]  Michel Fayol,et al.  Processing interclausal relationships : studies in the production and comprehension of text , 1997 .

[57]  Joseph P. Magliano,et al.  Verb Aspect and Situation Models , 2000 .

[58]  Rolf A. Zwaan,et al.  Situation models in language comprehension and memory. , 1998, Psychological bulletin.

[59]  Patrick F. Reidy An Introduction to Latent Semantic Analysis , 2009 .

[60]  Michael Halliday,et al.  Cohesion in English , 1976 .

[61]  María José de la Fuente NEGOTIATION AND ORAL ACQUISITION OF L2 VOCABULARY , 2002, Studies in Second Language Acquisition.

[62]  W. J. V. Kopple,et al.  Some Exploratory Discourse on Metadiscourse , 1985, College Composition & Communication.

[63]  Ulla Connor,et al.  Linguistic/Rhetorical Measures for International Persuasive Student Writing , 1990 .

[64]  Scott Jarvis,et al.  vocd: A theoretical and empirical evaluation , 2007 .

[65]  Charles Hulme,et al.  The science of reading: A handbook. , 2005 .

[66]  Philip M. McCarthy,et al.  MTLD, vocd-D, and HD-D: A validation study of sophisticated approaches to lexical diversity assessment , 2010, Behavior research methods.

[67]  P. David Pearson The Effects of Grammatical Complexity on Children's Comprehension, Recall, and Conception of Certain Semantic Relations (Reprint) , 2013 .

[68]  David Malvern,et al.  Lexical Diversity and Language Development: Quantification and Assessment , 2004 .

[69]  J. B. Wyman,et al.  What is reading ability , 1921 .

[70]  B. Grela Lexical verb diversity in children with Down syndrome , 2002, Clinical linguistics & phonetics.

[71]  Walter Kintsch,et al.  Comprehension: A Paradigm for Cognition , 1998 .

[72]  R. Logie,et al.  Age-of-acquisition, imagery, concreteness, familiarity, and ambiguity measures for 1,944 words , 1980 .

[73]  W. Chafe Givenness, contrastiveness, definiteness, subjects, topics, and point of view , 1976 .

[74]  R. Hout,et al.  Lexical richness in the spontaneous speech of bilinguals , 2003 .

[75]  Joseph K. Torgesen,et al.  Repeated reading and reading fluency in learning disabled children. , 1985 .

[76]  Paul Meara,et al.  The rediscovery of vocabulary , 2002 .

[77]  Peter W. Foltz,et al.  An introduction to latent semantic analysis , 1998 .

[78]  R. H. Baayen,et al.  The CELEX Lexical Database (CD-ROM) , 1996 .

[79]  Wenjun Jin,et al.  A Quantitative Study of Cohesion in Chinese Graduate Students' Writing: Variations across Genres and Proficiency Levels. , 2001 .

[80]  W. Kintsch,et al.  Are Good Texts Always Better? Interactions of Text Coherence, Background Knowledge, and Levels of Understanding in Learning From Text , 1996 .

[81]  Joy Reid,et al.  Second Language Writing: Responding to different topic types: a quantitative analysis from a contrastive rhetoric perspective , 1990 .

[82]  Dana R. Ferris,et al.  Lexical and Syntactic Features of ESL Writing by Students at Different Levels of L2 Proficiency , 1994 .

[83]  M. Halliday NOTES ON TRANSITIVITY AND THEME IN ENGLISH. PART 2 , 1967 .

[84]  Effets Des,et al.  The Effects of Grammatical Complexity on Children ’ s Comprehension , Recall , and Conception of Certain Semantic Relations , 2022 .

[85]  Paul Kei Matsuda,et al.  Contrastive Rhetoric in Context: A Dynamic Model of L2 Writing , 1997 .

[86]  Moira Linnarud,et al.  Lexis in composition : a performance analysis of Swedish learners' written English , 1987, Studies in Second Language Acquisition.

[87]  Rod Ellis,et al.  Classroom Interaction, Comprehension, and the Acquisition of L2 Word Meanings , 1994 .

[88]  A. Paivio Abstractness, imagery, and meaningfulness in paired-associate learning , 1965 .

[89]  Barbara Burnaby,et al.  A Handbook for ESL Literacy , 1984 .

[90]  Scott Jarvis,et al.  Exploring multiple profiles of highly rated learner compositions , 2003 .