Complexity, Accuracy, and Fluency as Properties of Language Performance: The Development of the Multiple Subsystems over Time and in Relation to Each Other

Applied linguists have identified three components of second language (L2) performance: complexity, accuracy, and fluency (CAF) to measure L2 development. Many studies researching CAF found trade-off effects (in which a higher performance in one component corresponds to lower performance in another) during tasks, often in online oral language performance. Trade-off effects are attributed to the inability of the learner to simuletaneously attend to all components at the highest level possible. Although cross-sectional research has suggested that students at different proficiency levels sacrifice performance in one CAF area while improving in another, there has been little longitudinal research about CAF (Ortega & Iberri-Shea, 2005). As such, previous research could not address if CAF grows linearly over time nor if the rate of CAF growth is the same for all learners. The current study explicitly addresses how language performance in CAF changes over L2 development in an instructed environment. This longitudinal study analyzed English L2 oral data from sixty-six students from Arabic, Chinese, and Korean language backgrounds over 3-9 months in the English Language Institute at the University of Pittsburgh. Elicited speeches were transcribed, coded, and assessed with three measures of structural complexity, a measure of lexical variety, two measures of accuracy, and three measures of fluency. The scores were then analyzed with hierarchical linear modeling (Singer & Willett, 2003) to investigate how each student’s performance changed over time for each measure and to determine predictive variables. Although individual differences were found in initial scores (often proficiency differences, but not for all measures), growth trajectories were the same for all measures, except one grammatical complexity measure (length of AS unit) where slopes differed by gender. All measures showed growth, and only two measures (lexical variety and a mean length of fluent run) showed non-linear growth. Trade-off effects found in cross-sectional studies were not found in these longitudinal data even though within-individual and between-individual correlations were also calculated. Additionally, the results may suggest that instructed language performance growth is uniform, rather than along individual paths. The research also serves to evaluate the measures, which has research and pedagogical implications.

[1]  Patti Spinner Second Language Assessment and Morphosyntactic Development. , 2011 .

[2]  James E. Purpura,et al.  Assessing Grammar , 2004 .

[3]  Kathleen Bardovi-Harlig,et al.  Attainment of Syntactic and Morphological Accuracy by Advanced Language Learners , 1989, Studies in Second Language Acquisition.

[4]  André A. Rupp,et al.  Growth in reading skills of children from diverse linguistic backgrounds : Findings from a 5-year longitudinal study , 2007 .

[5]  Rebecca C. Knickmeyer,et al.  Sex Differences in the Brain: Implications for Explaining Autism , 2005, Science.

[6]  N. Ellis Selective Attention and Transfer Phenomena in L2 Acquisition: Contingency, Cue Competition, Salience, Interference, Overshadowing, Blocking, and Perceptual Learning , 2006 .

[7]  Jos W. R. Twisk,et al.  Applied Longitudinal Data Analysis for Epidemiology , 2013 .

[8]  M. Ahmadian The effect of ‘massed’ task repetitions on complexity, accuracy and fluency: does it transfer to a new task? , 2011 .

[9]  D. Baca,et al.  A cognitive approach to language learning , 2006 .

[10]  G. Crookes Planning and Interlanguage Variation , 1989, Studies in Second Language Acquisition.

[11]  Kenneth Hyltenstam,et al.  Maturational constraints in SLA , 2008 .

[12]  Teresa Cadierno,et al.  Time and Motion: Measuring the Effects of the Conceptual Demands of Tasks on Second Language Speech Production , 2009 .

[13]  J. Schachter AN ERROR IN ERROR ANALYSIS1 , 1974 .

[14]  Micheline B. Chalhoub-Deville Chapter 10 Task-based assessments : Characteristics and validity evidence , 2022 .

[15]  Lourdes Ortega,et al.  Defining and Measuring SLA , 2008 .

[16]  Jacquelyn Schachter,et al.  Some Reservations Concerning Error Analyis , 1977 .

[17]  Wander Lowie,et al.  A Dynamic Systems Theory approach to second language acquisition , 2007, Bilingualism: Language and Cognition.

[18]  Jeanine Treffers-Daller,et al.  Language Dominance and Lexical Diversity: How Bilinguals and L2 Learners Differ in their Knowledge and Use of French Lexical and Functional Items , 2009 .

[19]  Linda C. Strauss,et al.  Comparing Student Performance and Growth in 2- and 4-Year Institutions , 2002 .

[20]  Peter Skehan,et al.  The Influence of Task Structure and Processing Conditions on Narrative Retellings. , 1999 .

[21]  Peter Skehan,et al.  Modelling Second Language Performance: Integrating Complexity, Accuracy, Fluency, and Lexis , 2009 .

[22]  Hua Lin,et al.  A Grammar of Mandarin Chinese 普通话语言学 By 林华 , 2007 .

[23]  Issues and Terminology in Long Term Care , 2022 .

[24]  Elabbas Benmamoun,et al.  The Syntax of Arabic , 2009 .

[25]  P. Robinson Task complexity, task difficulty, and task production: exploring interactions in a componential framework , 2001 .

[26]  B. MacWhinney The Childes Project: Tools for Analyzing Talk, Volume II: the Database , 2000 .

[27]  吉島 茂,et al.  文化と言語の多様性の中のCommon European Framework of Reference for Languages: Learning, teaching, assessment (CEFR)--それは基準か? (第10回明海大学大学院応用言語学研究科セミナー 講演) , 2008 .

[28]  K. W. Hunt Syntactic maturity in schoolchildren and adults. , 1970, Monographs of the Society for Research in Child Development.

[29]  G. Mizera,et al.  WORKING MEMORY AND L2 ORAL FLUENCY , 2006 .

[30]  Diane Larsen-Freeman,et al.  Adjusting Expectations: The Study of Complexity, Accuracy, and Fluency in Second Language Acquisition , 2009 .

[31]  Manfred Pienemann,et al.  Language Processing and Second Language Development: Processability theory , 1998 .

[32]  Lourdes Ortega,et al.  LONGITUDINAL RESEARCH IN SECOND LANGUAGE ACQUISITION: RECENT TRENDS AND FUTURE DIRECTIONS , 2005, Annual Review of Applied Linguistics.

[33]  Carl Mills Syntax and the Evaluation of College Writing: A Blind Alley , 1990 .

[34]  Yasuyo Sawaki,et al.  Factor structure of the TOEFL Internet-based test , 2009 .

[35]  Paul D. Umbach Gender equity in the academic labor market: an analysis of academic disciplines , 2006 .

[36]  Christopher Brumfit,et al.  Communicative methodology in language teaching: the roles of fluency and accuracy / Christopher Brumfit , 1986 .

[37]  Jürgen M. Meisel,et al.  On determining developmental stages in natural second language acquisition , 1981, Studies in Second Language Acquisition.

[38]  D. Larsen-Freeman Complex, dynamic systems: A new transdisciplinary theme for applied linguistics? , 2011, Language Teaching.

[39]  G. A. Marcoulides Multilevel Analysis Techniques and Applications , 2002 .

[40]  S. Verhulst,et al.  Age‐Dependent Traits: A New Statistical Model to Separate Within‐ and Between‐Individual Effects , 2006, The American Naturalist.

[41]  Mikkel Wallentin,et al.  Putative sex differences in verbal abilities and language cortex: A critical review , 2009, Brain and Language.

[42]  Peter Skehan Lexical Performance by Native and Non-Native Speakers on Language-Learning Tasks , 2009 .

[43]  Robert L. Politzer,et al.  An Exploratory Study of Learning Behaviors and Their Relationship to Gains in Linguistic and Communicative Competence , 1985 .

[44]  D. Jared,et al.  Early predictors of biliteracy development in children in French immersion: A 4-year longitudinal study. , 2011 .

[45]  Guoxing Yu,et al.  Lexical Diversity in Writing and Speaking Task Performances , 2010 .

[46]  M H Boyle,et al.  Multilevel modelling of hierarchical data in developmental studies. , 2001, Journal of child psychology and psychiatry, and allied disciplines.

[47]  PETER SKEHAN,et al.  Individual Differences in L 2 Learning 589 18 Individual Differences in Second Language Learning , 2003 .

[48]  Peter Skehan,et al.  Tasks and Language Performance Assessment , 2013, Second Language Task-Based Performance.

[49]  A. Elliot,et al.  On the measurement of achievement goals: critique, illustration, and application , 2008 .

[50]  Rod Ellis,et al.  The Study of Second Language Acquisition , 1994 .

[51]  K. W. Hunt Grammatical structures written at three grade levels , 1965 .

[52]  Matthew D. Parker,et al.  A comparative study between mean length of utterance in morphemes (MLUm) and mean length of utterance in words (MLUw) , 2005 .

[53]  Graham Crookes,et al.  The Utterance, and Other Basic Units for Second Language Discourse Analysis. , 1990 .

[54]  Marjolijn Verspoor,et al.  Variability in Second Language Development From a Dynamic Systems Perspective , 2008 .

[55]  Xiaofei Lu A Corpus-Based Evaluation of Syntactic Complexity Measures as Indices of College-Level ESL Writers' Language Development , 2011 .

[56]  Paul Meara,et al.  P-Lex: A Simple and Effective Way of Describing the lexical Characteristics of Short L2 Tests. , 2001 .

[57]  B. MacWhinney,et al.  The Competition Model: the Input, the Context, and the Brain Part of the First and Second Language Acquisition Commons, and the Psychology Commons , 2022 .

[58]  Bishan Yang,et al.  Morphosyntactic Phenomena of Korean in Role and Reference Grammar: Psych-Verb Constructions, Inflectional Verb Morphemes, Complex Sentences, and Relative Clauses , 1994 .

[59]  Martin Bygate,et al.  Chapter 12. Effects of task repetition on the structure and control of oral language , 2009 .

[60]  David Malvern,et al.  Investigating accommodation in language proficiency interviews using a new measure of lexical diversity , 2002 .

[61]  John N. Wendel An assessment of English language learner writing , 2008 .

[62]  Pauline Foster,et al.  Task type and task processing conditions as influences on foreign language performance , 1997 .

[63]  Ho-min Sohn The Korean language , 1999 .

[64]  A. Furnham,et al.  Extraversion: The Unloved Variable in Applied Linguistic Research , 1999 .

[65]  Rod Ellis,et al.  Analysing Learner Language , 2005 .

[66]  Abdulmoneim Mahmoud Modern Standard Arabic vs. Non-Standard Arabic: Where Do Arab Students of EFL Transfer From? , 2000 .

[67]  K. Stanovich Matthew Effects in Reading: Some Consequences of Individual Differences in the Acquisition of Literacy , 2009 .

[68]  Gary J. Ockey,et al.  Self-consciousness and Assertiveness as Explanatory Variables of L2 Oral Ability: A Latent Variable Approach , 2011 .

[69]  Yasuhiro Shirai,et al.  Is the Acquisition Order of Grammatical Morphemes Impervious to L1 Knowledge? Evidence From the Acquisition of Plural ‐s, Articles, and Possessive ’s , 2009 .

[70]  Li-Shih Huang The Potential Influence of L1 (Chinese) on L2 (English) Communication. , 2010 .

[71]  Margaret K. Nydell Understanding Arabs: A Guide for Modern Times , 2005 .

[72]  Paul van Geert,et al.  The Dynamic Systems Approach in the Study of L1 and L2 Acquisition: An Introduction , 2008 .

[73]  Peter Skehan,et al.  Cognition and Second Language Instruction: Cognition and tasks , 2001 .

[74]  Theodore V. Higgs,et al.  The Push Toward Communication. , 1982 .

[75]  Deborah Cameron,et al.  Sex/Gender, Language and the New Biologism , 2010 .

[76]  Anthony S. Bryk,et al.  Hierarchical Linear Models: Applications and Data Analysis Methods , 1992 .

[77]  J. Norris,et al.  Towards an Organic Approach to Investigating CAF in Instructed SLA: The Case of Complexity , 2009 .

[78]  P. Robinson,et al.  Attention and Memory during SLA , 2008 .

[79]  K. McGraw,et al.  Forming inferences about some intraclass correlation coefficients. , 1996 .

[80]  Kees de Bot,et al.  Introduction: Second Language Development as a Dynamic Process , 2008 .

[81]  Craig Chaudron,et al.  Second Language Classrooms. Research on Teaching and Learning. , 1988 .

[82]  Joseph Kee-Kuok Wong,et al.  Are the Learning Styles of Asian International Students Culturally or Contextually Based , 2004 .

[83]  Byung-Eun Cho,et al.  Issues Concerning Korean Learners of English: English Education in Korea and Some Common Difficulties of Korean Students , 2004 .

[84]  H. Scarborough Index of Productive Syntax , 1990, Applied Psycholinguistics.

[85]  Marianne Spoelman,et al.  Dynamic Patterns in Development of Accuracy and Complexity: A Longitudinal Case Study in the Acquisition of Finnish , 2010 .

[86]  Robert M. DeKeyser Practice in a Second Language: Study abroad as foreign language practice , 2007 .

[87]  Z. Syed The Sociocultural Context of English Language Teaching in the Gulf. , 2003 .

[88]  D. Larsen-Freeman The Emergence of Complexity, Fluency, and Accuracy in the Oral and Written Production of Five Chinese Learners of English , 2006 .

[89]  John F. Sowa,et al.  Construing Experience through Meaning: A Language-based Approach to Cognition by M. A. K. Halliday and Christian M. I. M. Matthiessen , 2001, Computational Linguistics.

[90]  Folkert Kuiken,et al.  The influence of complexity in monologic versus dialogic tasks in Dutch L2 , 2007 .

[91]  Peter Robinson,et al.  Cognition and Second Language Instruction: Task complexity, cognitive resources, and syllabus design: a triadic framework for examining task influences on SLA , 2001 .

[92]  Judith D. Singer,et al.  Using SAS PROC MIXED to Fit Multilevel Models, Hierarchical Models, and Individual Growth Models , 1998 .

[93]  R. Ellis,et al.  The Effects of Pre‐Task Planning and On‐Line Planning on Fluency, Complexity and Accuracy in L2 Monologic Oral Production , 2003 .

[94]  Carolina Maldonado-Carreño,et al.  Children's early approaches to learning and academic trajectories through fifth grade. , 2010, Developmental psychology.

[95]  Ping Chen,et al.  Modern Chinese: History and Sociolinguistics , 1999 .

[96]  Terence Odlin,et al.  Cross‐Linguistic Influence , 2008 .

[97]  Lourdes Ortega,et al.  Understanding Second Language Acquisition , 2008 .

[98]  Florence Myles,et al.  Lexical Development in Instructed L2 Learners of French: Is there a Relationship with Morphosyntactic Development? , 2009 .

[99]  H. Riggenbach,et al.  Overview: varying perspectives on fluency , 2000 .

[100]  Jack M. Fletcher,et al.  Developmental Lag versus Deficit Models of Reading Disability: A Longitudinal, Individual Growth Curves Analysis. , 1996 .

[101]  Mansoor Tavakoli,et al.  The effects of simultaneous use of careful online planning and task repetition on accuracy, complexity, and fluency in EFL learners’ oral production , 2011 .

[102]  Timothy J. Robinson,et al.  Multilevel Analysis: Techniques and Applications , 2002 .

[103]  Clyde A. Warden,et al.  Motivators That Do Not Motivate: The Case of Chinese EFL Learners and the Influence of Culture on Motivation , 2005 .

[104]  R. Hawkins,et al.  The development of fluency in advanced learners of French , 1996 .

[105]  Alex Housen,et al.  Complexity, accuracy and fluency in second language acquisition , 2009 .

[106]  Folkert Kuiken,et al.  Task complexity and measures of linguistic performance in L2 writing , 2007 .

[107]  Peter Skehan,et al.  Task-Based Instruction , 1998, Annual Review of Applied Linguistics.

[108]  G. Pallotti CAF: Defining, Refining and Differentiating Constructs , 2009 .

[109]  R. Schmidt Psychological Mechanisms Underlying Second Language Fluency , 1992, Studies in Second Language Acquisition.

[110]  C. Perfetti,et al.  Fluency Training in the ESL Classroom: An Experimental Study of Fluency Development and Proceduralization , 2011 .

[111]  G. Richard Tucker,et al.  ERROR ANALYSIS AND ENGLISH‐LANGUAGE STRATEGIES OF ARAB STUDENTS1 , 1974 .

[112]  Michael H. Long,et al.  An introduction to second language acquisition research , 1990 .

[113]  E. Bates,et al.  INDIVIDUAL DIFFERENCES AND THEIR IMPLICATIONS FOR THEORIES OF LANGUAGE DEVELOPMENT , 1995 .

[114]  Alan Tonkyn,et al.  Measuring spoken language: a unit for all reasons , 2000 .

[115]  Rod Ellis,et al.  第二语言习得概论 = Understanding second language acquisition , 1985 .

[116]  G. J. Ramstedt A Korean grammar , 1939 .

[118]  Sari Luoma,et al.  Assessing Speaking: Developing test specifications , 2004 .

[119]  Shunji Inagaki,et al.  Second Language Development in Writing: Measures of Fluency, Accuracy, and Complexity , 1998 .

[120]  Maria Thomas-Ruzic,et al.  The Least You Should Know about Arabic: Implications for the ESL Writing Instructor. , 1983 .

[121]  P. Robinson,et al.  Task complexity, the Cognition Hypothesis and second language learning and performance , 2007 .

[122]  David Malvern,et al.  Measuring vocabulary diversity using dedicated software , 2000 .

[123]  J. Roberts Variation in Child Language , 2006 .

[124]  Peter Skehan,et al.  Complexity, accuracy, fluency and lexis in task-based performance: a meta-analysis of the Ealing research , 2012 .