Measures of Linguistic Accuracy in Second Language Writing Research

Because a literature review revealed that the descriptions of measures of linguistic accuracy in research on second language writing are often inadequate and their reliabilities often not reported, I completed an empirical study comparing 3 measures. The study used a holistic scale, error-free T-units, and an error classification system on the essays of English as a second language (ESL) students. I present detailed discussion of how each measure was implemented, give intra- and interrater reliabilities and discuss why disagreements arose within a rater and between raters. The study will provide others doing research in the area of L2 writing with a comprehensive description that will help them select and use a measure of linguistic accuracy.

[1]  K. W. Hunt.  Grammatical structures written at three grade levels , 1965 .

[2]  H. Jacobs.  Testing Esl Composition: A Practical Approach , 1981 .

[3]  J. Hedgcock,et al.  Collaborative oral/aural revision in foreign language writing instruction , 1992 .

[4]  Christine Pearson Casanave,et al.  Language development in students' journals , 1994 .

[5]  Terri Gullickson,et al.  Publication Manual of the American Psychological Association (4th ed.). , 1996 .

[6]  Robert A. Fischer.  Testing Written Communicative Competence in French. , 1984 .

[7]  Barbara Kroll.  Second Language Writing. Research Insights for the Classroom. , 1990 .

[8]  Steven J. Ross,et al.  SALIENCE OF FEEDBACK ON ERROR AND ITS EFFECT ON EFL WRITING QUALITY , 1986 .

[9]  Diana Frantzen.  The Effects of Grammar Supplementation on Written Accuracy in an Intermediate Spanish Content Course , 1995 .

[10]  Susan M. Gass,et al.  REPLICATION AND REPORTING , 1997, Studies in Second Language Acquisition.

[11]  Sandra Ishikawa,et al.  Objective measurement of low-proficiency EFL narrative writing , 1995 .

[12]  Zhang Shuqiang.  Cognitive Complexity and Written Production in English as a Second Language , 1987 .

[13]  Christine Goring. Kepner.  An Experiment in the Relationship of Types of Written Feedback to the Development of Second‐Language Writing Skills , 1991 .

[14]  Kenneth D. Chastain,et al.  Characteristics of Graded and Ungraded Compositions. , 1990 .

[15]  Hiroe Kobayashi,et al.  Effects of First Language on Second Language Writing: Translation versus Direct Composition† , 1992 .

[16]  B. Weltens,et al.  The reliability ritual , 1991 .

[17]  Liz Hamp-Lyons,et al.  Communicative Writing Profiles: An Investigation of the Transferability of a Multiple‐Trait Scoring Instrument Across ESL Writing Assessment Contexts * , 1991 .

[18]  Kathleen Bardovi-Harlig,et al.  Attainment of Syntactic and Morphological Accuracy by Advanced Language Learners , 1989, Studies in Second Language Acquisition.

[19]  Robert S. Carlisle.  The Writing of Anglo and Hispanic Elementary School Students in Bilingual, Submersion, and Regular Programs , 1989, Studies in Second Language Acquisition.

[20]  Barbara Kroll,et al.  Second Language Writing: What does time buy? ESL student performance on home versus class compositions , 1990 .

[21]  Andrew D. Cohen,et al.  The writing of Southeast Asian-American students in secondary school and university☆ , 1993 .

[22]  G. Crookes.  Planning and Interlanguage Variation , 1989, Studies in Second Language Acquisition.