What Is Successful Writing? An Investigation Into the Multiple Ways Writers Can Write Successful Essays

This study identifies multiple profiles of successful essays via a cluster analysis approach using linguistic features reported by a variety of natural language processing tools. The findings from the study indicate that there are four profiles of successful writers for the samples analyzed. These four profiles are linguistically distinct from one another and demonstrate that expert human raters examine a number of different linguistic features in a variety of combinations when assessing writing proficiency and assigning high scores to independent essays (regardless of the scoring rubric considered). The writing styles in the four clusters can be described as action and depiction style, academic style, accessible style, and lexical style. The study provides empirical evidence that successful writing cannot be defined simply through a single set of predefined features, but that, rather, successful writing has multiple profiles. While these profiles may overlap, each profile is distinct.

[1]  Richard H. Haswell.  Documenting Improvement in College Writing , 2000 .

[2]  Pegeen Reichert Powell.  Retention and Writing Instruction: Implications for Access and Pedagogy. , 2009 .

[3]  Danielle S. McNamara,et al.  Predicting Human Scores of Essay Quality Using Computational Indices of Linguistic and Textual Features , 2011, AIED.

[4]  Deborah McCutchen,et al.  Individual Differences in Writing: Implications of Translating Fluency. , 1994 .

[5]  Gale H. Roid,et al.  Patterns of Writing Skills Derived From Cluster Analysis of Direct-Writing Assessments , 1994 .

[6]  Danielle S McNamara,et al.  Natural language processing in an intelligent writing strategy tutoring system , 2012, Behavior Research Methods.

[7]  Michel Ferrari,et al.  What makes a good writer? Differences in good and poor writers' self-regulation of writing , 1998 .

[8]  P. David Pearson.  The Effects of Grammatical Complexity on Children's Comprehension, Recall, and Conception of Certain Semantic Relations. , 1974 .

[9]  Pavlo D. Antonenko,et al.  Using cluster analysis for data mining in educational technology research , 2012, Educational Technology Research and Development.

[10]  Martin Chodorow,et al.  Automated Essay Evaluation: The Criterion Online Writing Service , 2004, AI Mag..

[11]  Karen A. Schriver.  Evaluating Text Quality: The Continuum from Text-Focused to Reader-Focused Methods. Technical Report No. 41. , 1989 .

[12]  Paul Deane,et al.  On the relation between automated essay scoring and modern views of the writing construct , 2013 .

[13]  Arthur C. Graesser,et al.  Coh-Metrix: An automated tool for theoretical and applied natural language processing , 2011 .

[14]  Charles A. Perfetti,et al.  Coherence and connectedness in the development of discourse production , 1982 .

[15]  M. A. Britt,et al.  Argumentation Schema and the Myside Bias in Written Argumentation , 2009 .

[16]  Danielle S. McNamara,et al.  The epistemic stance between the author and reader: A driving force in the cohesion of text and writing , 2013 .

[17]  B. Huot,et al.  The Literature of Direct Writing Assessment: Major Concerns and Prevailing Trends , 1990 .

[18]  Arthur C. Graesser,et al.  Coh-Metrix , 2011 .

[19]  Arthur C. Graesser,et al.  Coh-Metrix: Analysis of text on cohesion and language , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[20]  Rod D. Roscoe,et al.  Writing pal: Feasibility of an intelligent writing strategy tutor in the high school classroom , 2013 .

[21]  Philip M. McCarthy,et al.  Linguistic Features of Writing Quality , 2010 .

[22]  Danielle S. McNamara,et al.  The Development of Writing Proficiency as a Function of Grade Level: A Linguistic Analysis , 2011 .

[23]  Scott Jarvis,et al.  Exploring multiple profiles of highly rated learner compositions , 2003 .

[24]  D. McCutchen.  Domain knowledge and linguistic knowledge in the development of writing ability , 1986 .

[25]  Douglas Biber,et al.  Representativeness in corpus design , 1993 .

[26]  Michelle Perry,et al.  Indexing transitional knowledge , 1993 .

[27]  W. Kintsch,et al.  Are Good Texts Always Better? Interactions of Text Coherence, Background Knowledge, and Levels of Understanding in Learning From Text , 1996 .

[28]  R. Flesch.  A new readability yardstick. , 1948, The Journal of applied psychology.

[29]  Cheryl M. Yates,et al.  Lower-level developmental skills in beginning writing , 1992 .

[30]  R. T. Kellogg,et al.  Training Advanced Writing Skills: The Case for Deliberate Practice , 2009 .

[31]  R. T. Kellogg.  Effects of topic knowledge on the allocation of processing time and cognitive effort to writing processes , 1987, Memory & cognition.