College student perceptions of writing errors, text quality, and author characteristics

Abstract Both conventional wisdom and empirical research suggest that errors in writing impact perceptions of both writing quality and characteristics of the author. Texts that exhibit poor spelling and grammar, or lack compelling arguments and clear structure, are perceived as lower quality. Moreover, the authors themselves may be perceived as less intelligent, creative, hardworking or trustworthy. Using a within-subjects design, the current study systematically examined the effects of lower-level errors and higher-level errors on college students’ ( n  = 70) perceptions of multiple aspects of writing quality and author characteristics. Results demonstrated that students noticed both kinds of errors but were much more sensitive to lower-level errors than higher-level errors. Nearly identical patterns were observed for judgments of text quality and authors, and the sensitivity to lower-level errors was stronger for more-skilled readers. Implications for challenges and biases in peer assessment are discussed.

[1]  Ute Knoch,et al.  Re-Training Writing Raters Online: How Does It Compare with Face-to-Face Training?. , 2007 .

[2]  S. Freedman How Characteristics of Student Essays Influence Teachers ' Evaluations , 2005 .

[3]  Atta Gebril,et al.  Exploring the relationship of organization and connection with scores in integrated writing assessment , 2017 .

[4]  F. Peter,et al.  Automated writing evaluation: An expanding body of knowledge. , 2016 .

[5]  Christopher W. Bauman,et al.  Making Attributions for Behaviors: The Prevalence of Correspondence Bias in the General Population , 2010 .

[6]  Amanda Godley,et al.  Bidialectal African American Adolescents' Beliefs about Spoken Language Expectations in English Classrooms. , 2012 .

[7]  J. Marshall,et al.  WRITING NEATNESS, COMPOSITION ERRORS, AND ESSAY GRADES , 1969 .

[8]  Wan Wan Constructing and developing ESL students’ beliefs about writing through metaphor: An exploratory study , 2014 .

[9]  Danielle S. McNamara,et al.  Say More and Be More Coherent: How Text Elaboration and Cohesion Can Increase Writing Quality. , 2016 .

[10]  D. Kreiner,et al.  Effects of Spelling Errors on the Perception of Writers , 2002, The Journal of general psychology.

[11]  Paul L. Simpson,et al.  On the discourse of satire , 2003 .

[12]  William Condon,et al.  Large-Scale Assessment, Locally-Developed Measures, and Automated Scoring of Essays: Fishing for Red Herrings? , 2013 .

[13]  Jane Hodson Dialect in Film and Literature , 2014 .

[14]  Haiying Li,et al.  A sequential analysis of responses in online debates to postings of students exhibiting high versus low grammar and spelling errors , 2017 .

[15]  P. Lindsey,et al.  Understanding Variations Between Student and Teacher Application of Rubrics , 2015 .

[16]  L. F. Thompson,et al.  Computer-mediated cross-cultural collaboration: attributing communication errors to the person versus the situation. , 2010, The Journal of applied psychology.

[17]  Stephen Graham,et al.  Word processing programs and weaker writers/readers: a meta-analysis of research findings , 2012 .

[18]  D. Myhill,et al.  The role of grammar in the writing curriculum: A review of the literature , 2014 .

[19]  L. Figueredo,et al.  Didn't You Run the Spell Checker? Effects of Type of Spelling Error and Use of a Spell Checker on Perceptions of the Author , 2005 .

[20]  Ernesto Panadero,et al.  The use and design of rubrics to support assessment for learning , 2017 .

[21]  S. McKelvie,et al.  Does Writeing Rite Matter? Effects of Textual Errors on Personality Trait Attributions , 2019 .

[22]  Toshihiko Kobayashi Native and Nonnative Reactions to ESL Compositions , 1991 .

[23]  Laura K. Allen,et al.  Automated Detection of Essay Revising Patterns: Applications for Intelligent Feedback in a Writing Tutor. , 2015 .

[24]  Christian D. Schunn,et al.  Understanding the benefits of providing peer feedback: how students respond to peers’ texts of varying quality , 2015 .

[25]  T. Thompson Understanding attitudes toward assessment: The personality factor , 1995 .

[26]  Sandra Schamroth Abrams,et al.  Demystifying Digitalk , 2014 .

[27]  Hunter M. Breland,et al.  Perceptions of Writing Skill. College Board Report No. 82-4. , 1982 .

[28]  T. Shanahan,et al.  Reading and Writing Relations and Their Development , 2000 .

[29]  Ali Reza Rezaei,et al.  Reliability and validity of rubrics for assessment through writing , 2010 .

[30]  Crispin Thurlow,et al.  From Statistical Panic to Moral Panic: The Metadiscursive Construction and Popular Exaggeration of New Media Language in the Print Media , 2006, J. Comput. Mediat. Commun..

[31]  Jacob Cohen,et al.  A power primer. , 1992, Psychological bulletin.

[32]  T. Shanahan Relationships between reading and writing development. , 2016 .

[33]  C. Wood,et al.  do i know its wrong: children’s and adults’ use of unconventional grammar in text messaging , 2014 .

[34]  Rod D. Roscoe,et al.  Automated formative writing assessment using a levels of language framework , 2017 .

[35]  D. Fisher,et al.  Learning to Talk Like the Test: Guiding Speakers of African American Vernacular English , 2013 .

[36]  N. Elliot On a Scale: A Social History of Writing Assessment in America , 2005 .

[37]  Steve Graham,et al.  It Is More Than Just the Message: Presentation Effects in Scoring Writing , 2011 .

[38]  S. Graham,et al.  Writing education around the globe: introduction and call for a new global analysis , 2016 .

[39]  Danielle S. McNamara,et al.  What Is Successful Writing? An Investigation Into the Multiple Ways Writers Can Write Successful Essays , 2014 .

[40]  Anders Jonsson,et al.  The use of scoring rubrics: Reliability, validity, and educational consequences , 2007 .

[41]  Amanda M. VanDerHeyden,et al.  The Technical Adequacy of Curriculum-Based and Rating-Based Measures of Written Expression for Elementary School Students , 2006 .

[42]  Hunter M. Breland,et al.  Perceptions of Writing Skills , 1984 .

[43]  Charlene Polio,et al.  THE ACCURACY OF COMPUTER-ASSISTED FEEDBACK AND STUDENTS' RESPONSES TO IT , 2015 .

[44]  Benjamin A. Rifkin,et al.  Error Gravity: A Critical Review of Research Design. , 1995 .

[45]  T. Santangelo,et al.  Does spelling instruction make students better spellers, readers, and writers? A meta-analytic review , 2014 .

[46]  Ken Hyland,et al.  Teachers’ perceptions of error: The effects of first language and experience , 2006 .

[47]  K. Topping Peer Assessment Between Students in Colleges and Universities , 1998 .

[48]  P. Alexander,et al.  Do students' beliefs about writing relate to their writing self-efficacy, apprehension, and performance? , 2014 .

[49]  David Johnson,et al.  Linguistic discrimination in writing assessment: How raters react to African American “errors,” ESL errors, and standard English errors on a state-mandated writing exam , 2012 .

[50]  Chris M. Anson,et al.  Assessing peer and instructor response to writing: A corpus analysis from an expert survey , 2017 .

[51]  Anders Jonsson,et al.  The Use of Scoring Rubrics for Formative Assessment Purposes Revisited: A Review. , 2013 .

[52]  Zhenhui Rao,et al.  Native and Non-native Teachers’ Perceptions of Error Gravity: The Effects of Cultural and Educational Factors , 2017 .

[53]  N. Falchikov,et al.  Student Peer Assessment in Higher Education: A Meta-Analysis Comparing Peer and Teacher Marks , 2000 .

[54]  D. Gilbert,et al.  The correspondence bias. , 1995, Psychological bulletin.

[55]  M. A. Britt,et al.  Investigating Instruction for Improving Revision of Argumentative Essays , 2011 .

[56]  Ivan Chong How students' ability levels influence the relevance and accuracy of their feedback to peers: A case study , 2017 .

[57]  Arne Lervåg,et al.  Reading comprehension and its underlying components in second-language learners: A meta-analysis of studies comparing first- and second-language learners. , 2014, Psychological bulletin.

[58]  Brian P. Meier,et al.  Mindfulness Reduces the Correspondence Bias , 2017, Quarterly journal of experimental psychology.

[59]  Steve Graham,et al.  Throw 'em out or make 'em better? State and district high-stakes writing assessments , 2011 .

[60]  George Engelhard,et al.  Examining Rater Errors in the Assessment of Written Composition With a Many-Faceted Rasch Model , 1994 .

[61]  Thomas E. Nunnally Breaking the Five-Paragraph-Theme Barrier. , 1991 .

[62]  L. McHugh,et al.  Perspective taking reduces the fundamental attribution error , 2015 .

[63]  L. Thompson,et al.  Learning to Teach the Five-Paragraph Theme. , 2003 .

[64]  P. Carrell The Effect of Writers' Personalities and Raters' Personalities on the Holistic Evaluation of Writing. , 1995 .

[65]  Junko Yamashita,et al.  L2 Reading Comprehension and Its Correlates: A Meta‐Analysis , 2014 .

[66]  Paul Deane,et al.  On the relation between automated essay scoring and modern views of the writing construct , 2013 .

[67]  Composition Errors and Essay Examination Grades Re-Examined , 1967 .

[68]  Julie E. Boland,et al.  If You’re House Is Still Available, Send Me an Email: Personality Influences Reactions to Written Errors in Email Messages , 2016, PloS one.

[69]  Judit Kormos The role of individual differences in L2 writing , 2012 .

[70]  Kristen Purcell,et al.  The impact of digital tools on student writing and how writing is taught in schools , 2013 .

[71]  J. Hayes Modeling and Remodeling Writing , 2012 .

[72]  Christian D. Schunn,et al.  The effects of skill diversity on commenting and revisions , 2013 .

[73]  Diana Hacker,et al.  Rules for Writers , 1985 .

[74]  Jill Fitzgerald,et al.  Research on Revision in Writing , 1987 .

[75]  Mary Jane White,et al.  Implicit writing beliefs and their relation to writing quality , 2005 .