Rubrics, prototypes, and exemplars: Categorization theory and systems of writing placement

Abstract Categorization theory helps make sense of writing placement. As developed by psychologists, social scientists, and language analysts, current theory suggests that human acts of categorization fall roughly under three models: classical, prototypical, and exemplar. Results of actual holistic scoring, however, show that readers behave as if the categories (scale points) had prototypical structure. In many ways, prototypical and exemplar categorization support a different writing-placement method, one more efficient than the holistic, a two-tiered sequence of quick, blind, and single readings followed by careful, informed, and multiple readings. The procedure is flexible and admits wide variations. Categorization theory itself, and standard research techniques associated with it, can be productive in inquiry into writing assessment.

[1]  Edward E. Smith,et al.  Correlated properties in natural categories , 1984 .

[2]  R. Hogarth Judgement and choice: The psychology of decision , 1982 .

[3]  Eviatar Zerubavel,et al.  The fine line : making distinctions in everyday life , 1993 .

[4]  Richard H. Haswell Searching for Kiyoko: Bettering mandatory ESL writing placement , 1998 .

[5]  L. Barritt,et al.  Researching Practice: Evaluating Assessment Essays. , 1986 .

[6]  Susanmarie Harrington New Visions of Authority in Placement Test Rating. , 1998 .

[7]  E. Rosch,et al.  Structural bases of typicality effects. , 1976 .

[8]  H. Simon,et al.  Rational choice and the structure of the environment. , 1956, Psychological review.

[9]  M. Bornstein,et al.  Chromatic information processing: Rate depends on stimulus location in the category and psychological complexity , 1980 .

[10]  Lucille M. Schultz,et al.  Appealing Texts , 1990 .

[11]  Eliot R. Smith,et al.  Exemplar and Prototype Use in Social Categorization , 1990 .

[12]  Edward M. White,et al.  Teaching and Assessing Writing , 1986 .

[13]  John C. Turner,et al.  Perceiving people as group members: The role of fit in the salience of social categorizations , 1991 .

[14]  E. Rosch Cognitive Representations of Semantic Categories. , 1975 .

[15]  Steven L. Neuberg,et al.  A Continuum of Impression Formation, from Category-Based to Individuating Processes: Influences of Information and Motivation on Attention and Interpretation , 1990 .

[16]  A. Ball Expanding the dialogue on culture as a critical component when assessing writing , 1997 .

[17]  S. Freedman How Characteristics of Student Essays Influence Teachers ' Evaluations , 2005 .

[18]  Edward E. Smith,et al.  An Invitation to cognitive science , 1997 .

[19]  Paul B. Diederich,et al.  Measuring Growth in English , 1974 .

[20]  S. Plous The psychology of judgment and decision making , 1994 .

[21]  Eliot R. Smith,et al.  Exemplar-Based Model of Social Judgment , 1992 .

[22]  Doug Shale,et al.  Essay Reliability: Form and Meaning. , 1986 .

[23]  Lawrence W. Barsalou,et al.  The instability of graded structure: implications for the nature of concepts , 1987 .

[24]  G. W. Hill Group versus individual performance: are n + 1 heads better than one?" psychological bulletin , 1982 .

[25]  Wayne D. Gray,et al.  Basic objects in natural categories , 1976, Cognitive Psychology.

[26]  L. Barsalou Ideals, central tendency, and frequency of instantiation as determinants of graded structure in categories. , 1985, Journal of experimental psychology. Learning, memory, and cognition.

[27]  E. Lenneberg Biological Foundations of Language , 1967 .

[28]  Sharon Lee Armstrong,et al.  What some concepts might not be , 1983, Cognition.

[29]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[30]  J. Turner,et al.  Contextual changes in the prototypicality of extreme and moderate outgroup members , 1995 .

[31]  J. Crocker,et al.  Cognitive Processes in the Revision of Stereotypic Beliefs , 1983 .

[32]  P. Devine Stereotypes and prejudice: Their automatic and controlled components. , 1989 .

[33]  Richard H. Haswell,et al.  Gaining Ground in College Writing: Tales of Development and Interpretation , 1991 .

[34]  Eleanor Rosch,et al.  Principles of Categorization , 1978 .

[35]  Edward E. Smith,et al.  Categories and concepts , 1984 .

[36]  S. Fiske Social cognition and social perception. , 1993, Annual review of psychology.

[37]  Daniel J. Royer,et al.  Directed Self-Placement: An Attitude of Orientation. , 1998 .

[38]  M. Brewer A dual process model of impression formation. , 1988 .

[39]  E. Rosch,et al.  Family resemblances: Studies in the internal structure of categories , 1975, Cognitive Psychology.

[40]  L. Barsalou,et al.  Ad hoc categories , 1983, Memory & cognition.

[41]  Edward A. Morante A primer on placement testing , 1987 .

[42]  E. Guba,et al.  Fourth Generation Evaluation , 1989 .

[43]  E. Hirt,et al.  DIAGNOSTIC AND CONFIRMATION STRATEGIES IN TRAIT HYPOTHESIS TESTING , 1990 .

[44]  Stephen A. Bernhardt,et al.  Text Revisions by Basic Writers: From Impromptu First Draft to Take-Home , 1988 .

[45]  Dale T. Miller,et al.  Norm theory: Comparing reality to its alternatives , 1986 .

[46]  Linda Argote,et al.  Individual versus group use of base-rate and individuating information , 1986 .

[47]  D. Ilgen,et al.  The Effects of Ratee Prototypicality on Rater Observation and Accuracy1 , 1989 .

[48]  E. Higgins,et al.  Individual construct accessibility and subjective impressions and recall. , 1982 .

[49]  Bob Broad Reciprocal authorities in communal writing assessment: Constructing textual value within a “New politics of inquiry” , 1997 .

[50]  Lance J. Rips,et al.  Semantic distance and the verification of semantic relations , 1973 .

[51]  G. Lakoff,et al.  Women, Fire, and Dangerous Things: What Categories Reveal about the Mind , 1988 .

[52]  Susan T. Fiske,et al.  Category-based versus piecemeal-based affective responses: Developments in schema-triggered affect. , 1986 .

[53]  B. Tversky,et al.  Objects, parts, and categories. , 1984 .

[54]  James Hoetker ESSAY EXAMINATION TOPICS AND STUDENTS' WRITING , 1982 .

[55]  R. Moreland,et al.  Role of the self-concept in the perception of others. , 1985 .

[56]  D. Homa On the Nature of Categories , 1984 .

[57]  Mary L. DeRemer,et al.  Writing assessment: Raters' elaboration of the rating task , 1998 .

[58]  M. Brewer,et al.  Perceptions of the Elderly: Stereotypes as Prototypes , 1981 .