Direct and Indirect Writing Assessments: Examining Issues of Equity and Utility

Performance tests are increasingly used as alternatives to, or in connection with, standardized multiple-choice tests as a means of assessing student learning and school accountability. Besides their proposed equity advantages over multiple-choice tests in measuring student learning across groups of students, performance assessments have also been viewed as having greater utility for monitoring school progress because of their proposed closer correspondence to the curriculum that is actually taught. We examined these assumptions by comparing third-grade student performance on a performance-based writing test and a multiple-choice test of language skills. We observed smaller differences in achievement on the writing performance assessment for some groups of students (e.g., low socioeconomic status, various ethnic backgrounds) than are commonly observed on multiple-choice tests. Girls, however, had higher mean scores than boys on both types of assessments. Moreover, the school’s identification and commitment over time to improving its students’ writing skills positively related to its students’ outcomes on the writing performance test. Overall, our examination of performance-based writing assessment is encouraging with respect to providing a relatively fair assessment and measuring learning tasks that are related to the school’s curricular practices.

[1]  Georgia Earnest García Factors Influencing the English Reading Test Performance of Spanish-Speaking Hispanic Children. Technical Report No. 539. , 1991 .

[2]  Anthony S. Bryk,et al.  A Multilevel Model of the Social Distribution of High School Achievement. , 1989 .

[3]  P. David Pearson,et al.  Assessment and Diversity , 1994 .

[4]  G. Wiggins Teaching to the (Authentic) Test. , 1989 .

[5]  Daniel P. Mayer Do New Teaching Standards Undermine Performance on Old Tests? , 1998 .

[6]  Andrew C. Porter,et al.  The Uses and Misuses of Opportunity-to-Learn Standards. , 1995 .

[7]  Stephen P. Klein,et al.  The Cost of Science Performance Assessments in Large-Scale Testing Programs , 1997 .

[8]  L. Resnick,et al.  Assessing the Thinking Curriculum: New Tools for Educational Reform , 1992 .

[9]  Teacher Reports on Opportunity to Learn: Analyses of the 1993 California Learning Assessment System (CLAS) , 1995 .

[10]  Susan R. Goldman,et al.  Evaluation of Procedure-Based Scoring for Hands-On Science Assessment , 1992 .

[11]  Joseph Murphy,et al.  Handbook of Research on Educational Administration , 1999 .

[12]  Harvey S. Wiener,et al.  Writing Assessment: Issues and Strategies , 1987 .

[13]  Linda Darling-Hammond Authentic assessment in action , 1995 .

[14]  Stephen B. Dunbar,et al.  Complex, Performance-Based Assessment: Expectations and Validation Criteria , 1991 .

[15]  Robert L. Linn,et al.  Performance Assessment: Policy Promises and Technical Measurement Standards , 1994 .

[16]  Harold H. Wenglinsky Finance Equalization and Within-School Equity: The Relationship Between Education Spending and the Social Distribution of Achievement , 1998 .

[17]  Janet Ouston School Effectiveness and School Improvement: Critique of a Movement , 1999 .

[18]  S. Hennings A Comparison of Equating Methods Applied to Performance-Based Assessments. , 1996 .

[19]  L. Morte,et al.  School Law: Cases and Concepts , 1990 .

[20]  Michael Rutter,et al.  Fifteen Thousand Hours: Secondary Schools and Their Effects on Children , 1979 .

[21]  Max Stafford-Clark,et al.  Taking stock , 2022, Trans. GIS.

[22]  Guillermo Solano-Flores,et al.  Performance-Based Assessments , 1994 .

[23]  Norman Edward Gronlund,et al.  Assessment of student achievement , 1997 .

[24]  Marilyn Mayer Culpepper,et al.  A Comparison of a Multiple Choice and an Essay Test of Writing Skills. , 1982 .

[25]  Bill Harp Assessment and Evaluation in Whole Language Programs , 1991 .

[26]  Kathryn Hoberg Arehart,et al.  State of the States: The Status of Universal Newborn Hearing Screening, Assessment, and Intervention Systems in 16 States. , 1998, American journal of audiology.

[27]  J. Pellegrino Commentary: Understanding What We Measure and Measuring What We Understand , 1992 .

[28]  Pamela A. Moss,et al.  Can There Be Validity Without Reliability? , 1994 .

[29]  Richard J. Stiggins,et al.  A Comparison of Direct and Indirect Writing Assessment Methods. , 1981 .

[30]  Andrew C. Porter,et al.  Research news and Comment: The Uses and Misuses of Opportunity-to-Learn Standards , 1995 .

[31]  Randy Elliot Bennett,et al.  Equivalence of Free-Response and Multiple-Choice Items , 1991 .

[32]  R. Brennan,et al.  Mirror, Mirror on the Wall, Which Is the Fairest Test of All? An Examination of the Equitability of Portfolio Assessment Relative to Standardized Tests , 1997 .

[33]  Yuk Fai Cheong,et al.  HLM 6: Hierarchical Linear and Nonlinear Modeling , 2000 .

[34]  M. Mccarthy,et al.  Public School Law: Teachers' and Students' Rights , 1981 .

[35]  Stephen W. Raudenbush,et al.  Inequality of Access to Educational Resources: A National Report Card for Eighth-Grade Math , 1998 .

[36]  Fred I. Godshalk The Measurement of Writing Ability. , 1966 .

[37]  L. Hamilton Gender Differences on High School Science Achievement Tests: Do Format and Content Matter? , 1998 .

[38]  Anthony S. Bryk,et al.  Hierarchical Linear Models: Applications and Data Analysis Methods , 1992 .

[39]  Tony Bush,et al.  Educational Management: Redefining Theory, Policy and Practice , 1999 .

[40]  K. Seashore,et al.  Rethinking school improvement , 1999 .

[41]  H. Breland,et al.  A COMPARISON OF DIRECT AND INDIRECT ASSESSMENTS OF WRITING SKILL , 1979 .

[42]  R. Stiggins,et al.  Creating Writers: Linking Assessment and Writing Instruction , 1989 .

[43]  Merrilee K. Finley Teachers and Tracking in a Comprehensive High School. , 1984 .

[44]  P. Cuttance,et al.  Continuity of School Effects: A Longitudinal Analysis of Primary and Secondary School Effects on GCSE Performance , 1995 .

[45]  Guillermo Solano-Flores,et al.  Gender and Racial/Ethnic Differences on Performance Assessments in Science , 1997 .

[46]  L. Darling-Hammond Performance-Based Assessment and Educational Equity , 1994 .

[47]  Marjorie T. Davis,et al.  Teaching and Assessing Writing: Recent Advances in Understanding, Evaluating, and Improving Student Performance , 1988 .

[48]  Juliana V. Lombard An Empirical Comparison of a Direct and an Indirect Method of Assessing Writing Proficiency. , 1988 .

[49]  J. Oakes What Educational Indicators? The Case for Assessing the School Context , 1989 .

[50]  V. H. Meredith,et al.  Issues in Direct Writing Assessment: Problem Identification and Control. , 1984 .

[51]  J. Oakes,et al.  Keeping Track: How Schools Structure Inequality. , 1986 .

[52]  P. Paulus Gender and Racial/Ethnic Differences , 1988 .

[53]  Kenneth J. Rowe,et al.  Multilevel Modelling in School Effectiveness Research. , 1996 .

[54]  M. O’Connor,et al.  Changing assessments : alternative views of aptitude, achievement and instruction , 1994 .

[55]  W. Firestone,et al.  Performance-Based Assessment and Instructional Change: The Effects of Testing in Maine and Maryland , 1998 .