Unlabeling the Disabled: A Perspective on Flagging Scores From Accommodated Test Administrations

Accommodations to standard test administrations are granted on many tests for students who have one or more disabling conditions. In some instances, students’ scores from these nonstandard administrations are “flagged” to caution those who interpret the test score that the test was not administered under typical conditions. The practice of flagging such test scores is contentious. Some argue that it essentially informs others that a student has a disability and creates the opportunity for bias against the student. Others argue that such scores must be flagged to be fair to those who took the test under standard conditions and to promote valid test score interpretations. This article reviews the psychometric issues regarding the flagging issue and discusses the guidance provided by the Standards for Educational and Psychological Testing. Research in this area related to college admissions testing is also reviewed and suggestions for avoiding the flagging issue in the future are provided. This review lends support to the recent decisions by several testing agencies to discontinue flagging practices.

[1]  Stephen G. Sireci,et al.  Validity Issues in Test Speededness , 2007 .

[2]  Martha Thurlow,et al.  A Summary of Research on the Effects of Test Accommodations: 2002 through 2004. Technical Report 45. , 2006 .

[3]  Preston C. Green,et al.  Legal and Psychometric Criteria for Evaluating Teacher Certification Tests. , 2005 .

[4]  S. Sireci,et al.  Validity Issues in Computer-Based Testing , 2005 .

[5]  Brent Bridgeman,et al.  Impact of Fewer Questions per Section on SAT I Scores , 2004 .

[6]  Brent Bridgeman,et al.  Effects of Differentially Time-Consuming Tests on Computer-Adaptive Test Scores , 2004 .

[7]  M. Freedman.  Disabling the SAT: How the College Board Is Undermining Its Premier Test , 2003 .

[8]  Joseph B. Berger,et al.  Recent and Anticipated Changes in Postsecondary Admissions: A Survey of New England Colleges and Universities , 2003 .

[9]  Martha Thurlow,et al.  A Summary of Research on the Effects of Test Accommodations: 1999 through 2001 (NCEO Technical Report) , 2002 .

[10]  Wayne J. Camara,et al.  Predictive Validity of SAT ® I: Reasoning Test for Test-Takers with Learning Disabilities and Extended Time Accommodations , 2002 .

[11]  Sandra J. Thompson,et al.  Universally Designed Assessments: Better Tests for Everyone! NCEO Policy Directions. , 2002 .

[12]  James M. Royer,et al.  Testing Accommodations for Examinees With Disabilities: A Review of Psychometric, Legal, and Social Policy Issues , 2001 .

[13]  Brent Bridgeman,et al.  Predictions of Freshman Grade-Point Average from the Revised and Recentered SAT[R] I: Reasoning Test. College Board Research Report. , 2000 .

[14]  P. David Pearson,et al.  Synthesizing the Effects of Test Accommodations for Special Education and Limited English Proficient Students. , 1999 .

[15]  Robert L. Ziomek,et al.  ACT Assessment Score Gains of Special-Tested Students Who Tested at Least Twice. , 1998 .

[16]  Kurt F. Geisinger,et al.  Psychometric issues in Testing Students With Disabilities , 1994 .

[17]  S. E. Phillips.  High-Stakes Testing Accommodations: Validity Versus Disabled Rights , 1994 .

[18]  S. Messick.  The Interplay of Evidence and Consequences in the Validation of Performance Assessments , 1994 .

[19]  Linda F. Wightman.  Test Takers with Disabilities: A Summary of Data from Special Administrations of the LSAT. LSAC Research Report Series. , 1993 .

[20]  Lorrie A. Shepard,et al.  Chapter 9: Evaluating Test Validity , 1993 .

[21]  Michael T. Kane,et al.  An argument-based approach to validity. , 1992 .

[22]  P. Lachenbruch.  Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[23]  Bruce Kaplan,et al.  THE PREDICTIVE VALIDITY OF THE SCHOLASTIC APTITUDE TEST FOR DISABLED STUDENTS , 1986 .

[24]  H. Gulliksen.  Theory of mental tests , 1952 .

[25]  J. P. Guilford,et al.  New Standards For Test Evaluation , 1946 .

[26]  T. L. Kelley,et al.  The Reliability of Test Scores , 1921 .

[27]  Alija Kulenović,et al.  Standards for Educational and Psychological Testing , 1999 .

[28]  M. Freedman.  Disabling the SAT. , 2003 .

[29]  Brian Rothschild,et al.  Effects of Extended Time on the SAT I: Reasoning Test Score Growth for Students with Learning Disabilities , 1998 .

[30]  L. Shepard.  Chapter 9: Evaluating Test Validity , 1993 .

[31]  R. Linn.  Educational measurement, 3rd ed. , 1989 .

[32]  Warren W. Willingham,et al.  Testing handicapped people , 1988 .

[33]  S. Whitely.  Construct validity: Construct representation versus nomothetic span. , 1983 .

[34]  S. Embretson.  CONSTRUCT VALIDITY: CONSTRUCT REPRESENTATION VERSUS NOMOTHETIC SPAN , 1983 .

[35]  L. Cronbach,et al.  Construct validity in psychological tests. , 1955, Psychological bulletin.

[36]  J. G. Jenkins.  Validity for what , 1946 .