Validating score interpretations and uses

The argument-based approach to validation involves two steps; specification of the proposed interpretations and uses of the test scores as an interpretive argument, and the evaluation of the plausibility of the proposed interpretive argument. More ambitious interpretations and uses tend to involve an extended network of inferences and assumptions and require extensive evidence for their support. Simpler interpretations do not claim much, and therefore, may not require much evidential support. The evaluation of score based decisions generally requires an evaluation of the consequences of the decision rule. In any case, the claims that are being made need to be justified.

[1]  Lee J. Cronbach,et al.  Construct validation after thirty years. , 1989 .

[2]  Carol A. Chapelle,et al.  VALIDITY IN LANGUAGE ASSESSMENT , 1999, Annual Review of Applied Linguistics.

[3]  J. Loevinger.  Objective Tests as Instruments of Psychological Theory , 1957 .

[4]  Robert L. Ebel,et al.  Must all tests be valid , 1961 .

[5]  R. Guion.  Content Validity—The Source of My Discontent , 1977 .

[6]  Lee J. Cronbach,et al.  Psychological tests and personnel decisions , 1958 .

[7]  Carol A. Chapelle,et al.  Building a validity argument for the test of english as a foreign language , 2011 .

[8]  J. Anthony Blair.  Informal logic and reasoning in evaluation , 1995 .

[9]  A. Anastasi.  Evolving Concepts of Test Validation , 1986 .

[10]  M. Kane.  Criterion Bias in Examine Centered Standard Setting: Some Thought Experiments , 2005 .

[11]  Robert C. Pinto,et al.  Argument, Inference and Dialectic, Collected Papers on Informal Logic with an Introduction by Hans V. Hansen , 2001, Argumentation Library.

[12]  S. Messick.  The Interplay of Evidence and Consequences in the Validation of Performance Assessments , 1994 .

[13]  R. Guion,et al.  On Trinitarian doctrines of validity. , 1980 .

[14]  E. House.  Evaluating with Validity , 1980 .

[15]  Allan S. Cohen,et al.  Validating Measures of Performance , 2005 .

[16]  Carol A. Chapelle,et al.  Does an Argument-Based Approach to Validity Make a Difference? , 2010 .

[17]  S. Toulmin.  The uses of argument , 1960 .

[18]  Michael T. Kane,et al.  An argument-based approach to validity. , 1992 .

[19]  S. Messick.  Test validity and the ethics of assessment. , 1980 .

[20]  K. Ryan.  Assessment Validation in the Context of High‐Stakes Assessment , 2005 .

[21]  Allan S. Cohen,et al.  Threats to the Valid Use of Assessments , 1996 .

[22]  Donald B. Rubin,et al.  The Dependability of Behavioral Measurements: Theory of Generalizability for Scores and Profiles. , 1974 .

[23]  M. Kane.  Validating the Performance Standards Associated With Passing Scores , 1994 .

[24]  Lyle F. Bachman.  Building and Supporting a Case for Test Use , 2005 .

[25]  M. R. Novick,et al.  Statistical Theories of Mental Test Scores. , 1971 .

[26]  Lyle F. Bachman,et al.  Language Assessment in Practice , 2010 .

[27]  L. Cronbach,et al.  Construct validity in psychological tests. , 1955, Psychological bulletin.

[28]  Douglas Walton,et al.  Informal Logic: A Handbook for Critical Argumentation , 1989 .

[29]  L. Shepard.  Chapter 9: Evaluating Test Validity , 1993 .