The Validity Argument of a Web-Based Spanish Listening Exam: Test Usefulness Evaluation

This study describes research used for supporting a validity argument for a new Spanish Listening Exam, whose scores are intended to place examinees into appropriate levels of university Spanish classes. This study contributes to the field of argument-based approaches to language assessment by implementing Bachman's (2005) assessment use argument framework. The validity argument is supported by research providing backing for three warrants pertaining to the quality of inference that can be made on the basis of examinees' performance. These warrants, based on three qualities of test usefulness (Bachman & Palmer, 1996), guided test development and research toward a placement test with the purpose of grouping students according to their levels of language ability within the framework of the communicative approach for learning Spanish.

[1]  Susy Macqueen,et al.  Validity , 1973, Just Algorithms.

[2]  M. Kane.  The Argument-Based Approach to Validation , 1990 .

[3]  R. Almond,et al.  Focus Article: On the Structure of Educational Assessments , 2003 .

[4]  Cyril J. Weir,et al.  Language Testing and Validation , 2005 .

[5]  M. Kane.  Current Concerns in Validity Theory , 2001 .

[6]  Michael T. Kane,et al.  Certification Testing as an Illustration of Argument-Based Validation , 2004 .

[7]  Carol A. Chapelle,et al.  test Score Interpretation And Use , 2011 .

[8]  Lyle F. Bachman.  Building and Supporting a Case for Test Use , 2005 .

[9]  Carol A. Chapelle,et al.  Building a validity argument for the test of english as a foreign language , 2011 .

[10]  Stephen E. Toulmin,et al.  The Uses of Argument: Preface to the Updated Edition , 2003 .

[11]  Tim McNamara,et al.  Validity in Language Testing: The Challenge of Sam Messick's Legacy , 2006 .

[12]  G. Buck.  Assessing Listening , 2001 .

[13]  Michael T. Kane,et al.  Validating High-Stakes Testing Programs , 2005 .

[14]  Tim McNamara,et al.  Test dimensionality: IRT analysis of an ESP listening test1 , 1991 .

[15]  Maria Cristina,et al.  The development of a Web-based Spanish listening placement exam , 2007 .

[16]  Allan S. Cohen,et al.  Validating Measures of Performance , 2005 .

[17]  S. Toulmin.  The uses of argument , 1960 .

[18]  Michael T. Kane,et al.  An argument-based approach to validity. , 1992 .

[19]  Lyle F. Bachman,et al.  语言测试实践 = Language testing in practice , 1998 .