Validation of a web-based ESL test

The web offers new opportunities to realize some of the current ideals for interactive language assessment by providing learners information about their language ability at their convenience. If such tests are to be trusted to provide learners with information that might help to improve their language ability, the tests need to undergo validation processes, but validation theory does not offer specific guidance about what should be included in a validity argument. Conventional wisdom suggests that low-stakes tests require less rigorous validation than high-stakes tests, but what are the factors that affect decisions about the validation process for either? Attempting to make these contributing factors explicit, this article examines the ways in which the purpose of a low-stakes web-based ESL (English as a second language) test guided its design and the validation process. The validity argument resulting from the first phase of the validation process is illustrated.

[1]  L. Shepard.  Chapter 9: Evaluating Test Validity , 1993 .

[2]  Tom M Grundner.  Readability revisited. , 1982, IRB.

[3]  Susan Conrad.  Investigating academic texts with corpus-based techniques: An example from biology☆ , 1996 .

[4]  Douglas Biber,et al.  Variation across speech and writing: Methodology , 1988 .

[5]  J. B. Strother,et al.  The effect of syntactic simplification on reading EST texts as L1 and L2 , 1990 .

[6]  Ronald P. Cody,et al.  Applied Statistics and the SAS Programming Language (5th Edition) , 2005 .

[7]  J. Charles Alderson,et al.  TOEFL preparation courses: a study of washback , 1996 .

[8]  C. Chapelle.  Are C-tests valid measures for L2 vocabulary research? , 1994 .

[9]  Lorrie A. Shepard,et al.  Chapter 9: Evaluating Test Validity , 1993 .

[10]  Richard C. Anderson,et al.  Conceptual and empirical bases of readability formulas , 1986 .

[11]  Bernard Spolsky,et al.  Concise encyclopedia of educational linguistics , 1999 .

[12]  Lyle F. Bachman,et al.  语言测试实践 = Language testing in practice , 1998 .

[13]  J. Charles Alderson,et al.  Does Washback Exist , 1993 .

[14]  飯島 周.  「会話の文法」に関する一考察 : Longman Grammar of Spoken and Written Englishの場合 , 1999 .

[15]  Seán Devitt,et al.  Language Processing and Second Language Development: Processability Theory , 2000 .

[16]  T. McNamara.  Measuring Second Language Performance , 1996 .

[17]  John Read,et al.  Assessing Vocabulary by John Read , 2000 .

[18]  Donald Shankweilert,et al.  SYNTACTIC COMPLEXITY AND READING ACQUISITION , 1986 .

[19]  Lyle F. Bachman.  语言测试要略 = Fundamental considerations in language testing , 1990 .

[20]  Carol A. Chapelle,et al.  VALIDITY IN LANGUAGE ASSESSMENT , 1999, Annual Review of Applied Linguistics.

[21]  E. Atkins.  Power and Criticism: Poststructural Investigations in Education* , 1990 .

[22]  Carol A. Chapelle,et al.  A framework for second language vocabulary assessment , 2001 .

[23]  Paula Garcia,et al.  Combining Multiple Regression and CART to Understand Difficulty in Second Language Reading and Listening Comprehension Test Items , 2001 .