Can placement tests inform instructional decisions?

Studies of placement tests are typically narrowly concerned with their validation as instruments for the efficient grouping of students. They rarely explore the assumption that placement test content can be related to classroom tasks and so inform instructional decisions. This study focuses on a trial version of the Global Placement Test (GPT), a measure of grammatical knowledge being developed for use in language schools worldwide. The central concern is the extent to which the GPT can enable schools to make valid inferences regarding mastery of the grammatical structures to be taught on the relevant courses and hence guide diagnostic intervention. In this study the GPT, together with another test specifically designed to measure knowledge of grammatical items expressing temporal relations in English, was administered to 1070 EFL (English as a Foreign Language) learners studying in the UK, Greece and Japan. The dimensionality of the GPT as a measurement scale was investigated by IRT and factor-analytic methods. The analysis suggests that item difficulty is affected more by item type than by any inherent linguistic difficulty of the element of grammatical competence being tested. The results cast doubt on whether quick grammar-based placement tests, which traditionally emphasize efficiency and practicality, can provide sufficient information on which to base diagnostic mediation or sequencing of instructional materials.

[1]  T. McNamara.  Measuring Second Language Performance , 1996 .

[2]  Michael Rube Redfield,et al.  Language Test Construction and Evaluation , 1997 .

[3]  R. Adams,et al.  An algorithmic approach to prescriptive assessment in English as a Second Language , 1988 .

[4]  Thom Hudson,et al.  Item response theory and the assumption of unidimensionality for language tests , 1985 .

[5]  Clive Perdue,et al.  Adult language acquisition : cross-linguistic perspectives , 1993 .

[6]  Kathleen Bardovi-Harlig,et al.  THE USE OF ADVERBIALS AND NATURAL ORDER IN THE DEVELOPMENT OF TEMPORAL EXPRESSION , 1992 .

[7]  M. Kobayashi.  Method effects on reading comprehension test performance: text organization and response format , 2002 .

[8]  Glenn Fulcher,et al.  Variable competence in second language acquisition: A problem for research methodology? , 1995 .

[9]  Marjorie Wesche.  A Comparative Study of Four Placement Instruments. , 1993 .

[10]  Siek-Toon Khoo,et al.  Quest: The Interactive Test Analysis System. , 1993 .

[11]  M. Sasaki.  A comparison of two methods for detecting differential I item functioning in an ESL placement test , 1991 .

[12]  이계순.  Syllabus Design의 방향 , 1987 .

[13]  Elana Shohamy,et al.  Validation of listening comprehension tests: the effect of text and question type , 1988 .

[14]  M. Reckase.  Unifactor Latent Trait Models Applied to Multifactor Tests: Results and Implications , 1979 .

[15]  Lyle F. Bachman,et al.  语言测试实践 = Language testing in practice , 1998 .

[16]  R. Robison,et al.  The Aspect Hypothesis Revisited: A Cross-Sectional Study of Tense and Aspect Marking in Interlanguage1 , 1995 .

[17]  Isaac I. Bejar,et al.  A PROCEDURE FOR INVESTIGATING THE UNIDIMENSIONALITY OF ACHIEVEMENT TESTS BASED ON ITEM PARAMETER ESTIMATES , 1980 .

[18]  G. Fulcher.  An English language placement test: issues in reliability and validity , 1997 .

[19]  John Soars,et al.  Headway pre-intermediate : teacher's book , 2001 .

[20]  Test review , 1988 .

[21]  C. Chapelle.  Construct definition and validity inquiry in SLA research , 1999 .

[22]  Andrew Harrison.  A Language Testing Handbook , 1983 .

[23]  Roger W. Andersen,et al.  Developmental sequences: the emergence of aspect marking in second language acquisition , 1991 .

[24]  Geoff Brindley,et al.  Interfaces between Second Language Acquisition and Language Testing Research: Describing language development? Rating scales and SLA , 1999 .

[25]  Liz Hamp-Lyons.  Applying the partial credit method of Rasch analysis: language testing and accountability , 1989 .

[26]  Jan-Eric Gustafsson,et al.  The Rasch Model for Dichotomous Items: Theory, Applications and a Computer Program. No. 63. , 1977 .

[27]  F. Lord.  Applications of Item Response Theory To Practical Testing Problems , 1980 .

[28]  R. Hambleton.  Principles and selected applications of item response theory. , 1989 .

[29]  W. Klein,et al.  The acquisition of temporality , 1993 .

[30]  Kathleen Bardovi-Harlig,et al.  The Role of Lexical Aspect in the Acquisition of Tense and Aspect , 1995 .

[31]  Charlene J. Sato.  The syntax of conversation in interlanguage development , 1990 .

[32]  Grant Henning,et al.  Linguistic and cultural bias in language proficiency tests , 1985 .

[33]  Brian E. Clauser,et al.  Using Statistical Procedures to Identify Differentially Functioning Test Items , 2005 .

[34]  Lyle F. Bachman.  语言测试要略 = Fundamental considerations in language testing , 1990 .

[35]  Evon M. O. Abu-Taieh,et al.  Comparative Study , 2020, Definitions.

[36]  James Dean Brown,et al.  Improving ESL Placement Tests Using Two Perspectives , 1989 .

[37]  Elaine Tarone,et al.  Interfaces between Second Language Acquisition and Language Testing Research: Research on interlanguage variation: Implications for language testing , 1999 .

[38]  A. Hughes.  Testing for language teachers , 1989 .

[39]  Susan Braidi.  The acquisition of second-language syntax , 2020 .

[40]  J. Charles Alderson,et al.  Evaluating a placement test , 1994 .