Development and Validation of a Diagnostic Grammar Test for Japanese Learners of English

This article reports on the development and validation of the English Diagnostic Test of Grammar (EDiT Grammar) for Japanese learners of English. From among the many aspects of grammar, this test focuses on the knowledge of basic English noun phrases (NPs), especially their internal structures, because previous research has indicated the difficulty faced by Japanese learners of English in acquiring these phrases. The results of the examination of the pilot and revised tests suggest that the revised test is generally appropriate in terms of item discrimination, distractor function, reliability, and the difficulty of NP groups. Overall, the EDiT Grammar provided favorable evidence for the validity in interpreting the test scores in the case of a fairly low-stakes diagnostic test.

[1]  Megumi Kimura,et al.  A Survey on Japanese Junior High School Students' Knowledge of English Phrase Structures : Identifying Time-gaps between Instruction and Acquisition , 2006 .

[2]  Steven M. Downing,et al.  Selected-Response Item Formats in Test Development , 2006 .

[3]  Yoshihiro Terada.  Word Order Anagram Test and Reading Comprehension in EFL : What Type of Word Order Awareness Should Be Focused on in Teaching? , 2009 .

[4]  Anthony Green,et al.  Can placement tests inform instructional decisions? , 2004 .

[5]  Seán Devitt,et al.  Language Processing and Second Language Development: Processability Theory , 2000 .

[6]  Yasuyo Sawaki,et al.  Cognitive Diagnosis and Q-Matrices in Language Assessment , 2009 .

[7]  K. Hashimoto,et al.  Comprehension of Post-Modification Structures by Japanese Learners of English : An Analysis by Detailed Reading Time , 2007 .

[8]  Alan Davies,et al.  語言測試詞典=Dictionary of language testing , 1999 .

[9]  Lyle F. Bachman.  Statistical analyses for language assessment , 2004 .

[10]  Rex B. Kline,et al.  Beyond Significance Testing: Reforming Data Analysis Methods in Behavioral Research , 2004 .

[11]  Robert L. Brennan,et al.  NCME instructional module: Generalizability theory. , 1992 .

[12]  James E. Purpura,et al.  Assessing Grammar , 2004 .

[13]  James E. Purpura,et al.  Assessing Grammar: Assessing Grammar , 2004 .

[14]  J. Charles Alderson,et al.  Diagnosing Foreign Language Proficiency: The Interface between Learning and Assessment , 2005 .

[15]  Rod Ellis,et al.  The Study of Second Language Acquisition , 1994 .

[16]  J. Laborda,et al.  Building a Validity Argument for the Test of English as a Foreign Language , 2009 .

[17]  Christine E. Nuttall,et al.  Teaching reading skills in a foreign language , 1982 .