Factor structure of the TOEFL Internet-based test

This construct validation study investigated the factor structure of the Test of English as a Foreign Language™ Internet-based test (TOEFL® iBT). An item-level confirmatory factor analysis was conducted for a test form completed by participants in a field study. A higher-order factor model was identified, with a higher-order general factor (ESL/EFL ability) and four first-order factors for reading, listening, speaking and writing. Integrated Speaking and Writing tasks, which require language processing in multiple modalities, defined the target modalities (speaking and writing). These results broadly supported the current practice of reporting a total score and four scores corresponding to the modalities for the test, as well as the test design that permits the integrated tasks to contribute only to the scores of the target modalities.

[1]  Lyle F. Bachman,et al.  The Construct Validation of Some Components of Communicative Proficiency , 1982 .

[2]  M. Sasaki.  Second Language Proficiency, Foreign Language Aptitude, and Intelligence: Quantitative and Qualitative Analyses , 1996 .

[3]  J. S. Long,et al.  Testing Structural Equation Models , 1993 .

[4]  G. A. Marcoulides,et al.  A First Course in Structural Equation Modeling , 2000 .

[5]  Spencer S. Swinton,et al.  Factor Analysis of the Test of English as a Foreign Language for Several Language Groups. TOEFL Research Reports, 6. , 1980 .

[6]  Lyle F. Bachman,et al.  语言测试实践 = Language testing in practice , 1998 .

[7]  David Graddol,et al.  The Future of English? : A guide to forecasting the popularity of the English language in the 21st century , 1997 .

[8]  Cyril J. Weir,et al.  Reading in a Second Language: Process, Product and Practice , 1999 .

[9]  Karl G. Jöreskog,et al.  Lisrel 8: User's Reference Guide , 1997 .

[10]  Gordon A. Hale.  Multiple-Choice Cloze Items and the Test of English as a Foreign Language. TOEFL Research Reports 26. , 1988 .

[11]  Albert Satorra,et al.  Robustness issues in structural equation modeling: a review of recent developments , 1990 .

[12]  Yasukata Yano,et al.  World Englishes in 2000 and Beyond. , 2001 .

[13]  John W. Oller,et al.  Two Mutually Exclusive Hypotheses about Second Language Ability: Factor Analytic Studies of a Variety of Language Tests. , 1976 .

[14]  L. J. Stricker,et al.  Factor Structure of the LanguEdge™ Test across Language Groups. TOEFL® Monograph Series. MS-32. ETS RR-05-12. , 2005 .

[15]  Albert Satorra,et al.  A scaled difference chi-square test statistic for moment structure analysis , 1999 .

[16]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[17]  D. Rindskopf,et al.  Some Theory and Applications of Confirmatory Second-Order Factor Analysis. , 1988, Multivariate behavioral research.

[18]  Lyle F. Bachman,et al.  THE CONSTRUCT VALIDATION OF THE FSI ORAL INTERVIEW1 , 1981 .

[19]  J. Laborda,et al.  Building a Validity Argument for the Test of English as a Foreign Language , 2009 .

[20]  D. Thissen,et al.  Factor analysis for items scored in two categories , 2000 .

[21]  M. Browne,et al.  Alternative Ways of Assessing Model Fit , 1992 .

[22]  S. West,et al.  A Comparison of Bifactor and Second-Order Models of Quality of Life , 2006, Multivariate behavioral research.

[23]  Bernard Spolsky,et al.  An Investigation into the Comparability of Two Tests of English as a Foreign Language , 1995 .

[24]  Antony John Kunnan,et al.  Test Taker Characteristics and Test Performance: A Structural Modeling Approach , 1996 .

[25]  Cyril J. Weir,et al.  Communicative Language Testing , 1991 .

[26]  William Grabe,et al.  Communicative language proficiency : definition and implications for TOEFL 2000 , 1997 .

[27]  A. Boomsma.  Reporting Analyses of Covariance Structures , 2000 .

[28]  J R Nesselroade,et al.  Reporting structural equation modeling results in Psychology and Aging: some proposed guidelines. , 1991, Psychology and aging.

[29]  W. Manning.  DEVELOPMENT OF CLOZE-ELIDE TESTS OF ENGLISH AS A SECOND LANGUAGE , 1987 .

[30]  D. Rock,et al.  CONFIRMATORY FACTOR ANALYSIS OF THE TEST OF ENGLISH AS A FOREIGN LANGUAGE , 1982 .

[31]  Marjorie Bingham Wesche,et al.  Second language performance testing: the Ontario Test of ESL as an example , 1987 .

[32]  P. Lachenbruch.  Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[33]  Sang-Keun Shin,et al.  Did they take the same test? Examinee language proficiency and the structure of language tests , 2005 .

[34]  P. Bruthiaux.  Squaring the circles: issues in modeling English worldwide , 2003 .

[35]  A. Panter,et al.  Writing about structural equation models. , 1995 .

[36]  Yasuyo Sawaki,et al.  FACTOR STRUCTURE OF THE TOEFL® INTERNET-BASED TEST (IBT): EXPLORATION IN A FIELD TRIAL SAMPLE , 2008 .

[37]  R. Bagozzi,et al.  On the evaluation of structural equation models , 1988 .

[38]  Rex B. Kline,et al.  Principles and Practice of Structural Equation Modeling , 1998 .

[39]  Lyle F. Bachman.  Building and Supporting a Case for Test Use , 2005 .

[40]  Dianne M. Finkelstein,et al.  A Beginner's Guide to Structural Equation Modeling , 2005, Technometrics.