Development and validation of the Spanish-English Language Proficiency Scale (SELPS).

PURPOSE This study examined the development and validation of a criterion-referenced Spanish-English Language Proficiency Scale (SELPS) that was designed to assess the oral language skills of sequential bilingual children ages 4-8. This article reports results for the English proficiency portion of the scale. METHOD The SELPS assesses syntactic complexity, grammatical accuracy, verbal fluency, and lexical diversity based on 2 story retell tasks. In Study 1, 40 children were given 2 story retell tasks to evaluate the reliability of parallel forms. In Study 2, 76 children participated in the validation of the scale against language sample measures and teacher ratings of language proficiency. RESULTS Study 1 indicated no significant differences between the SELPS scores on the 2 stories. Study 2 indicated that the SELPS scores correlated significantly with their counterpart language sample measures. Correlations between the SELPS and teacher ratings were moderate. CONCLUSIONS The 2 story retells elicited comparable SELPS scores, providing a valuable tool for test-retest conditions in the assessment of language proficiency. Correlations between the SELPS scores and external variables indicated that these measures assessed the same language skills. Results provided empirical evidence regarding the validity of inferences about language proficiency based on the SELPS score.

[1]  J. P. Morgan,et al.  Design and Analysis: A Researcher's Handbook , 2005, Technometrics.

[2]  Mercer Mayer,et al.  Frog on His Own , 1973 .

[3]  B. Goldstein.  Bilingual Language Development and Disorders in Spanish-English Speakers. Second Edition. , 2012 .

[4]  E. Pen A,et al.  Narrative Discourse in Bilingual Children: Language and Task Effects. , 2004, Language, speech, and hearing services in schools.

[5]  U. Nettelbladt,et al.  Similarities between SLI and L2 children. Evidence from the acquisition of Swedish word order , 1996 .

[6]  Manfred Pienemann,et al.  Language Processing and Second Language Development: Processability theory , 1998 .

[7]  Patton O. Tabors.  One Child, Two Languages: A Guide for Preschool Educators of Children Learning English As a Second Language , 1997 .

[8]  Noriko Iwashita,et al.  Features of oral proficiency in task performance by EFL and JFL learners , 2010 .

[9]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[10]  L. Bedore,et al.  The measure matters: Language dominance profiles across measures in Spanish–English bilingual children* , 2012, Bilingualism: Language and Cognition.

[11]  Alex Housen,et al.  Complexity, accuracy and fluency in second language acquisition , 2009 .

[12]  M. Restrepo,et al.  Article use in Spanish-speaking children with Specific Language Impairment , 2001, Journal of Child Language.

[13]  R. Solórzano.  High Stakes Testing: Issues, Implications, and Remedies for English Language Learners , 2008 .

[14]  G. Pallotti.  CAF: Defining, Refining and Differentiating Constructs , 2009 .

[15]  V. Gutiérrez-Clellen,et al.  Understanding child bilingual acquisition using parent and teacher reports , 2003, Applied Psycholinguistics.

[16]  Lyle F. Bachman,et al.  The Construct Validation of Some Components of Communicative Proficiency , 1982 .

[17]  T. McNamara,et al.  Assessed Levels of Second Language Speaking Proficiency: How Distinct? , 2007 .

[18]  Ann M. Peters,et al.  The Units of Language Acquisition , 1983 .

[19]  Mercer Mayer,et al.  A Boy, a Dog, a Frog, and a Friend , 1967 .

[20]  Judit Kormos,et al.  Exploring measures and perceptions of fluency in the speech of second language learners. , 2004 .

[21]  Jeff MacSwan,et al.  The Threshold Hypothesis, Semilingualism, and Other Contributions to a Deficit View of Linguistic Minorities , 2000 .

[22]  I. Stockman,et al.  Children's story retelling under different modality and task conditions: implications for standardizing language sampling procedures. , 2003, American journal of speech-language pathology.

[23]  Brian North,et al.  The development of a common framework scale of language proficiency , 2000 .

[24]  D. Eignor.  The standards for educational and psychological testing. , 2013 .

[25]  A. Riazantseva,et al.  SECOND LANGUAGE PROFICIENCY AND PAUSING A Study of Russian Speakers of English , 2001, Studies in Second Language Acquisition.

[26]  S. Ervin-Tripp.  Is Second Language Learning Like the First , 1974 .

[27]  E. Hatch.  Second language acquisition : a book of readings , 1979 .

[28]  M. Crago,et al.  Tense and temporality: a comparison between children learning a second language and children with SLI. , 2000, Journal of speech, language, and hearing research : JSLHR.

[29]  Koutsompou Violetta-Irene.  Second Language Acquisition: A Case Study , 2014 .

[30]  Brian A. Goldstein,et al.  Bilingual Language Development & Disorders in Spanish-English Speakers , 2004 .

[31]  J. Paradis.  The interface between bilingual development and specific language impairment , 2010, Applied Psycholinguistics.

[32]  R. Gillam,et al.  Measures of Language Development in Fictional Narratives of Latino Children. , 2003, Language, speech, and hearing services in schools.

[33]  A. Iglesias,et al.  Narrative Transcription Accuracy and Reliability in Two Languages , 2008 .

[34]  Lyle F. Bachman.  语言测试要略 = Fundamental considerations in language testing , 1990 .

[35]  Melinda Martin‐Beltrán.  Positioning proficiency: How students and teachers (de)construct language proficiency at school , 2010 .

[36]  Manfred Pienemann,et al.  Language processing and second language development , 1998 .

[37]  B. Goldstein.  Clinical Implications of Research on Language Development and Disorders in Bilingual Children , 2006 .

[38]  P. Schwanenflugel,et al.  RELATIONSHIP BETWEEN LEXICAL COMPETENCE AND LANGUAGE PROFICIENCY: Variable Sensitivity , 2005, Studies in Second Language Acquisition.

[39]  Wolfgang Kühlwein,et al.  Second Language Acquisition. A Book of Readings , 1979 .

[40]  Ellen Bialystok,et al.  Bilingualism in development: Language, literacy, and cognition. , 2001 .

[41]  L. Bedore,et al.  Parent and teacher rating of bilingual language proficiency and language development concerns , 2011, International journal of bilingual education and bilingualism.

[42]  Alija Kulenović,et al.  Standards for Educational and Psychological Testing , 1999 .

[43]  David J. Francis,et al.  Oral Language and Reading in Bilingual Children , 2006 .

[44]  T. Marinis,et al.  Differential effects of internal and external factors on the development of vocabulary, tense morphology and morpho-syntax in successive bilingual children , 2011 .

[45]  Z. Šidák.  Rectangular Confidence Regions for the Means of Multivariate Normal Distributions , 1967 .

[46]  R. Glaser,et al.  Knowing What Students Know: The Science and Design of Educational Assessment , 2001 .

[47]  T. McNamara.  Measuring Second Language Performance , 1996 .

[48]  V. Gutiérrez-Clellen,et al.  Using language sampling in clinical assessments with bilingual children: challenges and future directions. , 2009, Seminars in speech and language.

[49]  James Cummins,et al.  The Influence of Bilingualism on Cognitive Growth : Synthesis of Research Yindings and Explanatory Hypotheses , 2007 .

[50]  V. Gutiérrez-Clellen.  Narratives in Two Languages: Assessing Performance of Bilingual Children , 2002 .

[51]  K. W. Hunt.  Syntactic maturity in schoolchildren and adults. , 1970, Monographs of the Society for Research in Child Development.

[52]  G. Glass,et al.  Do Some School-Age Children Have No Language? Some Problems of Construct Validity in the Pre-LAS Español , 2002 .

[53]  L. Bedore,et al.  Assessment of Bilingual Children for Identification of Language Impairment: Current Findings and Implications for Practice , 2008 .

[54]  Lisa C. Pray.  How Well Do Commonly Used Language Instruments Measure English Oral-Language Proficiency? , 2005 .

[55]  Michael P. Klentschy,et al.  Helping English Learners Increase Achievement Through Inquiry-Based Science Instruction , 2002 .

[56]  J. Norris,et al.  Towards an Organic Approach to Investigating CAF in Instructed SLA: The Case of Complexity , 2009 .

[57]  S. Pickert,et al.  Story Retelling: An Informal Technique for Evaluating Children's Language. , 1978 .

[58]  A. Kaufman,et al.  Kaufman Assessment Battery for Children, Second Edition , 2014 .

[59]  M. Saville‐Troike.  Dilingual discourse: the negotiation of meaning without a common code , 1987 .

[60]  M. Swain,et al.  THEORETICAL BASES OF COMMUNICATIVE APPROACHES TO SECOND LANGUAGE TEACHING AND TESTING , 1980 .

[61]  Jason L. Huang,et al.  The work of ideology: examining class, language use, and attitudes among Moroccan university students , 2014 .

[62]  Joanna S. Gorin,et al.  Improving Construct Validity with Cognitive Psychology Principles. , 2001 .

[63]  Geoff Brindley,et al.  Interfaces between Second Language Acquisition and Language Testing Research: Describing language development? Rating scales and SLA , 1999 .

[64]  John Heilmann,et al.  Properties of the narrative scoring scheme using narrative retells in young school-age children. , 2010, American journal of speech-language pathology.

[65]  M. Restrepo,et al.  Identifiers of predominantly Spanish-speaking children with language impairment. , 1998, Journal of speech, language, and hearing research : JSLHR.

[66]  Jacob Cohen,et al.  Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit. , 1968 .

[67]  Noriko Iwashita,et al.  Syntactic Complexity Measures and Their Relation to Oral Proficiency in Japanese as a Foreign Language , 2006 .

[68]  Becky H. Huang,et al.  Do current English language development/proficiency standards reflect the English needed for success in school? , 2011 .

[69]  E. Skarakis-Doyle,et al.  Assessing Story Comprehension in Preschool Children , 2008 .

[70]  Peter Skehan,et al.  Modelling Second Language Performance: Integrating Complexity, Accuracy, Fluency, and Lexis , 2009 .

[71]  Jacob Cohen,et al.  The Equivalence of Weighted Kappa and the Intraclass Correlation Coefficient as Measures of Reliability , 1973 .

[72]  William J. Hussar,et al.  The Condition of Education 2012. NCES 2012-045. , 2012 .

[73]  J. Macswan,et al.  How Language Proficiency Tests Mislead Us about Ability: Implications for English Language Learner Placement in Special Education , 2006, Teachers College Record: The Voice of Scholarship in Education.

[74]  Joanna S. Gorin.  Test Design with Cognition in Mind , 2007 .

[75]  Use of Mazes in the Narrative Language Samples of Bilingual and Monolingual 1 4to 7-year old Children , 2005 .

[76]  P. Robinson,et al.  Investigating Second Language Task Complexity , 1995 .

[77]  T. Klee.  Developmental and diagnostic characteristics of quantitative measures of children's language production , 1992 .

[78]  M. Crago,et al.  Lexical acquisition over time in minority first language children learning English as a second language , 2008, Applied Psycholinguistics.

[79]  Karl J. Krahnke.  The Natural Approach: Language Acquisition in the Classroom , 1985 .

[80]  James Cummins.  The Influence of Bilingualism on Cognitive Growth: A Synthesis of Research Findings and Explanatory Hypotheses. Working Papers on Bilingualism, No. 9. , 1976 .