Constructing an Acquisition-Based Procedure for Second Language Assessment

This article reports on a first attempt to develop and test run an observation procedure for assessing the syntactic and morphological development of adult learners of English as a second language (ESL) as evidenced in spontaneous speech production. The procedure is based on the profile analysis approach, which was first developed by Crystal, Fletcher, and Gorman (1976) for the assessment of impaired speech (English) and later adapted to the assessment of second language development (German) by Clahsen (1985). The theoretical basis of the procedure is the multidimensional model of second language acquisition (SLA) developed by Meisel, Clahsen, and Pienemann (1981) and extended to ESL acquisition by Pienemann and Johnston (1987a). According to the model, invariant developmental stages in the acquisition of certain syntactic and morphological elements in German and English can be predicted and explained in terms of hierarchically ordered speech processing constraints. In order to assess the developmental stage of ESL learners, an observation form was drawn up, incorporating a selection of morphosyntactic features whose presence or absence in a taped sample of natural speech was monitored by assessors. The ratings made by the assessors were then compared to those assigned through a detailed linguistic analysis to test the feasibility of using a “shorthand” version of a profile analysis. Analysis of the outcomes of the test run revealed significant correlations between the assessments and the linguistic analysis. But some variation was found in the assessors' ability to apply the assessment criteria, and the extent of agreement between the assessors' observations and the linguistic analysis was less than would be acceptable in the given theoretical framework. However, the source of these problems was identified through the first test run and suggestions were made for further refining the procedure to improve its accuracy.

[1]  Jürgen M. Meisel,et al.  Word order and case marking in early child language. Evidence from simultaneous acquisition of two first languages: French and German , 1986 .

[2]  David Crystal,et al.  Profiling Linguistic Disability , 1982 .

[3]  Manfred Pienemann,et al.  Is Language Teachable? Psycholinguistic Experiments and Hypotheses , 1989 .

[4]  Paul Fletcher,et al.  The grammatical analysis of language disability , 1976 .

[5]  Manfred Pienemann,et al.  An acquisition based procedure for second language assessment (ESL) , 1986 .

[6]  Sascha W. Felix.  Second language development : trends and issues , 1980 .

[7]  Manfred Pienemann,et al.  Determining the influence of instruction on L2 speech processing , 1987 .

[8]  Geoff Brindley,et al.  The use of second language learning research in E.S.L. proficiency assessment , 1982 .

[9]  R. Andersen.  Pidginization and Creolization as Language Acquisition. , 1983 .

[10]  Michael H. Long.  Does Second Language Instruction Make a Difference? A Review of Research , 1983 .

[11]  Lyle F. Bachman,et al.  The Measurement of Foreign/Second Language Proficiency , 1987 .

[12]  Jürgen M. Meisel,et al.  Deutsch als Zweitsprache , 1983 .

[13]  Carol W. Pfaff,et al.  First and second language acquisition processes , 1987 .

[14]  J. Farrell,et al.  Dreiser's Tragedy : The Distortion of American Values , 1976 .

[15]  Thorn Huebner,et al.  SYSTEM AND VARIABILITY IN INTERLANGUAGE SYNTAX , 1985 .

[16]  Jürgen M. Meisel,et al.  On determining developmental stages in natural second language acquisition , 1981, Studies in Second Language Acquisition.

[17]  Manfred Pienemann,et al.  Der Zweitspracherwerb ausländischer Arbeiterkinder , 1981 .

[18]  James P. Lantolf,et al.  Oral‐Proficiency Testing: A Critical Analysis , 1985 .

[19]  Kyle Perkins,et al.  Research in Language Testing , 1980 .

[20]  David Barnwell.  Oral Proficiency Testing in the United States. , 1987 .

[21]  W. Labov.  The social stratification of English in New York City , 1969 .

[22]  Jürgen M. Meisel.  Transfer as a second-language strategy , 1983 .

[23]  Charles James Nice Bailey.  Variation and linguistic theory , 1973 .

[24]  D. Ingram,et al.  Developing a Language Programme , 1982 .

[25]  A. Woods,et al.  Statistics in Language Studies , 1986 .

[26]  Sally Sieloff Magnan,et al.  Teaching for Proficiency, the Organizing Principle , 1985 .

[27]  David Nunan,et al.  Applying second language acquisition research , 1987 .

[28]  Geoff Brindley,et al.  The assessment of second language proficiency : issues and approaches , 1986 .