The validity of direct versus semi- direct oral tests

The article reports the results of a study which examined the validity of two oral language tests - one direct and one semi-direct. While concurrent validity of the two types of tests (as obtained via correlations in a number of earlier studies) was high, a variety of qualitative analyses indicated that the two tests differed in a number of aspects. Differences were found in the elicitation tasks (in the number and types of functions and topics) and in the language samples obtained (in communicative strategies and in the discourse features). Conclusions are drawn regarding the need to validate tests from multiple perspectives.

[1]  Elana Shohamy,et al.  THE STABILITY OF ORAL PROFICIENCY ASSESSMENT ON THE ORAL INTERVIEW TESTING PROCEDURES , 1983 .

[2]  Denise E. Murray,et al.  The context of oral and written language: A framework for mode and medium switching , 1988, Language in Society.

[3]  E. Shohamy,et al.  Evaluation standards for the assessment of alternative testing methods: An application , 1986 .

[4]  Deborah Tannen,et al.  Analyzing discourse : text and talk , 1982 .

[5]  Leo Van Lier,et al.  Reeling, Writhing, Drawling, Stretching, and Fainting in Coils: Oral Proficiency Interviews as Conversation , 1989 .

[6]  Brian Street,et al.  Literacy Practices and Literacy Myths , 1988 .

[7]  Elana Shohamy,et al.  From Testing Research to Educational Policy: Introducing a New Comprehensive Test of Oral Proficiency. , 1986 .

[8]  Charles W. Stansfield.  The Development and Validation of the Portuguese Speaking Test. , 1990 .

[9]  Charles J. Fillmore,et al.  Ideal readers and real readers , 1983 .

[10]  E. Tarone.  On the Variability of Interlanguage Systems , 1983 .

[11]  Tina Raffaldini,et al.  The Use of Situation Tests as Measures of Communicative Ability , 1988, Studies in Second Language Acquisition.

[12]  Predicting Speaking Proficiency from Cloze Tests: Theoretical and Practical Considerations for Tests Substitution , 1982 .

[13]  W. Ong,et al.  Orality and literacy : the technologizing of the word , 1982 .

[14]  N. Hornberger.  Continua of Biliteracy , 1989 .

[15]  June K. Phillips.  The Language connection : from the classroom to the world , 1977 .

[16]  E. Shohamy.  A Proposed Framework for Testing the Oral Language of Second/Foreign Language Learners , 1988, Studies in Second Language Acquisition.

[17]  T. McNamara.  Item Response Theory and the validation of an ESP test for health professionals , 1990 .

[18]  Judith A. Langer.  The Construction of Meaning and the Assessment of Comprehension: An Analysis of Reader Performance on Standardized Test Items. , 1982 .

[19]  Authentic language tests: where from and where to? , 1985 .

[20]  John L. D. Clark.  Direct Testing of Speaking Proficiency: Theory and Application. , 1978 .

[21]  Rüdiger Grotjahn.  Test validation and cognitive psychology: some methodological considerations , 1986 .

[22]  John L. D. Clark.  Validation of a tape-mediated ACTFL/ILR-scale based test of Chinese speaking proficiency , 1988 .

[23]  S. Messick.  Evidence and Ethics in the Evaluation of Tests , 1981 .