Sample size effects on temporal reliability of language sample measures of preschool children.

The present study examined the temporal reliability of four quantitative measurements of operationally defined linguistic behaviors observed in a naturalistic setting. The measures of language production were computed using the Systematic Analysis of Language Transcripts (SALT) software from two 20-minute language samples obtained 3 to 14 days apart for each of 20 preschool-aged children. Samples were edited to different sizes based either on duration (12 or 20 minutes) or on limits of the total number of complete and intelligible utterances (from 25 to 175 in increments of 25). Inadequate reliability was found for the language sample measure, total number of words; hence, the validity of this measure is questionable. In contrast, very high temporal reliability coefficients (r > .92) were obtained for the language sample measures of number of different words, mean length of utterance in morphemes, and mean sentence length in morphemes when derived from a large number (> or = 175) of complete and intelligible utterances. The temporal reliability of these measures reached acceptable levels, not only for research purposes, but for diagnostic purposes as well.

[1]  K. Moll,et al.  Reliability of Language Measures and Size of Language Sample , 1960 .

[2]  Temporal Reliability of Seven Language Measures , 1963 .

[3]  J. Stanley,et al.  Educational and Psychological Measurement and Evaluation , 1972 .

[4]  Paul Fletcher,et al.  The grammatical analysis of language disability , 1976 .

[5]  James E. Ysseldyke,et al.  Assessment in special and remedial education , 1978 .

[6]  R A Berk,et al.  Generalizability of behavioral observations: a clarification of interobserver agreement and interobserver reliability. , 1979, American journal of mental deficiency.

[7]  Jon F. Miller,et al.  Assessing Language Production in Children: Experimental Procedures , 1981 .

[8]  R S Chapman,et al.  The relation between age and mean length of utterance in morphemes. , 1981, Journal of speech and hearing research.

[9]  Judith Felson Duchan,et al.  Assessing children's language in naturalistic contexts , 1983 .

[10]  R. McCauley,et al.  Psychometric review of language and articulation tests for preschool children. , 1984, The Journal of speech and hearing disorders.

[11]  T. Klee,et al.  The relation between grammatical development and mean length of utterance in morphemes , 1985, Journal of Child Language.

[12]  A reconsideration of the relation between age and mean utterance length. , 1986, Journal of speech and hearing research.

[13]  S. Conant.  The relationship between age and MLU in young children: a second look at Klee and Fitzgerald's data , 1987, Journal of Child Language.

[14]  J. Rondal,et al.  Age-relation, reliability and grammatical validity of measures of utterance length , 1987, Journal of Child Language.

[15]  Margaret Lahey,et al.  Language disorders and language development , 1988 .

[16]  P. Dale,et al.  Examination of Test-Retest and Split-Half Reliability for Measures Derived from Language Samples of Young Handicapped Children , 1989 .

[17]  T. Klee,et al.  A comparison of the age-MLU relation in normal and specifically language-impaired preschool children. , 1989, The Journal of speech and hearing disorders.

[18]  Helen Tager-Flusberg,et al.  The relation of utterance length to grammatical complexity in normal and language-disordered groups , 1991, Applied Psycholinguistics.

[19]  T. Klee.  Developmental and diagnostic characteristics of quantitative measures of children's language production , 1992 .

[20]  R. Watkins,et al.  Measuring children's lexical diversity: differentiating typical and impaired language learners. , 1995, Journal of speech and hearing research.