Inter-rater reliability as a reflection of ambiguity in the communication of deaf and normally-hearing children.

This study involves (a) procedures for coding intentionality and communicative function from the behavior of young children, (b) determining inter-rater reliability on those decisions, and (c) making judgments about which data to use for presentation and analysis. Communication data from videotaped interactions of 48 deaf and 96 normally-hearing children (12-54 months of age) and their mothers were obtained from two independent coders. As predicted, the percent-agreement between coders was higher for older children and for hearing children compared to deaf children. It is argued that the ambiguity reflected in poor coder agreement for less skilled communicators may represent the extent to which these children are understood. It is suggested that for such children data analysis should be restricted to those behaviors on which two independent coders agree.

[1]  A. Geers,et al.  Communication of oral deaf and normally hearing children at 36 months of age. , 1997, Journal of speech, language, and hearing research : JSLHR.

[2]  M E Demorest,et al.  Sources of variability in speechreading sentences: a generalizability analysis. , 1992, Journal of speech and hearing research.

[3]  R. Golinkoff,et al.  The Origins and Growth of Communication , 1984 .

[4]  C. Snow,et al.  Classifying communicative acts in children's interactions. , 1994, Journal of communication disorders.

[5]  Jacob Cohen A Coefficient of Agreement for Nominal Scales , 1960 .

[6]  B. R. Schirmer An Analysis of the Language of Young Hearing-Impaired Children in Terms of Syntax, Semantics, and Use , 1985, American annals of the deaf.

[7]  C. Prutting,et al.  Early communication: semantic functions and communicative intentions in the communication of the preschool child with impaired hearing. , 1977, American annals of the deaf.

[8]  A. Stredler-Brown,et al.  Learning to Communicate: Babies with Hearing Impairments Make Their Needs Known. , 1992 .

[9]  E. L. Lowell,et al.  Pragmatic and semantic development in young children with impaired hearing. , 1979, Journal of speech and hearing research.

[10]  P. Kricos,et al.  Cognitive & Communicative Development in Hearing-Impaired Preschool Children , 2013 .

[11]  R. Ingham,et al.  The reliability of observational data: II. Issues in the identification and measurement of stuttering events. , 1994, Journal of speech and hearing research.

[12]  P. S. Day Deaf children's expression of communicative intentions. , 1986, Journal of communication disorders.

[13]  M. Greenberg Mode use in deaf children: the effects of communication method and communication competence , 1980, Applied Psycholinguistics.

[14]  Jane A. Herman,et al.  Learning How to Say What One Means: A Longitudinal Study of Children's Speech Act Use* , 1996 .

[15]  Donald B. Rubin,et al.  The Dependability of Behavioral Measurements: Theory of Generalizability for Scores and Profiles. , 1974 .

[16]  Hoi K. Suen,et al.  Analyzing Quantitative Behavioral Observation Data , 1989 .