The effect of listener experience and anchors on judgments of dysphonia.

PURPOSE To determine the effect of auditory anchors on judgments of overall severity (OS) and vocal effort (VE) in dysphonic speech when judgments are made by experienced and inexperienced listeners, and when self-rated by individuals with dysphonia (speaker-listeners). METHOD Twenty individuals with dysphonia and 4 normal controls provided speech recordings. Speaker-listeners judged their own speech samples for OS and VE without auditory anchors, and then in the presence of anchors, using 100-mm visual analog scales (VAS). Twenty inexperienced and 10 experienced listeners evaluated the same speech samples for OS and VE in similar rating conditions. Twenty inexperienced listeners also made judgments of the speech samples solely in anchored conditions. RESULTS All listeners judged the speech samples as significantly less severe and effortful in the anchored conditions. No significant effects of anchors or experience were found for intrarater agreement within 7.14 mm on the VAS. Both inexperienced and experienced listeners were significantly less variable and showed improved interrater agreement in the anchored conditions. Anchors significantly improved agreement across groups of listeners, particularly between inexperienced and speaker-listeners. CONCLUSION Listeners systematically shift judgments of voice quality in response to auditory anchors. Anchors reduce interrater variability and may improve agreement across some types of listeners.

[1]  J Kreiman,et al.  Comparing internal and external standards in voice quality judgments. , 1993, Journal of speech and hearing research.

[2]  Philip C Doyle,et al.  Direct magnitude estimation and interval scaling of pleasantness and severity in dysphonic and normal speakers. , 2002, The Journal of the Acoustical Society of America.

[3]  V. Ciocca,et al.  Effect of listener training on perceptual judgement of hypernasality , 2009, Clinical linguistics & phonetics.

[4]  Reliability and confidence in using a paired comparison paradigm in perceptual voice quality evaluation , 2007, Clinical linguistics & phonetics.

[5]  Alison Behrman,et al.  Common practices of voice therapists in the evaluation of patients. , 2005, Journal of voice : official journal of the Voice Foundation.

[6]  J. F. Brandt,et al.  Vocal loudness and effort in continuous speech. , 1969, The Journal of the Acoustical Society of America.

[7]  J. Kreiman,et al.  When and why listeners disagree in voice quality assessment tasks. , 2007, The Journal of the Acoustical Society of America.

[8]  S. Awan,et al.  The effect of anchor modality on the reliability of vocal severity ratings. , 2009, Journal of voice : official journal of the Voice Foundation.

[9]  P. Carding,et al.  The reliability and validity of patient self‐rating of their own voice quality , 2005, Clinical otolaryngology : official journal of ENT-UK ; official journal of Netherlands Society for Oto-Rhino-Laryngology & Cervico-Facial Surgery.

[10]  T. Eadie,et al.  The role of experience on judgments of dysphonia. , 2010, Journal of voice : official journal of the Voice Foundation.

[11]  Jody Kreiman,et al.  Measuring vocal quality with speech synthesis , 2000 .

[12]  C. Sapienza,et al.  Application of psychometric theory to the measurement of voice quality using rating scales. , 2005, Journal of speech, language, and hearing research : JSLHR.

[13]  J. Hillenbrand,et al.  Acoustic correlates of breathy vocal quality: dysphonic voices and continuous speech. , 1996, Journal of speech and hearing research.

[14]  Jack E. Thomas,et al.  Judgment of Voice Improvement after Recurrent Laryngeal Nerve Section for Spastic Dysphonia: Clinicians versus Patients , 1986, The Annals of otology, rhinology, and laryngology.

[15]  I. J. Deary,et al.  The reliability of three perceptual evaluation scales for dysphonia , 2004, European Archives of Oto-Rhino-Laryngology and Head & Neck.

[16]  A. Parducci Chapter 5 – CONTEXTUAL EFFECTS: A RANGE–FREQUENCY ANALYSIS* , 1974 .

[17]  J. Kreiman,et al.  Perceptual evaluation of voice quality: review, tutorial, and a framework for future research. , 1993, Journal of speech and hearing research.

[18]  J Kreiman,et al.  Validity of rating scale measures of voice quality. , 1998, The Journal of the Acoustical Society of America.

[19]  R. Hillman,et al.  Consensus auditory-perceptual evaluation of voice: development of a standardized clinical protocol. , 2009, American journal of speech-language pathology.

[20]  S. Niimi,et al.  A Comparison of Voice Quality Ratings Made by Japanese and American Listeners Using the GRBAS Scale , 2003, Folia Phoniatrica et Logopaedica.

[21]  I. Titze,et al.  Dependence of phonatory effort on hydration level. , 1994, Journal of speech and hearing research.

[22]  Karen M. K. Chan,et al.  A comparison of two perceptual voice evaluation training programs for naive listeners. , 2006, Journal of voice : official journal of the Voice Foundation.

[23]  C. Baylor,et al.  Effect of Experience on Judgments of Adductor Spasmodic Dysphonia , 2007, The Annals of otology, rhinology, and laryngology.

[24]  L. Orloff,et al.  The impact of long-term botulinum toxin injections on symptom severity in patients with spasmodic dysphonia. , 2004, Journal of voice : official journal of the Voice Foundation.

[25]  J. Kreiman,et al.  Individual differences in voice quality perception. , 1992 .

[26]  F. Klingholz,et al.  Acoustic representation of speaking-voice quality , 1990 .

[27]  J. Kreiman,et al.  Listener experience and perception of voice quality. , 1990 .

[28]  Ventry Im,et al.  Identification of elderly people with hearing problems. , 1983 .

[29]  Jody Kreiman,et al.  Perception of aperiodicity in pathological voice. , 2005, The Journal of the Acoustical Society of America.

[30]  C. Baylor,et al.  The effect of perceptual training on inexperienced listeners' judgments of dysphonic voice. , 2006, Journal of voice : official journal of the Voice Foundation.

[31]  J. Hillenbrand,et al.  Acoustic correlates of breathy vocal quality. , 1994, Journal of speech and hearing research.

[32]  Edwin M-L Yiu,et al.  The effect of anchors and training on the reliability of perceptual voice evaluation. , 2002, Journal of speech, language, and hearing research : JSLHR.

[33]  Rahul Shrivastav,et al.  Perceptual distances of breathy voice quality: a comparison of psychophysical methods. , 2010, Journal of voice : official journal of the Voice Foundation.

[34]  R. Ingham,et al.  Time-interval measurement of stuttering: modifying interjudge agreement. , 1993, Journal of speech and hearing research.

[35]  Jessica E. Huber,et al.  Perceptual Evaluation of Hypernasality Compared to HONC Measures: The Role of Experience , 2005, The Cleft palate-craniofacial journal : official publication of the American Cleft Palate-Craniofacial Association.

[36]  Gary Weismer,et al.  Direct magnitude estimates of speech intelligibility in dysarthria: effects of a chosen standard. , 2002, Journal of speech, language, and hearing research : JSLHR.

[37]  P. van de Heyning,et al.  Test-retest study of the GRBAS scale: influence of experience and professional background on perceptual rating of voice quality. , 1997, Journal of voice : official journal of the Voice Foundation.