Validation of the Cepstral Spectral Index of Dysphonia (CSID) as a Screening Tool for Voice Disorders: Development of Clinical Cutoff Scores.

OBJECTIVES The purposes of this study were to (1) evaluate the performance of the Cepstral Spectral Index of Dysphonia (CSID--a multivariate estimate of dysphonia severity) as a potential screening tool for voice disorder identification and (2) identify potential clinical cutoff scores to classify voice-disordered cases versus controls. METHODOLOGY Subjects were 332 men and women (116 men, 216 women) comprised of subjects who presented to a physician with a voice-related complaint and a group of non-voice-related control subjects. Voice-disordered cases versus controls were initially defined via three reference standards: (1) auditory-perceptual judgment (dysphonia +/-); (2) Voice Handicap Index (VHI) score (VHI +/-); and (3) laryngoscopic description (laryngoscopic +/-). Speech samples were analyzed using the Analysis of Dysphonia in Speech and Voice program. Cepstral and spectral measures were combined into a CSID multivariate formula which estimated dysphonia severity for Rainbow Passage samples (i.e., the CSIDR). The ability of the CSIDR to accurately classify cases versus controls in relation to each reference standard was evaluated via a combination of logistic regression and receiver operating characteristic (ROC) analyses. RESULTS The ability of the CSIDR to discriminate between cases and controls was represented by the "area under the ROC curve" (AUC). ROC classification of dysphonia-positive cases versus controls resulted in a strong AUC = 0.85. A CSIDR cutoff of ≈24 achieved the best balance between sensitivity and specificity, whereas a more liberal cutoff score of ≈19 resulted in higher sensitivity while maintaining respectable specificity which may be preferred for screening purposes. Weaker but adequate AUCs = 0.75 and 0.73 were observed for the classification of VHI-positive and laryngoscopic-positive cases versus controls, respectively. Logistic regression analyses indicated that subject age may be a significant covariate in the discrimination of dysphonia-positive and VHI-positive cases versus controls. CONCLUSIONS The CSIDR can provide a strong level of accuracy for the classification of voice-disordered cases versus controls, particularly when auditory-perceptual judgment is used as the reference standard. Although users often focus on a cutoff score that achieves a balance between sensitivity and specificity, more liberal cutoffs for screening purposes versus conservative cutoffs when cost or risk of further evaluation is deemed to be high should also be considered.

[1]  D. Childers,et al.  Acoustic correlates of vocal quality. , 1990, Journal of speech and hearing research.

[2]  A. Behrman,et al.  Vocal hygiene education, voice production therapy, and the role of patient adherence: a treatment effectiveness study in women with phonotrauma. , 2008, Journal of speech, language, and hearing research : JSLHR.

[3]  John Attia,et al.  Moving beyond sensitivity and specificity: using likelihood ratios to help interpret diagnostic tests , 2003 .

[4]  S. Awan The voice diagnostic protocol : a practical guide to the diagnosis of voice disorders , 2001 .

[5]  R. Zraick,et al.  The effect of speaking sample duration on determination of habitual pitch. , 2005, Journal of voice : official journal of the Voice Foundation.

[6]  N. Roy,et al.  Automated acoustic analysis of task dependency in adductor spasmodic dysphonia versus muscle tension dysphonia , 2014, The Laryngoscope.

[7]  J. Hillenbrand,et al.  Acoustic correlates of breathy vocal quality: dysphonic voices and continuous speech. , 1996, Journal of speech and hearing research.

[8]  I. Deary,et al.  VoiSS: a patient-derived Voice Symptom Scale. , 2003, Journal of psychosomatic research.

[9]  J. Kreiman,et al.  Perceptual evaluation of voice quality: review, tutorial, and a framework for future research. , 1993, Journal of speech and hearing research.

[10]  R J Baken,et al.  The aged voice: a new hypothesis. , 2005, Journal of voice : official journal of the Voice Foundation.

[11]  B. Reiser,et al.  Estimation of the Youden Index and its Associated Cutoff Point , 2005, Biometrical journal. Biometrische Zeitschrift.

[12]  R F Orlikoff,et al.  The relationship of age and cardiovascular health to certain acoustic characteristics of male voices. , 1990, Journal of speech and hearing research.

[13]  C. Metz Basic principles of ROC analysis. , 1978, Seminars in nuclear medicine.

[14]  Shaheen N Awan,et al.  Spectral-Cepstral Estimation of Dysphonia Severity: External Validation , 2013, The Annals of otology, rhinology, and laryngology.

[15]  W. Youden,et al.  Index for rating diagnostic tests , 1950, Cancer.

[16]  L. Portney,et al.  Foundations of Clinical Research: Applications to Practice , 2015 .

[17]  J. Kreiman,et al.  When and why listeners disagree in voice quality assessment tasks. , 2007, The Journal of the Acoustical Society of America.

[18]  D. Mehta,et al.  Evidence-based clinical voice assessment: a systematic review. , 2013, American journal of speech-language pathology.

[19]  Richard Burns,et al.  Business Research Methods and Statistics Using SPSS , 2008 .

[20]  D. Sackett,et al.  Evidence based medicine: what it is and what it isn't , 1996, BMJ.

[21]  Geoffrey S. Meltzner,et al.  Quantifying dysphonia severity using a spectral/cepstral-based acoustic index: Comparisons with auditory-perceptual judgements from the CAPE-V , 2010, Clinical linguistics & phonetics.

[22]  G. Fairbanks Voice and articulation drillbook , 1960 .

[23]  C. Newman,et al.  The Voice Handicap Index (VHI)Development and Validation , 1997 .

[24]  Soren Y. Lowell,et al.  Predictive value and discriminant capacity of cepstral- and spectral-based measures during continuous speech. , 2013, Journal of voice : official journal of the Voice Foundation.

[25]  P H Dejonckere,et al.  Self-assessment of voice therapy for chronic dysphonia. , 2004, Clinical otolaryngology and allied sciences.

[26]  P. Dejonckere,et al.  Ambulatory phonation monitoring in a sample of 92 call center operators. , 2014, Journal of voice : official journal of the Voice Foundation.

[27]  P. Van cauwenberge,et al.  Toward improved ecological validity in the acoustic measurement of overall voice quality: combining continuous speech and sustained vowels. , 2010, Journal of voice : official journal of the Voice Foundation.

[28]  Susan Thibeault,et al.  Voice disorders in teachers and the general population: effects on work performance, attendance, and future career choices. , 2004, Journal of speech, language, and hearing research : JSLHR.

[29]  Soren Y Lowell,et al.  Aerodynamic and Acoustic Features of Vocal Effort , 2019 .

[30]  M. Śliwińska-Kowalska,et al.  Assessment of the Voice Handicap Index as a Screening Tool in Dysphonic Patients , 2011, Folia Phoniatrica et Logopaedica.

[31]  R. Hillman,et al.  Consensus auditory-perceptual evaluation of voice: development of a standardized clinical protocol. , 2009, American journal of speech-language pathology.

[32]  D. Scott,et al.  Voice Symptoms in Patients with Autoimmune Disease , 2012, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[33]  Viv Bewick,et al.  Statistics review 13: Receiver operating characteristic curves , 2004, Critical care.

[34]  Susan Thibeault,et al.  Prevalence of voice disorders in teachers and the general population. , 2004, Journal of speech, language, and hearing research : JSLHR.

[35]  E. Yiu,et al.  Voice activity and participation profile: assessing the impact of voice disorders on daily activities. , 2001, Journal of speech, language, and hearing research : JSLHR.

[36]  E. Cuende,et al.  The prevalence of dysphonia, its association with immunomediated diseases and correlation with biochemical markers. , 2012, Journal of voice : official journal of the Voice Foundation.

[37]  A. Sibai,et al.  Voice-Related Quality of Life in Patients with Multiple Sclerosis , 2012, Autoimmune diseases.

[38]  D. Rennie,et al.  The STARD statement for reporting studies of diagnostic accuracy: explanation and elaboration. , 2003, Annals of internal medicine.

[39]  R. Speyer,et al.  Prevalence and relative risk of dysphonia in rheumatoid arthritis. , 2008, Journal of voice : official journal of the Voice Foundation.

[40]  J. Hanley,et al.  A method of comparing the areas under receiver operating characteristic curves derived from the same cases. , 1983, Radiology.

[41]  Ellen S. Deutsch,et al.  Clinical Practice Guideline: Hoarseness (Dysphonia) , 2009, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[42]  Jackie L. Gartner-Schmidt,et al.  Acoustic analysis of four common voice diagnoses: moving toward disorder-specific assessment. , 2014, Journal of voice : official journal of the Voice Foundation.

[43]  E. DeLong,et al.  Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. , 1988, Biometrics.

[44]  N. Roy,et al.  Acoustic prediction of voice type in women with functional dysphonia. , 2005, Journal of voice : official journal of the Voice Foundation.

[45]  P. Taylor,et al.  Prevalence of subjective voice impairment in rheumatoid arthritis , 2008, Clinical Rheumatology.

[46]  Shaheen N Awan,et al.  Tracking voice change after thyroidectomy: application of spectral/cepstral analyses , 2011, Clinical linguistics & phonetics.

[47]  Helena Chmura Kraemer,et al.  Measures of clinical significance. , 2003, Journal of the American Academy of Child and Adolescent Psychiatry.

[48]  D. Bluemke,et al.  Relationship of temporal resolution to diagnostic performance for dynamic contrast enhanced MRI of the breast , 2009, Journal of magnetic resonance imaging : JMRI.

[49]  L. Ramig,et al.  Review: Occupational risks for voice problems , 2001, Logopedics, phoniatrics, vocology.

[50]  Thomas Murry,et al.  Development and Validation of the Voice Handicap Index‐10 , 2004, The Laryngoscope.

[51]  Nelson Roy,et al.  Spectral moments of the long-term average spectrum: sensitive indices of voice change after therapy? , 2005, Journal of voice : official journal of the Voice Foundation.

[52]  Shaheen N Awan,et al.  Toward the development of an objective index of dysphonia severity: A four‐factor acoustic model , 2006, Clinical linguistics & phonetics.

[53]  M. Pepe The Statistical Evaluation of Medical Tests for Classification and Prediction , 2003 .

[54]  P. Van cauwenberge,et al.  Acoustic measurement of overall voice quality: a meta-analysis. , 2009, The Journal of the Acoustical Society of America.

[55]  Varun V. Varadarajan,et al.  Dysphonia in nursing home and assisted living residents: prevalence and association with frailty. , 2015, Journal of voice : official journal of the Voice Foundation.

[56]  N. Hogikyan,et al.  Validation of an instrument to measure voice-related quality of life (V-RQOL). , 1999, Journal of voice : official journal of the Voice Foundation.

[57]  Glaser,et al.  High-Yield Biostatistics, Epidemiology, & Public Health , 2013 .

[58]  S. Fex Special ArticlePerceptual evaluation , 1992 .

[59]  N. Moradi,et al.  Cutoff point at voice handicap index used to screen voice disorders among persian speakers. , 2013, Journal of voice : official journal of the Voice Foundation.

[60]  Christopher Dromey,et al.  Estimating dysphonia severity in continuous speech: Application of a multi-parameter spectral/cepstral model , 2009, Clinical linguistics & phonetics.

[61]  N. Solomon,et al.  Utility of the voice handicap index as an indicator of postthyroidectomy voice dysfunction. , 2013, Journal of Voice.

[62]  Andy P. Field,et al.  Discovering Statistics Using SPSS , 2000 .

[63]  G Molenberghs,et al.  The dysphonia severity index: an objective measure of vocal quality based on a multiparameter approach. , 2000, Journal of speech, language, and hearing research : JSLHR.

[64]  Shaheen N Awan,et al.  Toward validation of the cepstral spectral index of dysphonia (CSID) as an objective treatment outcomes measure. , 2013, Journal of voice : official journal of the Voice Foundation.

[65]  H. Dotevall,et al.  Voice handicap index in Swedish , 2009, Logopedics, phoniatrics, vocology.

[66]  Y. Heman-Ackah,et al.  The relationship between cepstral peak prominence and selected parameters of dysphonia. , 2002, Journal of voice : official journal of the Voice Foundation.

[67]  N. Hogikyan,et al.  Establishment of a normative database for the Voice-Related Quality of Life (V-RQOL) measure. , 2014, Journal of voice : official journal of the Voice Foundation.

[68]  D. Kuik,et al.  Voice in early glottic cancer compared to benign voice pathology , 2007, European Archives of Oto-Rhino-Laryngology.

[69]  Shaheen N Awan,et al.  Exploring the relationship between spectral and cepstral measures of voice and the Voice Handicap Index (VHI). , 2014, Journal of voice : official journal of the Voice Foundation.