Use of Crowdsourcing to Assess the Ecological Validity of Perceptual-Training Paradigms in Dysarthria.

PURPOSE It has been documented in laboratory settings that familiarizing listeners with dysarthric speech improves intelligibility of that speech. If these findings can be replicated in real-world settings, the ability to improve communicative function by focusing on communication partners has major implications for extending clinical practice in dysarthria rehabilitation. An important step toward development of a listener-targeted treatment approach requires establishment of its ecological validity. To this end, the present study leveraged the mechanism of crowdsourcing to determine whether perceptual-training benefits achieved by listeners in the laboratory could be elicited in an at-home computer-based scenario. METHOD Perceptual-training data (i.e., intelligibility scores from a posttraining transcription task) were collected from listeners in 2 settings-the laboratory and the crowdsourcing website Amazon Mechanical Turk. RESULTS Consistent with previous findings, results revealed a main effect of training condition (training vs. control) on intelligibility scores. There was, however, no effect of training setting (Mechanical Turk vs. laboratory). Thus, the perceptual benefit achieved via Mechanical Turk was comparable to that achieved in the laboratory. CONCLUSION This study provides evidence regarding the ecological validity of perceptual-training paradigms designed to improve intelligibility of dysarthric speech, thereby supporting their continued advancement as a listener-targeted treatment option.

[1]  L. Nygaard,et al.  Perceptual learning of systematic variation in Spanish-accented speech. , 2009, The Journal of the Acoustical Society of America.

[2]  M. Schmuckler What Is Ecological Validity? A Dimensional Analysis. , 2001, Infancy : the official journal of the International Society on Infant Studies.

[3]  Stephen Wilson,et al.  Treating disordered speech and voice in Parkinson's disease online: a randomized controlled non-inferiority trial. , 2011, International journal of language & communication disorders.

[4]  Matthew H. Davis,et al.  Lexical information drives perceptual learning of distorted speech: evidence from the comprehension of noise-vocoded sentences. , 2005, Journal of experimental psychology. General.

[5]  A. Samuel,et al.  Perceptual learning for speech , 2009, Attention, perception & psychophysics.

[6]  K. T. Houston,et al.  Expanding Use of Telepractice in Speech-Language Pathology and Audiology , 2012 .

[7]  Russell L Woods,et al.  Crowdsourcing a Normative Natural Language Dataset: A Comparison of Amazon Mechanical Turk and In-Lab Data Collection , 2013, Journal of medical Internet research.

[8]  Peter F. Halpin,et al.  Online crowdsourcing for efficient rating of speech: a validation study. , 2015, Journal of communication disorders.

[9]  Stephanie A Borrie,et al.  Familiarisation conditions and the mechanisms that underlie improved recognition of dysarthric speech , 2012, Language and cognitive processes.

[10]  T. Anderson,et al.  A follow-up investigation into the mechanisms that underlie improved recognition of dysarthric speech. , 2012, The Journal of the Acoustical Society of America.

[11]  P. Adank,et al.  Predicting foreign-accent adaptation in older adults , 2012, Quarterly journal of experimental psychology.

[12]  Michael D. Buhrmester,et al.  Amazon's Mechanical Turk , 2011, Perspectives on psychological science : a journal of the Association for Psychological Science.

[13]  Adam J. Berinsky,et al.  Evaluating Online Labor Markets for Experimental Research: Amazon.com's Mechanical Turk , 2012, Political Analysis.

[14]  Rene L. Utianski,et al.  Crosslinguistic Application of English-Centric Rhythm Descriptors in Motor Speech Disorders , 2013, Folia Phoniatrica et Logopaedica.

[15]  Constance M. Clarke,et al.  Rapid adaptation to foreign-accented English. , 2004, The Journal of the Acoustical Society of America.

[16]  T. Pring,et al.  Delivering the Lee Silverman Voice Treatment (LSVT) by web camera: a feasibility study. , 2009, International journal of language & communication disorders.

[17]  Julie M. Liss,et al.  A Cognitive-Perceptual Approach to Conceptualizing Speech Intelligibility Deficits and Remediation Practice in Hypokinetic Dysarthria , 2011, Parkinson's disease.

[18]  Stephanie A. Borrie,et al.  The role of linguistic and indexical information in improved recognition of dysarthric speech. , 2011, The Journal of the Acoustical Society of America.

[19]  Jon Sprouse A validation of Amazon Mechanical Turk for the collection of acceptability judgments in linguistic theory , 2010, Behavior research methods.

[20]  Jennifer L. Spielman,et al.  Innovative technology for the assisted delivery of intensive voice treatment (LSVT®LOUD) for Parkinson disease. , 2012, American journal of speech-language pathology.

[21]  Julie M. Liss,et al.  The role of listener familiarity in the perception of dysarthric speech , 1995 .

[22]  Raymond D. Kent,et al.  A Longitudinal Case Study of ALS: Effects of Listener Familiarity and Proficiency on Intelligibility Judgments , 2000 .

[23]  Julie M Liss,et al.  The effects of familiarization on intelligibility and lexical segmentation in hypokinetic and ataxic dysarthria. , 2002, The Journal of the Acoustical Society of America.

[24]  Tessa Bent,et al.  Perceptual adaptation to non-native speech , 2008, Cognition.

[25]  A. Acquisti,et al.  Reputation as a sufficient condition for data quality on Amazon Mechanical Turk , 2013, Behavior Research Methods.

[26]  J. Liss,et al.  Vowel acoustics in dysarthria: speech disorder diagnosis and classification. , 2014, Journal of speech, language, and hearing research : JSLHR.

[27]  D. Pisoni,et al.  Multiple routes to the perceptual learning of speech. , 2008, The Journal of the Acoustical Society of America.

[28]  S. Borrie Visual speech information: a help or hindrance in perceptual processing of dysarthric speech. , 2015, The Journal of the Acoustical Society of America.

[29]  Stephanie A. Borrie,et al.  Perceptual learning of dysarthric speech: a review of experimental studies. , 2012, Journal of speech, language, and hearing research : JSLHR.

[30]  Emmanuel Dupoux,et al.  Perceptual adjustment to highly compressed speech: effects of talker and rate changes. , 1997, Journal of experimental psychology. Human perception and performance.

[31]  Panagiotis G. Ipeirotis,et al.  Running Experiments on Amazon Mechanical Turk , 2010, Judgment and Decision Making.

[32]  Julie M Liss,et al.  Free-classification of perceptually similar speakers with dysarthria. , 2014, Journal of speech, language, and hearing research : JSLHR.