On the Use of a Serious Game for Recording a Speech Corpus of People with Intellectual Disabilities

This paper describes the recording of a speech corpus focused on prosody of people with intellectual disabilities. To do this, a video game is used with the aim of improving the user’s motivation. Moreover, the player’s profiles and the sentences recorded during the game sessions are described. With the purpose of identifying the main prosodic troubles of people with intellectual disabilities, some prosodic features are extracted from recordings, like fundamental frequency, energy and pauses. After that, a comparison is made between the recordings of people with intellectual disabilities and people without intellectual disabilities. This comparison shows that pauses are the best discriminative feature between these groups. To check this, a study has been done using machine learning techniques, with a classification rate superior to 80%.

[1]  David Escudero Mancebo,et al.  Improving Automatic Classification of Prosodic Events by Pairwise Coupling , 2012, IEEE Transactions on Audio, Speech, and Language Processing.

[2]  Sara Wood,et al.  Relationship between speech, oromotor, language and cognitive abilities in children with Down's syndrome. , 2010, International journal of language & communication disorders.

[3]  S. Buckley,et al.  An overview of the development of teenagers with Down syndrome (11-16 years) , 2002 .

[4]  J. van Borsel,et al.  Cluttering in Down Syndrome , 2008, Folia Phoniatrica et Logopaedica.

[5]  Samantha Arzon,et al.  Running head : WISC-IV ! 1 ! ! ! ! ! ! ! ! ! Wechsler Intelligence Scale for Children ( WISC-IV ) , 2014 .

[6]  M. Hernández Martínez,et al.  Attention deficit disorder with or without hyperactivity or impulsivity in children with Down's syndrome , 2011 .

[7]  Alfred Bork,et al.  Multimedia in Learning , 2001 .

[8]  Ernest Adams,et al.  Fundamentals of Game Design , 2006 .

[9]  R S Chapman,et al.  Language, cognition, and short-term memory in individuals with Down syndrome. , 2001, Down's syndrome, research and practice : the journal of the Sarah Duffen Centre.

[10]  Robin S. Chapman,et al.  Language development in children and adolescents with Down syndrome , 1997 .

[11]  Raymond D. Kent,et al.  Speech impairment in Down syndrome: a review. , 2013, Journal of speech, language, and hearing research : JSLHR.

[12]  Marina Tsakiridou,et al.  The linguistic profile of Down ’ s syndrome subjects : evidence from wh-movement construction , 2006 .

[13]  Oscar Saz-Torralba,et al.  Analysis of Acoustic Features in Speakers with Cognitive Disorders and Speech Impairments , 2009, EURASIP J. Adv. Signal Process..

[14]  David Escudero Mancebo,et al.  A fuzzy classifier to deal with similarity between labels on automatic prosodic labeling , 2014, Comput. Speech Lang..

[15]  Manuela Raposo-Rivas,et al.  Las TIC en la educación de las personas con Síndrome de Down: un estudio bibliométrico , 2015 .

[16]  Mario Corrales Astorgano.  Videojuego para la mejora de la prosodia en personas con discapacidad intelectual , 2015 .

[17]  Vesna Stojanovik,et al.  Prosodic deficits in children with Down syndrome , 2011, Journal of Neurolinguistics.

[18]  J. Raven,et al.  Manual for Raven's progressive matrices and vocabulary scales , 1962 .

[19]  Oscar Saz-Torralba,et al.  The Alborada-I3A Corpus of Disordered Speech , 2010, LREC.

[20]  Bruno Estigarribia,et al.  Language Characteristics of Individuals With Down Syndrome , 2009, Topics in language disorders.