Applying situation-awareness for recommending phonological processes in the children's speech

Situation-Awareness (SA) involves the correct interpretation of scenarios, allowing a system to respond to the observed environment in several domains. Speech therapy is an area where SA may provide benefits; however, the related literature generally is not concerned with identifying phonological processes (PPs) in pronunciation and their effects on the management of therapeutic tasks. An early identification of speech sound disorders allows the diagnosis and treatment of various pathologies and the reasoning about situations may aid clinical decision-making. So, in this paper, we present a novel method for predicting PPs, supporting speech therapists in the identification of speech disorders in children. Our approach uses SA tied to machine learning to first classify the correctness in the pronunciation of a set of target words. Then, a second instance of ML uses scores calculated from mispelled words to predict the PPs. The method was evaluated through a speech corpus containing over a thousand of audio files, collected from pronunciation assessments performed by speech-language pathologists with more than 1,000 children. Our results showed an average accuracy over 92.5% for classifying the pronunciations, and 92.2% for predicting the PPs.

[1]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Philip H. Swain,et al.  Purdue e-Pubs , 2022 .

[3]  B. Nithya,et al.  Predictive analytics in health care using machine learning tools and techniques , 2017, 2017 International Conference on Intelligent Computing and Control Systems (ICICCS).

[4]  Iara Augustin,et al.  Blending Situation Awareness with Machine Learning to Identify Children’s Speech Disorders , 2018, 2018 IEEE 12th International Conference on Application of Information and Communication Technologies (AICT).

[5]  Iara Augustin,et al.  Situation awareness in the speech therapy domain: A systematic mapping study , 2019, Comput. Speech Lang..

[6]  Martín López-Nores,et al.  An educative environment based on ontologies and e-learning for training on design of speech-language therapy plans for children with disabilities and communication disorders , 2016, 2016 IEEE Congreso Argentino de Ciencias de la Informática y Desarrollos de Investigación (CACIDI).

[7]  Ronald A. Cole,et al.  FLORA: Fluent oral reading assessment of children's speech , 2011, TSLP.

[8]  Mieczyslaw M. Kokar,et al.  Situation Awareness and Cognitive Modeling , 2012, IEEE Intelligent Systems.

[9]  Leon Pretorius,et al.  System dynamics modelling of situation awareness , 2015, 2015 Military Communications and Information Systems Conference (MilCIS).

[10]  Isabel Guimarães,et al.  Robust phoneme recognition for a speech therapy environment , 2016, 2016 IEEE International Conference on Serious Games and Applications for Health (SeGAH).

[11]  Diego Quisi-Peralta,et al.  An ontology-based expert system to generate therapy plans for children with disabilities and communication disorders , 2016, 2016 IEEE Ecuador Technical Chapters Meeting (ETCM).

[12]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[13]  Ah-Hwee Tan,et al.  Modelling situation awareness for Context-aware Decision Support , 2009, Expert Syst. Appl..

[14]  Felipe Trujillo-Romero,et al.  Evolutionary approach for integration of multiple pronunciation patterns for enhancement of dysarthric speech recognition , 2014, Expert Syst. Appl..

[15]  Isabel Trancoso,et al.  Automatic word naming recognition for an on-line aphasia treatment system , 2013, Comput. Speech Lang..

[16]  Andy Liaw,et al.  Classification and Regression by randomForest , 2007 .

[17]  Mehmet Yavas,et al.  Processes and intelligibility in disordered phonology , 1988 .

[18]  Md. Mustafizur Rahman,et al.  Teaching intelligible speech to the autistic children by interactive computer games , 2011, SAC '11.

[19]  B. Dodd,et al.  Phonological disorders in children: changes in phonological process use during treatment. , 1989, The British journal of disorders of communication.

[20]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[21]  Stefan Gheorghe Pentiuc,et al.  Improving Computer Based Speech Therapy Using a Fuzzy Expert System , 2010, Comput. Informatics.

[22]  Ricardo Gutierrez-Osuna,et al.  Development of a Remote Therapy Tool for Childhood Apraxia of Speech , 2015, ACM Trans. Access. Comput..

[23]  Elmar Nöth,et al.  Robust Automatic Evaluation of Intelligibility in Voice Rehabilitation Using Prosodic Analysis , 2017, TSD.

[24]  Iván Pau,et al.  Deployment and Validation of a Smart System for Screening of Language Disorders in Primary Care , 2013, Sensors.

[25]  D. Stampe A dissertation on natural phonology , 1979 .