A case-based approach using phonological knowledge for identifying error patterns in children's speech

Case-Based Reasoning (CBR) covers a range of different methods for organizing, retrieving, and indexing knowledge from previous cases. Thus, this methodology has been successfully applied in medical domain, due to its human and intelligent properties to diagnose the case of a patient. In the speech therapy domain, an early identification of speech sound disorders allows the diagnosis and treatment of various pathologies and may aid clinical decision-making. However, there are few proposals that use knowledge modeling for supporting speech therapists. Moreover, there is no indicative in related literature of CBR being used for detecting the phonological processes (PPs) that may occur in pronunciations. So, in this paper, we present a case-based approach that uses machine learning for predicting PPs, aiming to provide clinical support in the identification of error patterns in children's speech. The method was evaluated through a speech corpus containing near one hundred thousand audio files, collected from pronunciation assessments performed by speech-language pathologists with more than 1,000 children. Using our knowledge base along with incremental learning, we obtained an accuracy of over 93% for predicting the PPs, showing the efficiency of our method for clinical decision support.

[1]  Mobyen Uddin Ahmed,et al.  Case studies on the clinical applications using case-based reasoning , 2012, 2012 Federated Conference on Computer Science and Information Systems (FedCSIS).

[2]  Agnar Aamodt,et al.  Case-Based Reasoning: Foundational Issues, Methodological Variations, and System Approaches , 1994, AI Commun..

[3]  Hyun Jung Lee,et al.  eHealth Recommendation Service System Using Ontology and Case-Based Reasoning , 2015, 2015 IEEE International Conference on Smart City/SocialCom/SustainCom (SmartCity).

[4]  Iván Pau,et al.  Deployment and Validation of a Smart System for Screening of Language Disorders in Primary Care , 2013, Sensors.

[5]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Isabel Guimarães,et al.  Robust phoneme recognition for a speech therapy environment , 2016, 2016 IEEE International Conference on Serious Games and Applications for Health (SeGAH).

[7]  Felipe Trujillo-Romero,et al.  Evolutionary approach for integration of multiple pronunciation patterns for enhancement of dysarthric speech recognition , 2014, Expert Syst. Appl..

[8]  Tong Zhang,et al.  Solving large scale linear prediction problems using stochastic gradient descent algorithms , 2004, ICML.

[9]  Rocio Guillén,et al.  Case Based Reasoning Using Speech Data for Clinical Assessment , 2005, IEA/AIE.

[10]  Martín López-Nores,et al.  An educative environment based on ontologies and e-learning for training on design of speech-language therapy plans for children with disabilities and communication disorders , 2016, 2016 IEEE Congreso Argentino de Ciencias de la Informática y Desarrollos de Investigación (CACIDI).

[11]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[12]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[13]  Iara Augustin,et al.  Blending Situation Awareness with Machine Learning to Identify Children’s Speech Disorders , 2018, 2018 IEEE 12th International Conference on Application of Information and Communication Technologies (AICT).

[14]  Moonis Ali,et al.  Proceedings of the 19th international conference on Advances in Applied Artificial Intelligence: industrial, Engineering and Other Applications of Applied Intelligent Systems , 2006 .

[15]  D. Stampe A dissertation on natural phonology , 1979 .

[16]  B. Nithya,et al.  Predictive analytics in health care using machine learning tools and techniques , 2017, 2017 International Conference on Intelligent Computing and Control Systems (ICICCS).

[17]  Christopher K. Riesbeck,et al.  Inside Case-Based Reasoning , 1989 .

[18]  Nidul Sinha,et al.  A hybrid CBR classification model by integrating ANN into CBR , 2015 .

[19]  Zhi-Hua Zhou,et al.  ML-KNN: A lazy learning approach to multi-label learning , 2007, Pattern Recognit..

[20]  Jong-Yih Kuo,et al.  Multiagent Cooperative Learning Strategies for Pursuit-Evasion Games , 2015 .

[21]  Mobyen Uddin Ahmed,et al.  Case-Based Reasoning Systems in the Health Sciences: A Survey of Recent Trends and Developments , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[22]  B. Dodd,et al.  Phonological disorders in children: changes in phonological process use during treatment. , 1989, The British journal of disorders of communication.

[23]  Ronald A. Cole,et al.  FLORA: Fluent oral reading assessment of children's speech , 2011, TSLP.

[24]  Wahidah Husain,et al.  The development of personalized wellness therapy recommender system using hybrid case-based reasoning , 2010, 2010 2nd International Conference on Computer Technology and Development.

[25]  Ian D. Watson,et al.  Case-based reasoning is a methodology not a technology , 1999, Knowl. Based Syst..

[26]  Marileda Barichello Gubiani,et al.  Factors Influencing Consonant Acquisition in Brazilian Portuguese-Speaking Children. , 2017, Journal of speech, language, and hearing research : JSLHR.

[27]  Putra Sumari,et al.  Performance based CBR Mass detection in mammograms , 2010, 2010 INTERNATIONAL CONFERENCE ON COMMUNICATION CONTROL AND COMPUTING TECHNOLOGIES.

[28]  Mehmet Yavas,et al.  Processes and intelligibility in disordered phonology , 1988 .

[29]  Isabel Trancoso,et al.  Automatic word naming recognition for an on-line aphasia treatment system , 2013, Comput. Speech Lang..

[30]  Philip H. Swain,et al.  Purdue e-Pubs , 2022 .