A study of decodable breathing patterns for augmentative and alternative communication

Abstract People who use high-tech augmentative and alternative communication (AAC) solutions still face restrictions in terms of practical utilization of present AAC devices, especially when speech impairment is compounded with motor disabilities. This study aims to explore an effective way to decode breathing patterns for AAC by the means of a breath activated dynamic air pressure detection system (DAPDS) and supervised machine learning (ML). The aim is to detect a user’s modulated breathing patterns (MBPs) and turn them into synthesized messages for conversation with the outside world. MBPs are processed using a one-nearest neighbor (1-NN) algorithm with variations of dynamic time warping (DTW) to produce synthesized machine spoken words (SMSW) at managed complexities and speeds. An ethical approved protocol was conducted with the participation of 25 healthy subjects to create a library of 1500 MBPs corresponding to four different classes. A mean systematic classification accuracy of 91.97 % was obtained using the current configuration. The implications from the study indicate that an improved AAC solution and speaking biometrics decoding could be undertaken in the future.

[1]  Marjorie H. Charlop,et al.  Augmentative and Alternative Communication Systems , 2011 .

[2]  Chris Ball,et al.  Efficient Communication by Breathing , 2004, Deterministic and Statistical Methods in Machine Learning.

[3]  Annalu Waller,et al.  Telling tales: unlocking the potential of AAC technologies , 2018, International journal of language & communication disorders.

[4]  Jason Farquhar,et al.  Design requirements and potential target users for brain-computer interfaces – recommendations from rehabilitation professionals , 2014 .

[5]  Sharon L. Glennen AUGMENTATIVE AND ALTERNATIVE COMMUNICATION SYSTEMS , 1999 .

[6]  A breath controlled AAC system , 2016 .

[7]  Erin Beneteau,et al.  Functional Performance Using Eye Control and Single Switch Scanning by People With ALS , 2010 .

[8]  N. Birbaumer,et al.  Brain-machine interface (BMI) in paralysis. , 2015, Annals of physical and rehabilitation medicine.

[9]  Noam Sobel,et al.  Sniffing enables communication and environmental control for the severely disabled , 2010, Proceedings of the National Academy of Sciences.

[10]  E. Simion Augmentative and Alternative Communication – Support for People with Severe Speech Disorders , 2014 .

[11]  Krista M Wilkinson,et al.  Eye Tracking Research to Answer Questions about Augmentative and Alternative Communication Assessment and Intervention , 2014, Augmentative and alternative communication.

[12]  Norman Alm,et al.  Automatic generation of conversational utterances and narrative for Augmentative and Alternative Communication: a prototype system , 2010, SLPAT@NAACL.

[13]  Eamonn J. Keogh,et al.  Scaling up dynamic time warping for datamining applications , 2000, KDD '00.

[14]  Sijung Hu,et al.  Augmentative and Alternative Communication (AAC) Advances: A Review of Configurations for Individuals with a Speech Disability , 2019, Sensors.

[15]  Nava Tintarev,et al.  A mobile phone based personal narrative system , 2011, ASSETS.

[16]  Sijung Hu,et al.  Breathing Pattern Interpretation as an Alternative and Effective Voice Communication Solution , 2018, Biosensors.

[17]  M. O'Reilly,et al.  Comparing two types of augmentative and alternative communication systems for children with autism , 2006, Pediatric rehabilitation.

[18]  Paul L. Rosin,et al.  Facial Dynamics in Biometric Identification , 2008, BMVC.

[19]  Susan Fager,et al.  Access to augmentative and alternative communication: new technologies and clinical decision-making. , 2012, Journal of pediatric rehabilitation medicine.

[20]  Janice Light,et al.  The Changing Face of Augmentative and Alternative Communication: Past, Present, and Future Challenges , 2012, Augmentative and alternative communication.

[21]  Ramon G. Garcia,et al.  Wearable augmentative and alternative communication device for paralysis victims using Brute Force Algorithm for pattern recognition , 2017, 2017IEEE 9th International Conference on Humanoid, Nanotechnology, Information Technology, Communication and Control, Environment and Management (HNICEM).

[22]  Janice Light,et al.  Challenges and opportunities in augmentative and alternative communication: Research and technology development to enhance communication and participation for individuals with complex communication needs , 2019, Augmentative and alternative communication.

[23]  Jean-Yves Ramel,et al.  Performance evaluation of DTW and its variants for word spotting in degraded documents , 2015, 2015 13th International Conference on Document Analysis and Recognition (ICDAR).

[24]  J. Reichle,et al.  Implementing Aided Augmentative Communication Systems With Persons Having Complex Communicative Needs , 2019, Behavior modification.