Compositional Language Modeling for Icon-Based Augmentative and Alternative Communication

Icon-based communication systems are widely used in the field of Augmentative and Alternative Communication. Typically, icon-based systems have lagged behind word- and character-based systems in terms of predictive typing functionality, due to the challenges inherent to training icon-based language models. We propose a method for synthesizing training data for use in icon-based language models, and explore two different modeling strategies. We propose a method to generate language models for corpus-less symbol-set.

[1]  C. Shewan,et al.  Augmentative and Alternative Communication , 2020, Encyclopedia of Education and Information Technologies.

[2]  Stephen N. Calculator,et al.  Roles and responsibilities of speech-language pathologists with respect to augmentative and alternative communication: Technical report , 2004 .

[3]  Nestor Garay-Vitoria,et al.  Text prediction systems: a survey , 2006, Universal Access in the Information Society.

[4]  D. Beukelman,et al.  Augmentative & Alternative Communication: Supporting Children & Adults With Complex Communication Needs , 2006 .

[5]  Kathryn Drager,et al.  AAC technologies for young children with complex communication needs: State of the science and future research directions , 2007, Augmentative and alternative communication.

[6]  Marc Brysbaert,et al.  Moving beyond Kučera and Francis: A critical evaluation of current word frequency norms and the introduction of a new and improved word frequency measure for American English , 2009, Behavior research methods.

[7]  Teresa Iacono,et al.  Non-electronic communication aids for people with complex communication needs , 2011, International journal of speech-language pathology.

[8]  Rupal Patel,et al.  Message formulation, organization, and navigation schemes for icon-based communication aids , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[9]  Per Ola Kristensson,et al.  The Imagination of Crowds: Conversational AAC Language Modeling using Crowdsourcing and Large Data Sources , 2011, EMNLP.

[10]  Rupal Patel,et al.  Non-Syntactic Word Prediction for AAC , 2012, SLPAT@HLT-NAACL.

[11]  Rupal Patel,et al.  SymbolPath: a continuous motion overlay module for icon-based assistive communication , 2012, ASSETS '12.

[12]  Brian Roark,et al.  RSVP keyboard: An EEG based typing interface , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[13]  Tao Chen,et al.  Creating a live, public short message service corpus: the NUS SMS corpus , 2011, Lang. Resour. Evaluation.

[14]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[15]  Sanja Fidler,et al.  Skip-Thought Vectors , 2015, NIPS.

[16]  Ido Dagan,et al.  context2vec: Learning Generic Context Embedding with Bidirectional LSTM , 2016, CoNLL.