CABA2L A Bliss Predictive Composition Assistant for AAC Communication Software

In order to support the residual communication capabilities of verbal impaired peoples softwares allowing Augmentative and Alternative Communication (AAC) have been developed. AAC communication software aids provide verbal disables with an electronic table of AAC languages (i.e. Bliss, PCS, PIC, etc.) symbols in order to compose messages, exchange them via email, or vocally synthetize them, and so on. A current open issue, in thins kind of software, regards human-computer interaction in verbal impaired people suffering motor disorders. They can adopt only ad-hoc input device, such as buttons or switches, which require an intelligent automatic scansion of the AAC symbols table in order to compose messages. In such perspective we have developed Caba2l an innovative composition assistant exploiting an user linguistic behavior model adopting a semantic/probabilistic approach for predictive Bliss symbols scansion. Caba2l is based on an original discrete implementation of auto-regressive hidden Markov model called DAR-HMM and it is able to predict a list of symbols as the most probable ones according to both the previous selected symbol and the semantic categories associated to the symbols. We have implemented the composition assistant as a component of Bliss2003 an AAC communication software centered on Bliss language and experimentally validated it with both synthetic and real data.

[1]  Sarah W. Blackstone,et al.  Augmentative communication : an introduction , 1986 .

[2]  Marvin Minsky,et al.  Semantic Information Processing , 1968 .

[3]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[4]  H H Koester,et al.  Learning and performance of able-bodied individuals using scanning systems with and without word prediction. , 1994, Assistive technology : the official journal of RESNA.

[5]  H. Chertkow,et al.  Semantic memory , 2002, Current neurology and neuroscience reports.

[6]  Rich Caruana,et al.  Overfitting in Neural Nets: Backpropagation, Conjugate Gradient, and Early Stopping , 2000, NIPS.

[7]  Biing-Hwang Juang,et al.  The segmental K-means algorithm for estimating parameters of hidden Markov models , 1990, IEEE Trans. Acoust. Speech Signal Process..

[8]  Hsiao-Yu Lee,et al.  Wireless communication for speech impaired subjects via portable augmentative and alternative system , 2001, 2001 Conference Proceedings of the 23rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[9]  Alan F. Newell,et al.  Adaptive and predictive techniques in a communication prosthesis , 1987 .

[10]  Gregory W. Lesher,et al.  Techniques for augmenting scanning communication , 1998 .

[11]  H H Koester,et al.  Adaptive one-switch row-column scanning. , 1999, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[12]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[13]  Klaus-Robert Müller,et al.  Asymptotic statistical theory of overtraining and cross-validation , 1997, IEEE Trans. Neural Networks.

[14]  Zoubin Ghahramani,et al.  An Introduction to Hidden Markov Models and Bayesian Networks , 2001, Int. J. Pattern Recognit. Artif. Intell..

[15]  Lawrence R. Rabiner,et al.  A segmental k-means training procedure for connected word recognition , 1986, AT&T Technical Journal.

[16]  H. Johnson,et al.  A statewide demographic survey of people with severe communication impairments , 1990 .

[17]  Jeff A. Bilmes,et al.  A gentle tutorial of the em algorithm and its application to parameter estimation for Gaussian mixture and hidden Markov models , 1998 .

[18]  J. Fodor.  The Modularity of mind. An essay on faculty psychology , 1986 .