What is the potential for context aware communication aids?

Abstract Use of voice output communication aids (VOCAs) can be a very effective strategy to assist people with speech impairments in communicating. Despite this, people who use communication aids often express frustration with VOCAs—desiring devices that are simpler, quicker and more effective to use. Whilst it is not possible to resolve all these issues with technology, it is argued that significant progress can be made. The use of contextual information is one development that could improve the simplicity and effectiveness of communication aid design. Improving the effectiveness of communication aids, including through the use of context support, is a goal of the NIHR Devices for Dignity Assistive Technology Theme. This discussion paper examines the potential for creating ‘context aware’ communication aids. Three projects in which the authors have been involved are described to illustrate different approaches to the use of contextual information.

[1]  Simon Judge,et al.  Switch access to technology - A comprehensive Guide. , 2006 .

[2]  Kathleen F. McCoy,et al.  Topic modeling in fringe word prediction for AAC , 2006, IUI '06.

[3]  R. Wilkinson,et al.  Acquired dysarthria in conversation: methods of resolving understandability problems. , 2011, International journal of language & communication disorders.

[4]  G. Pullin,et al.  The value of visualizing tone of voice , 2013, Logopedics, phoniatrics, vocology.

[5]  Harald Martinsen,et al.  Introduction to augmentative and alternative communication : sign teaching and the use of communication aids for children, adolescents and adults with developmental disorders , 2000 .

[6]  Janice Light,et al.  Communicative Competence for Individuals who require Augmentative and Alternative Communication: A New Definition for a New Era of Communication? , 2014, Augmentative and alternative communication.

[7]  Bernard M O'Keefe,et al.  Research priorities in augmentative and alternative communication as identified by people who use AAC and their facilitators , 2007, Augmentative and alternative communication.

[8]  Kathleen F. McCoy,et al.  The Effects of Word Prediction on Communication Rate for AAC , 2007, HLT-NAACL.

[9]  Constantine Stephanidis,et al.  Universal access in the information society , 1999, HCI.

[10]  Mark Liberman,et al.  Towards an integrated understanding of speaking rate in conversation , 2006, INTERSPEECH.

[11]  M. S. Hawley,et al.  A Voice-Input Voice-Output Communication Aid for People With Severe Speech Impairment , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[12]  Simon Judge,et al.  Users’ perceptions of communication aid design - D4D project report , 2010 .

[13]  Jeffery D. Higginbotham,et al.  Design Meets Disability , 2009 .

[14]  Nestor Garay-Vitoria,et al.  Text prediction systems: a survey , 2006, Universal Access in the Information Society.

[15]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[16]  Martine M Smith,et al.  Roles of aided communication: perspectives of adults who use AAC , 2008, Disability and rehabilitation. Assistive technology.

[17]  Brian Roark,et al.  The Application of Natural Language Processing to Augmentative and Alternative Communication , 2012, Assistive technology : the official journal of RESNA.

[18]  Simon Judge,et al.  Ambiguous keyboards for AAC , 2011 .

[19]  P. Enderby.  Introducing the therapy outcome measure for AAC services in the context of a review of other measures , 2014, Disability and rehabilitation. Assistive technology.

[20]  Kevin Caves,et al.  Access to AAC: Present, past, and future , 2007, Augmentative and alternative communication.

[21]  P. Enderby,et al.  Interventions Using High-Technology Communication Devices: A State of the Art Review , 2012, Folia Phoniatrica et Logopaedica.

[22]  Kathryn M. Yorkston,et al.  A Comparison of Standard and User Vocabulary Lists , 1988 .

[23]  Janice Murray,et al.  Augmentative and alternative communication: a review of current issues , 2009 .

[24]  Mark Hawley,et al.  A voice input voice output communication aid: what do users and therapists require? , 2010 .

[25]  Ehud Reiter,et al.  Supporting Personal Narrative for Children with Complex Communication Needs , 2012, TCHI.

[26]  I. Scott MacKenzie,et al.  Text entry using soft keyboards , 1999, Behav. Inf. Technol..

[27]  Nicola Grove,et al.  Using Storytelling to Support Children and Adults with Special Needs : Transforming lives through telling tales , 2012 .

[28]  Michael Elhadad,et al.  Using Semantic Authoring for Blissymbols Communication Boards , 2006, HLT-NAACL.

[29]  M. Clarke,et al.  Patterns of interaction between children with physical disabilities using augmentative and alternative communication systems and their peers , 2003 .

[30]  Simon P. Levine,et al.  A comparison of Mouthstick and Morse code text inputs , 1986 .

[31]  Bruce Wisenburn,et al.  An AAC Application Using Speaking Partner Speech Recognition to Automatically Produce Contextually Relevant Utterances: Objective Results , 2008, Augmentative and alternative communication.

[32]  Brian Gordon,et al.  ICU-Talk, a communication aid for intubated intensive care patients , 2002, Assets '02.

[33]  Norman Alm,et al.  Automatic generation of conversational utterances and narrative for Augmentative and Alternative Communication: a prototype system , 2010, SLPAT@NAACL.

[34]  Karen Hux,et al.  AAC menu interface: Effectiveness of active versus passive learning to master abbreviation-expansion codes , 2006, Augmentative and alternative communication.

[35]  Simon Judge,et al.  Perceptions of the design of voice output communication aids. , 2013, International journal of language & communication disorders.

[36]  John L. Arnott,et al.  Towards the improvement of Augmentative and Alternative Communication through the modelling of conversation , 2013, Comput. Speech Lang..

[37]  Anthony Dunne,et al.  Hertzian Tales: Electronic Products, Aesthetic Experience, and Critical Design , 1999 .

[38]  Jean C. Krause,et al.  Investigating alternative forms of clear speech: the effects of speaking rate and speaking mode on intelligibility. , 2002, The Journal of the Acoustical Society of America.

[39]  Kathleen F. McCoy,et al.  Trade-offs between informativeness and speed of message delivery in augmentative and alternative communication. , 2004, Journal of speech, language, and hearing research : JSLHR.

[40]  Barry Romich,et al.  A Rate Index for Augmentative and Alternative Communication , 2002, Int. J. Speech Technol..

[41]  E Moodie,et al.  Perspectives on AAC systems by the users and by their communication partners. , 1997, European journal of disorders of communication : the journal of the College of Speech and Language Therapists, London.

[42]  Annalu Waller,et al.  Developing personal identity through story telling , 2000 .