Automatic generation of conversational utterances and narrative for Augmentative and Alternative Communication: a prototype system

We detail the design, development and evaluation of Augmentative and Alternative Communication (AAC) software which encourages rapid conversational interaction. The system uses Natural Language Generation (NLG) technology to automatically generate conversational utterances from a domain knowledge base modelled from content suggested by a small AAC user group. Findings from this work are presented along with a discussion about how NLG might be successfully applied to conversational AAC systems in the future.

[1]  Bruce Wisenburn,et al.  An AAC Application Using Speaking Partner Speech Recognition to Automatically Produce Contextually Relevant Utterances: Objective Results , 2008, Augmentative and alternative communication.

[2]  Emiel Krahmer,et al.  Plan-based vs. template-based NLG: a false opposition? , 1999 .

[3]  Chris Mellish,et al.  The semantic web as a Linguistic resource: Opportunities for natural language generation , 2005, Knowl. Based Syst..

[4]  Robert Stevens,et al.  Editing OWL through Generated CNL , 2009, CNL.

[5]  Ion Androutsopoulos,et al.  NaturalOWL : Generating Texts from OWL Ontologies in Protege and in Second Life , 2008, ECAI 2008.

[6]  D. Jeffery Higginbotham,et al.  Use of nondisabled subjects in AAC research: Confessions of a research infidel , 1995 .

[7]  Kim Adams,et al.  The effect of context priming and task type on augmentative communication performance , 2009, Augmentative and alternative communication.

[8]  Norman Alm,et al.  Modelling conversational pragmatics in communication aids , 2003 .

[9]  John Todman,et al.  Rate and quality of conversations using a text-storage AAC system: Single-case training study , 2000 .

[10]  Dan Brickley,et al.  FOAF Vocabulary Specification , 2004 .

[11]  Janice Light,et al.  Attitudes toward Individuals Who Use Augmentative and Alternative Communication: Research Review , 2005 .

[12]  John Todman,et al.  Effect of Pre-utterance Pause Length on Perceptions of Communicative Competence in AAC-Aided Social Conversations , 2003 .

[13]  Ehud Reiter,et al.  Book Reviews: Building Natural Language Generation Systems , 2000, CL.

[14]  Annalu Waller.  Providing narratives in an augmentative communication system. , 1992 .

[15]  Kathleen F. McCoy,et al.  Compansion: From research prototype to practical integration , 1998, Natural Language Engineering.

[16]  Kevin Caves,et al.  Access to AAC: Present, past, and future , 2007, Augmentative and alternative communication.

[17]  C. Mason,et al.  Augmentative–Alternative Communication , 2010 .

[18]  Vangelis Karkaletsis,et al.  Enriching OWL Ontologies with Linguistic and User-Related Annotations: The ELEON System , 2007, 19th IEEE International Conference on Tools with Artificial Intelligence(ICTAI 2007).

[19]  Janice Light,et al.  Interaction involving individuals using augmentative and alternative communication systems: State of the art and future directions , 1988 .

[20]  Emiel Krahmer,et al.  Squibs and Discussions: Real versus Template-Based Natural Language Generation: A False Opposition? , 2005, CL.

[21]  John Todman,et al.  Single-case and Small-n Experimental Designs : A Practical Guide To Randomization Tests , 2001 .

[22]  Janice Light,et al.  “I have chosen to live life abundantly”: Perceptions of leisure by adults who use Augmentative and Alternative Communication , 2008, Augmentative and alternative communication.

[23]  Erland Hjelmquist,et al.  Language and literacy in nonvocal children with cerebral palsy , 1997 .

[24]  Norman Alm,et al.  Using NLG to Help Language-Impaired Users Tell Stories and Participate in Social Dialogues , 2009, ENLG.

[25]  Emiel Krahmer,et al.  Proceedings of the 12th European Workshop on Natural Language Generation , 2009 .

[26]  Michael Elhadad,et al.  Using Semantic Authoring for Blissymbols Communication Boards , 2006, HLT-NAACL.