Language Generation for Multimedia Healthcare Briefings

This paper identifies issues for language generation that arose in developing a multimedia interface to healthcare data that includes coordinated speech, text and graphics. In order to produce brief speech for time-pressured caregivers, the system both combines related information into a single sentence and uses abbreviated references in speech when an unambiguous textual reference is also used. Finally, due to the temporal nature of the speech, the language generation module needs to communicate information about the ordering and duration of references to other temporal media, such as graphics, in order to allow for coordination between media.

[1]  Eduard H. Hovy,et al.  Aggregation in Natural Language Generation , 1993, EWNLG.

[2]  Julia Hirschberg,et al.  Assigning Intonational Features in Synthesized Spoken Directions , 1988, ACL.

[3]  Robert Dale,et al.  Generating referring expressions in a domain of objects and processes (language representation) , 1988 .

[4]  Michael Elhadad,et al.  Using argumentation to control lexical choice: a functional unification implementation , 1993 .

[5]  Jacques Robin,et al.  Revision-based generation of natural language summaries providing historical background: corpus-based analysis, design, implementation and evaluation , 1995 .

[6]  Mark Steedman,et al.  Representing discourse information for spoken dialogue generation , 1996 .

[7]  James Shaw,et al.  Practical Issues in Automatic Documentation Generation , 1994, ANLP.

[8]  Robert Dale.  Generating referring expressions - constructing descriptions in a domain of objects and processes , 1992, ACL-MIT press series in natural language processing.

[9]  Helmut Horacek,et al.  An Integrated View of Text Planning , 1992, NLG.

[10]  Donia Scott,et al.  Book Reviews: Generating Referring Expressions , 1994, CL.

[11]  P D Clayton,et al.  IAIMS at Columbia-Presbyterian Medical Center: accomplishments and challenges. , 1992, Bulletin of the Medical Library Association.

[12]  Scott Prevost,et al.  A semantics of contrast and information structure for specifying intonation in spoken language generation , 1996 .

[13]  Steven K. Feiner,et al.  Negotiation for automated generation of temporal multimedia presentations , 1997, MULTIMEDIA '96.

[14]  Shimei Pan,et al.  Spoken language generation in a multimedia system , 1996, Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP '96.

[15]  Steven K. Feiner,et al.  Top-down hierarchical planning of coherent visual discourse , 1997, IUI '97.

[16]  James Shaw.  Conciseness through Aggregation in Text Generation , 1995, ACL.

[17]  Steven K. Feiner,et al.  MAGIC: an experimental system for generating multimedia briefings about post-bypass patient status. , 1996, Proceedings : a conference of the American Medical Informatics Association. AMIA Fall Symposium.