Answering it with Charts: Dialogue in Natural Language and Charts

A methodology is proposed for taking queries and requests expressed in natural language as input and answering them in charts through organizing that interaction into felicitous dialogue. Charts and graphics, as well as languages, are important modes of communication. This is especially true of those which are used frequently when people analyze huge amount of data interactively, in order to find out its characteristics or to resolve questions about it. This paper raises the problem that in such situations the correctness of the charts depends on the context, and proposes a framework to resolve it. The core of the framework is a logical form that includes the specifications of the user's perspective and the proper treatment of the logical form for handling utterance fragments. The framework has been implemented and confirmed to be appropriate.

[1]  Johanna D. Moore,et al.  A Media-Independent Content Language for Integrated Text and Graphics Generation , 1998 .

[2]  William A. Woods,et al.  Semantics and Quantification in Natural Language Question Answering , 1986, Adv. Comput..

[3]  Vibhu O. Mittal.  Visual Prompts and Graphical Design: A Framework for Exploring the Design Space of 2-D Charts and Graphs , 1997, AAAI/IAAI.

[4]  Stephen M. Casner,et al.  Task-analytic approach to the automated design of graphic presentations , 1991, TOGS.

[5]  Jade Goldstein-Stewart,et al.  Interactive graphic design using automatic presentation knowledge , 1994, CHI '94.

[6]  Johanna D. Moore,et al.  Saying it in graphics: from intentions to visualizations , 1998, Proceedings IEEE Symposium on Information Visualization (Cat. No.98TB100258).

[7]  Gene Zelazny.  Say It With Charts: The Executive's Guide to Visual Communication , 2001 .

[8]  Steven F. Roth,et al.  Data characterization for intelligent graphics presentation , 1990, CHI '90.

[9]  Guy Lapalme,et al.  PostGraphe: A System for the Generation of Statistical Graphics and Text , 1996, INLG.

[10]  Jock D. Mackinlay,et al.  Automating the design of graphical presentations of relational information , 1986, TOGS.

[11]  Mitsunori Matsushita,et al.  A frame representation of user requirements for automated data visualization , 2000 .

[12]  Gary G. Hendrix,et al.  Developing a natural language interface to complex data , 1977, TODS.

[13]  Steven F. Roth,et al.  Graphics and natural language as components of automatic explanation , 1991 .

[14]  Jaime G. Carbonell,et al.  Recovery Strategies for Parsing Extragrammatical Language , 1983, CL.

[15]  Mitsunori Matsushita,et al.  Criteria to Choose Appropriate Graph-Types , 2000, PRICAI.

[16]  Steven F. Roth,et al.  Graphics and Natural Language as Components of Automatic Explanation , 1988, SGCH.