Extending Plan Inference Techniques to Recognize Intentions in Information Graphics

Plan inference techniques have been used extensively to understand natural language dialogue. But as noted by Clark[5], language and communication are more than just utterances. This paper presents the problems that we have had to address and the solutions that we have devised in designing a system to recognize intentions from information graphics. Our work is part of a larger project to develop an interactive natural language system that provides an alternative means for individuals with sight-impairments to access the content of information graphics.

[1]  James F. Allen,et al.  A Plan Recognition Model for Subdialogues in Conversations , 1987, Cogn. Sci..

[2]  LohseGerald Lee.  A cognitive model for understanding graphical perception , 1993 .

[3]  Christopher D. Wickens,et al.  The Proximity Compatibility Principle: Its Psychological Foundation and Relevance to Display Design , 1995, Hum. Factors.

[4]  Jim Hunter,et al.  Recognising Visual Patterns to Communicate Gas Turbine Time-Series Data , 2003 .

[5]  Vibhu O. Mittal.  Visual Prompts and Graphical Design: A Framework for Exploring the Design Space of 2-D Charts and Graphs , 1997, AAAI/IAAI.

[6]  Steven F. Roth,et al.  Mapping communicative goals into conceptual tasks to generate graphics in discourse , 2000, IUI '00.

[7]  S. Kosslyn.  Understanding charts and graphs , 1989 .

[8]  Bonnie E. John,et al.  Toward an Engineering Model of Stimulus-Response Compatibility , 1990 .

[9]  M. Corio,et al.  Generation of texts for information graphics , 1999 .

[10]  H. Grice.  Utterer's meaning and intentions , 1969 .

[11]  Peter B. L. Meijer,et al.  An experimental system for auditory image representations , 1992, IEEE Transactions on Biomedical Engineering.

[12]  L. Kaufman,et al.  Handbook of perception and human performance , 1986 .

[13]  Sandra Carberry,et al.  Plan Recognition in Natural Language Dialogue , 1990 .

[14]  Gerald L. Lohse,et al.  A Cognitive Model for Understanding Graphical Perception , 1993, Hum. Comput. Interact..

[15]  Ben Shneiderman,et al.  Readings in information visualization - using vision to think , 1999 .

[16]  James F. Allen,et al.  A Plan Recognition Model for Subdialogues in Conversations , 1987, Cogn. Sci..

[17]  Liliana Ardissono,et al.  Using dynamic user models in the recognition of the plans of the user , 2005, User Modeling and User-Adapted Interaction.

[18]  C. Raymond Perrault,et al.  A Plan-Based Analysis of Indirect Speech Act , 1980, CL.

[19]  Ingrid Zukerman,et al.  Bayesian Models for Keyhole Plan Recognition in an Adventure Game , 2004, User Modeling and User-Adapted Interaction.