Interactive Exploration of Behavior Datasets

Modern sensor technologies and simulators applied to large and complex dynamic systems (such as road traffic networks, sets of river channels, etc.) produce large amounts of behavior data that are difficult for users to interpret and analyze. Software tools that generate presentations combining text and graphics can help users understand this data. In this paper we describe the results of our research on automatic multimedia presentation generation (including text, graphics, maps, images, etc.) for interactive exploration of behavior datasets. We designed a novel user interface that combines automatically generated text and graphical resources. We describe the general knowledge-based design of our presentation generation tool. We also present applications that we developed to validate the method, and a comparison with related work.

[1]  Michael James O'Donnell Intermixing Multiple Discourse Strategies for Automatic Text Composition , 2000 .

[2]  Steven K. Feiner,et al.  Interactive Multimedia Explanation for Equipment Maintenance and Repair , 1990, HLT.

[3]  Albert Gatt,et al.  Using Natural Language Generation Technology to Improve Information Flows in Intensive Care Units , 2008, ECAI.

[4]  Thomas Rist,et al.  The Design of Illustrated Documents as a Planning Task , 1993, AAAI Workshop on Intelligent Multimedia Interfaces.

[5]  Johanna D. Moore,et al.  A strategy for generating evaluative arguments , 2000, INLG.

[6]  Jim Hunter,et al.  Choosing words in computer-generated weather forecasts , 2005, Artif. Intell..

[7]  Stefan Kopp,et al.  Towards integrated microplanning of language and iconic gesture for multimodal output , 2004, ICMI '04.

[8]  Chris Mellish,et al.  Choosing the content of textual summaries of large time-series data sets , 2006, Natural Language Engineering.

[9]  Timo Huttula,et al.  Wireless in-situ Sensor Network for Agriculture and Water Monitoring on a River Basin Scale in Southern Finland: Evaluation from a Data User’s Perspective , 2009, Sensors.

[10]  Paolo Traverso,et al.  Automated planning - theory and practice , 2004 .

[11]  Ramachandran Ramjee,et al.  Nericell: rich monitoring of road and traffic conditions using mobile smartphones , 2008, SenSys '08.

[12]  Parke Godfrey,et al.  An overview of cooperative answering , 1992, Journal of Intelligent Information Systems.

[13]  Johanna D. Moore,et al.  Information Presentation in Spoken Dialogue Systems , 2006, EACL.

[14]  Martin Molina,et al.  A Knowledge-Based Method for Generating Summaries of Spatial Movement in Geographic Areas , 2010, Int. J. Artif. Intell. Tools.

[15]  Allison Woodruff,et al.  Guidelines for using multiple views in information visualization , 2000, AVI '00.