Content-based visualization for intelligent problem-solving environments

Mechanisms are proposed to allow visualization to become an active agent in the problem-solving environment. Two main problems are addressed: dealing with too much data and allowing simulation steering. The agent solves these problems by extracting semantically interesting data for spatial and temporal understanding, enabling a dynamic and flexible behavior for simulation-integrated control, and intelligently creating visualizations that intuitively display the selected data. A significant event language is proposed to capture the semantically interesting data through event expressions which can then be parsed and monitored. Behavior is achieved through programmable, hierarchical finite-state machines with events mapped to the arcs and interactions with the visualization and simulation mapped to the nodes. A knowledge-based data mapping process has been designed which uses visual perceptual knowledge and problem-specific knowledge represented in cognitive maps to create visualizations. This architecture has been applied within a watershed simulation application and a prototype has been developed.

[1]  Ken Brodlie,et al.  GRASPARC-A problem solving environment integrating computation and visualization , 1993, Proceedings Visualization '93.

[2]  B. H. McCormick,et al.  Visualization in scientific computing , 1995 .

[3]  Arie E. Kaufman Guest Editor's Introduction: Visualization , 1994 .

[4]  Jeffrey D. Ullman,et al.  Introduction to Automata Theory, Languages and Computation , 1979 .

[5]  Drew McDermott,et al.  Introduction to artificial intelligence , 1986, Addison-Wesley series in computer science.

[6]  Christopher K. McKenna Quantitative methods for public decision making , 1980 .

[7]  Jock D. Mackinlay,et al.  Automating the design of graphical presentations of relational information , 1986, TOGS.

[8]  Bart Kosko,et al.  Fuzzy Cognitive Maps , 1986, Int. J. Man Mach. Stud..

[9]  D. Scott Dyer,et al.  A dataflow toolkit for visualization , 1990, IEEE Computer Graphics and Applications.

[10]  Ulrich Lang,et al.  Integration of visualization and scientific calculation in a software system , 1991, Proceeding Visualization '91.

[11]  Ross T. Whitaker,et al.  Achieving direct volume visualization with interactive semantic region selection , 1991, Proceeding Visualization '91.

[12]  Alex T. Pang Spray rendering , 1994, IEEE Computer Graphics and Applications.

[13]  S. Mitra,et al.  Specification and automated implementation of coordination protocols in distributed controls for flexible manufacturing cells , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[14]  Bart Kosko,et al.  Virtual Worlds as Fuzzy Cognitive Maps , 1993, Presence: Teleoperators & Virtual Environments.

[15]  T. Gomi,et al.  Behavior-based AI techniques for vehicle control , 1993, Proceedings of VNIS '93 - Vehicle Navigation and Information Systems Conference.

[16]  Hikmet Senay,et al.  A knowledge-based system for visualization design , 1994, IEEE Computer Graphics and Applications.

[17]  Steven K. Feiner,et al.  AutoVisual: rule-based design of interactive multivariate visualizations , 1993, IEEE Computer Graphics and Applications.

[18]  David H. Laidlaw,et al.  The application visualization system: a computational environment for scientific visualization , 1989, IEEE Computer Graphics and Applications.

[19]  Michael Mahmoud Marefat,et al.  Dynamic, Simulation-Integrated, Intelligent Visualization: Methodology and Applications to Ecosystem Simulation , 1995 .