Visualization of state transition graphs

State transition graphs are important in computer science and engineering where they are used to analyze the behavior of computer-based systems. In such a graph nodes represent states a system can be in. Links, or directed edges, represent transitions between states. Research in visualization investigates the application of interactive computer graphics to understand large and complex data sets. Large state transition graphs fall into this category. They often contain tens of thousands of nodes, or more, and tens to hundreds of thousands of edges. Also, they describe system behavior at a low abstraction level. This hinders analysis and insight. This dissertation presents a number of techniques for the interactive visualization of state transition graphs. Much of the work takes advantage of multivariate data associated with nodes and edges. Using an experimental approach, several new methods were developed in close collaboration with a number of users. The following approaches were pursued: • Selection and projection. This technique provides the user with visual support to select a subset of node attributes. Consequently, the state transition graph is projected to 2D and visualized in a second, correlated visualization. • Attribute-based clustering. By specifying subsets of node attributes and clustering based on these, the user generates simplified abstractions of a state transition graph. Clustering generates hierarchical, relational, and metric data, which are represented in a single visualization. • User-defined diagrams. With this technique the user investigates state transition graphs with custom diagrams. Diagrams are parameterized by linking their graphical properties to the data. Diagrams are integrated in a number of correlated visualizations. • Multiple views on traces. System traces are linear paths in state transition graphs. This technique provides the user with different perspectives on traces. • Querying nodes and edges. Direct manipulation enables the user to interactively inspect and query state transition graphs. In this way relations and patterns can be investigated based on data associated with nodes and edges. This dissertation shows that interactive visualization can play a role during the analysis of state transition graphs. The ability to interrogate visual representations of such graphs allows users to enhance their knowledge of the modeled systems. It is shown how the above techniques enable users to answer questions about their data. A number of case studies, developed in collaboration with system analysts, are presented. Finally, solutions to challenges encountered during the development of the visualization techniques are discussed. Insights generic to the field of visualization are considered and directions for future work are recommended.

[1]  Donald A. Norman,et al.  Things That Make Us Smart: Defending Human Attributes In The Age Of The Machine , 1993 .

[2]  Martin Wattenberg,et al.  Visual exploration of multivariate graphs , 2006, CHI.

[3]  Manojit Sarkar,et al.  Graphical fisheye views of graphs , 1992, CHI.

[4]  Beat Kleiner,et al.  Graphical Methods for Data Analysis , 1983 .

[5]  S J Hage,et al.  What's wrong with this picture? , 1994, Radiology management.

[6]  Ben Shneiderman,et al.  The eyes have it: a task by data type taxonomy for information visualizations , 1996, Proceedings 1996 IEEE Symposium on Visual Languages.

[7]  Wil M. P. van der Aalst,et al.  Assessing State Spaces Using Petri-Net Synthesis and Attribute-Based Visualization , 2008, Trans. Petri Nets Other Model. Concurr..

[8]  Catherine Plaisant,et al.  The challenge of information visualization evaluation , 2004, AVI.

[9]  Wan Fokkink,et al.  Model checking a cache coherence protocol for a Java DSM implementation , 2003, Proceedings International Parallel and Distributed Processing Symposium.

[10]  David Hillel Gelernter Machine Beauty: Elegance And The Heart Of Technology , 1998 .

[11]  Jarke J. van Wijk,et al.  Bringing Computational Steering to the User , 1997, Scientific Visualization Conference (dagstuhl '97).

[12]  Matthew O. Ward,et al.  XmdvTool: integrating multiple methods for visualizing multivariate data , 1994, Proceedings Visualization '94.

[13]  Colin Ware,et al.  Information Visualization: Perception for Design , 2000 .

[14]  Ka Lok Man,et al.  Syntax and consistent equation semantics of hybrid Chi , 2006, J. Log. Algebraic Methods Program..

[15]  C. A. R. Hoare,et al.  Communicating sequential processes , 1978, CACM.

[16]  Michael Leuschel,et al.  Visualising Larger State Spaces in Pro B , 2005, ZB.

[17]  Eamonn J. Keogh,et al.  Visualizing and Discovering Non-Trivial Patterns in Large Time Series Databases , 2005, Inf. Vis..

[18]  Eamonn J. Keogh,et al.  A symbolic representation of time series, with implications for streaming algorithms , 2003, DMKD '03.

[19]  Daniel Asimov,et al.  The grand tour: a tool for viewing multidimensional data , 1985 .

[20]  Edsger W. Dijkstra,et al.  The humble programmer , 1972, CACM.

[21]  A. Johannes Pretorius,et al.  Verified Design of an Automated Parking Garage , 2006, FMICS/PDMC.

[22]  Marc Alexa,et al.  Visualizing time-series on spirals , 2001, IEEE Symposium on Information Visualization, 2001. INFOVIS 2001..

[23]  Stephen G. Eick,et al.  Space-filling Software Visualization , 1995, J. Vis. Lang. Comput..

[24]  Jarke J. van Wijk,et al.  Interactive Visualization of State Transition Systems , 2002, IEEE Trans. Vis. Comput. Graph..

[25]  Wan Fokkink,et al.  Introduction to Process Algebra , 1999, Texts in Theoretical Computer Science. An EATCS Series.

[26]  Orna Grumberg,et al.  Abstract interpretation of reactive systems , 1997, TOPL.

[27]  Jan Friso Groote,et al.  The Formal Specification Language mCRL2 , 2006, MMOSS.

[28]  Martin Wattenberg,et al.  Sketching a graph to query a time-series database , 2001, CHI Extended Abstracts.

[29]  Jarke J. van Wijk,et al.  Visual Analysis of Multivariate State Transition Graphs , 2006, IEEE Transactions on Visualization and Computer Graphics.

[30]  Ramana Rao,et al.  The table lens: merging graphical and symbolic representations in an interactive focus + context visualization for tabular information , 1994, CHI '94.

[31]  M. Sheelagh T. Carpendale,et al.  ArcTrees: Visualizing Relations in Hierarchical Data , 2005, EuroVis.

[32]  Karel Vredenburg,et al.  The state of user-centered design practice , 2005, IEEE Engineering Management Review.

[33]  Emden R. Gansner,et al.  An open graph visualization system and its applications to software engineering , 2000 .

[34]  Bruce H. McCormick,et al.  Visualization: expanding scientific and engineering research opportunities , 1989, Computer.

[35]  Thierry Jéron,et al.  3D Layout of Reachability Graphs of Communicating Processes , 1994, Graph Drawing.

[36]  H. W. A. M. van Rooy,et al.  Model Based Engineering of a Paint Factory with Supervisory Control Theory , 2007 .

[37]  Ben Shneiderman,et al.  Readings in information visualization - using vision to think , 1999 .

[38]  Alfred Inselberg,et al.  Parallel coordinates: a tool for visualizing multi-dimensional geometry , 1990, Proceedings of the First IEEE Conference on Visualization: Visualization `90.

[39]  H. L. Resnikoff The illusion of reality , 1988 .

[40]  Bonnie A. Nardi,et al.  Beyond Models and Metaphors: Visual Formalisms in User Interface Design , 1993, J. Vis. Lang. Comput..

[41]  Joseph Bentsman,et al.  Nonlinear control oriented boiler modeling-a benchmark problem for controller design , 1996, IEEE Trans. Control. Syst. Technol..

[42]  Sougata Mukherjea,et al.  Glyphmaker: creating customized visualizations of complex data , 1994, Computer.

[43]  Ben Shneiderman,et al.  Dynamic Query Tools for Time Series Data Sets: Timebox Widgets for Interactive Exploration , 2004, Inf. Vis..

[44]  Ben Shneiderman,et al.  Tree visualization with tree-maps: 2-d space-filling approach , 1992, TOGS.

[45]  Ioannis G. Tollis,et al.  On the Edge Label Placement Problem , 1996, GD.

[46]  Eser Kandogan,et al.  Visualizing multi-dimensional clusters, trends, and outliers using star coordinates , 2001, KDD '01.

[47]  Jacques Bertin,et al.  Graphics and graphic information-processing , 1981 .

[48]  Jan Friso Groote,et al.  A Formal Verification of the Alternating Bit Protocol in the Calculus of Constructions , 1993 .

[49]  Frits W. Vaandrager,et al.  Model checker aided design of a controller for a wafer scanner , 2006, International Journal on Software Tools for Technology Transfer.

[50]  André Arnold,et al.  Finite transition systems - semantics of communicating systems , 1994, Prentice Hall international series in computer science.

[51]  Gul A. Agha Computing in pervasive cyberspace , 2008, CACM.

[52]  Chris North,et al.  Toward measuring visualization insight , 2006, IEEE Computer Graphics and Applications.

[53]  Jarke J. van Wijk,et al.  Multiple Views on System Traces , 2008, 2008 IEEE Pacific Visualization Symposium.

[54]  Lisa Tweedie,et al.  Characterizing interactive externalizations , 1997, CHI.

[55]  Kristin A. Cook,et al.  Illuminating the Path: The Research and Development Agenda for Visual Analytics , 2005 .

[56]  Ben Shneiderman,et al.  Strategies for evaluating information visualization tools: multi-dimensional in-depth long-term case studies , 2006, BELIV '06.

[57]  Daniel A. Keim,et al.  Importance-driven visualization layouts for large time series data , 2005, IEEE Symposium on Information Visualization, 2005. INFOVIS 2005..

[58]  Yvonne Rogers,et al.  Interaction Design: Beyond Human-Computer Interaction. Second Edition , 2007 .

[59]  Matthew O. Ward,et al.  Visual Hierarchical Dimension Reduction for Exploration of High Dimensional Datasets , 2003, VisSym.

[60]  Bernard Kerr Thread Arcs: an email thread visualization , 2003, IEEE Symposium on Information Visualization 2003 (IEEE Cat. No.03TH8714).

[61]  Angela B. Shiflet,et al.  Introduction to Computational Science: Modeling and Simulation for the Sciences , 2006 .

[62]  Jarke J. van Wijk,et al.  Multidimensional visualization of transition systems , 2005, Ninth International Conference on Information Visualisation (IV'05).

[63]  P Beatty,et al.  Bridging the gaps. , 1990, Hospital trustee.

[64]  Ben Shneiderman,et al.  Network Visualization by Semantic Substrates , 2006, IEEE Transactions on Visualization and Computer Graphics.

[65]  Alexander Wolff,et al.  A Combinatorial Framework for Map Labeling , 1998, Graph Drawing.

[66]  Tamara Munzner,et al.  GrouseFlocks: Steerable Exploration of Graph Hierarchy Space , 2008, IEEE Transactions on Visualization and Computer Graphics.

[67]  B. Marx The Visual Display of Quantitative Information , 1985 .

[68]  J. V. van Wijk,et al.  Cluster and calendar based visualization of time series data , 1999, Proceedings 1999 IEEE Symposium on Information Visualization (InfoVis'99).

[69]  Ivan Herman,et al.  Graph Visualization and Navigation in Information Visualization: A Survey , 2000, IEEE Trans. Vis. Comput. Graph..

[70]  Barbara Tversky,et al.  Animation: can it facilitate? , 2002, Int. J. Hum. Comput. Stud..

[71]  J. V. van Wijk,et al.  Beamtrees: compact visualization of large hierarchies , 2002, IEEE Symposium on Information Visualization, 2002. INFOVIS 2002..

[72]  Tony Curzon Price,et al.  Emergence: From Chaos to Order by John H. Holland , 1998, J. Artif. Soc. Soc. Simul..

[73]  Jarke J. van Wijk,et al.  Eurographics/ Ieee-vgtc Symposium on Visualization 2008 Visual Inspection of Multivariate Graphs , 2022 .

[74]  Martin Wattenberg,et al.  Arc diagrams: visualizing structure in strings , 2002, IEEE Symposium on Information Visualization, 2002. INFOVIS 2002..

[75]  Robert L. Glass,et al.  Sorting out software complexity , 2002, CACM.

[76]  Tamara Munzner,et al.  LiveRAC: interactive visual exploration of system management time-series data , 2008, CHI.

[77]  Jarke J. van Wijk,et al.  Supporting the analytical reasoning process in information visualization , 2008, CHI.

[78]  Penny Rheingans,et al.  NIH/NSF Visualization Research Challenges , 2005 .

[79]  John A. Hartigan,et al.  Clustering Algorithms , 1975 .

[80]  Stefan Berchtold,et al.  Similarity clustering of dimensions for an enhanced visualization of multidimensional data , 1998, Proceedings IEEE Symposium on Information Visualization (Cat. No.98TB100258).

[81]  Pak Chung Wong,et al.  Dynamic visualization of graphs with extended labels , 2005, IEEE Symposium on Information Visualization, 2005. INFOVIS 2005..

[82]  Colin Ware Designing with a 2 1/2-D Attitude , 2001 .

[83]  Ben Shneiderman,et al.  Knowledge discovery in high-dimensional data: case studies and a user survey for the rank-by-feature framework , 2006, IEEE Transactions on Visualization and Computer Graphics.

[84]  Ben Shneiderman,et al.  A Rank-by-Feature Framework for Interactive Exploration of Multidimensional Data , 2005, Inf. Vis..

[85]  Jarke J. van Wijk,et al.  Bridging the Semantic Gap: Visualizing Transition Graphs with User-Defined Diagrams , 2007, IEEE Computer Graphics and Applications.

[86]  Ted Mihalisin,et al.  Visualization and analysis of multi-variate data: a technique for all fields , 1991, Proceeding Visualization '91.

[87]  Jan Friso Groote,et al.  µCRL: A Toolset for Analysing Algebraic Specifications , 2001, CAV.

[88]  Yvonne Rogers,et al.  External cognition: how do graphical representations work? , 1996, Int. J. Hum. Comput. Stud..