A general framework for visualizing abstract objects and relations

Pictorial representations significantly enhance our ability to understand complicated relations and structures, which means that information systems strongly require user interfaces that support the visualization of many kinds of information with a wide variety of graphical forms. At present, however, these difficult visualization problems have not been solved. We present a visualization framework for translating abstract objects and relations, typically represented in textual forms, into pictorial representations, and describe a general visualization interface based on this framework. In our framework, abstract objects and relations are mapped to graphical objects and relations by user-defined mapping rules. The kernel of our visualization process is to determine a layout of graphical objects under geometric constraints. A constraint-based object layout system named COOL has been developed to handle this layout problem. COOL introduces the concept of rigidity of constraints in order to reasonably handle, a set of conflicting constraints by use of the least squares method. As applications of our system, we show the generation of kinship diagrams, list diagrams, Nassi-Shneiderman diagrams, and entity-relationship diagrams.

[1]  Pascal Van Hentenryck Constraint satisfaction in logic programming , 1989, Logic programming.

[2]  Carlo Batini,et al.  An Algorithm for Automatic Layout of Entity-Relationship Diagrams , 1983, ER.

[3]  Alan Borning,et al.  Constraint-Based Tools for Building User Interfaces , 1986, ACM Trans. Graph..

[4]  O. Ferstl,et al.  Flowcharting by stepwise refinement , 1978, SIGP.

[5]  Carlo Batini,et al.  Automatic graph drawing and readability of diagrams , 1988, IEEE Trans. Syst. Man Cybern..

[6]  Robert Sedgewick,et al.  A system for algorithm animation , 1984, SIGGRAPH.

[7]  Ned Chapin New format for flowcharts , 1974, Softw. Pract. Exp..

[8]  James A. Larson Visual Languages for Database Users , 1986 .

[9]  Brad A. Myers,et al.  Creating user interfaces by demonstration , 1988 .

[10]  Joxan Jaffar,et al.  From Unification to Constraints , 1987, LP.

[11]  Donald E. Knuth,et al.  Computer-drawn flowcharts , 1963, CACM.

[12]  Jon M. Kerridge,et al.  Three solutions for a robot arm controller using Pascal‐Plus, occam and edison , 1984, Softw. Pract. Exp..

[13]  Ewan Klein,et al.  GRAFLOG: Understanding Drawings through Natural Language , 1988, Comput. Graph. Forum.

[14]  Alan Borning,et al.  The Programming Language Aspects of ThingLab, a Constraint-Oriented Simulation Laboratory , 1981, TOPL.

[15]  L.M. Burns,et al.  A graphical entity-relationship database browser , 1988, [1988] Proceedings of the Twenty-First Annual Hawaii International Conference on System Sciences. Volume II: Software track.

[16]  Michael J. Maher,et al.  Constraint Hierarchies and Logic Programming , 1989, ICLP.

[17]  Satoru Kawai,et al.  An enhanced treatment of hidden lines , 1987, TOGS.

[18]  Brian W. Kernighan,et al.  A system for algorithm animation tutorial and user manual , 1990 .

[19]  Frank Zdybel,et al.  An Information Presentation System , 1981, IJCAI.

[20]  Murray Hill,et al.  Yacc: Yet Another Compiler-Compiler , 1978 .

[21]  Marc H. Brown,et al.  Algorithm animation , 1988 .

[22]  Jock D. Mackinlay,et al.  Automating the design of graphical presentations of relational information , 1986, TOGS.

[23]  Robert P. Colwell,et al.  Instruction Sets and Beyond: Computers, Complexity, and Controversy , 1985, Computer.

[24]  J. M. da Mata ALLENDE: A Procedural Language for the Hierarchical Specification of VLSI Layouts , 1985, DAC 1985.

[25]  Nan C. Shu,et al.  Visual Programming: Perspectives and Approaches , 1989, IBM Syst. J..

[26]  Satoru Kawai,et al.  Advanced graphics for visualization of shielding relations , 1988, Comput. Vis. Graph. Image Process..

[27]  Günter Enderle,et al.  Computer graphics programming: GKS, the graphics standard, 2nd rev. ed. , 1986 .

[28]  EMANUEL DERMAN,et al.  A simple equation solver and its application to financial modelling , 1984, Softw. Pract. Exp..

[29]  Brian W. Kernighan,et al.  PIC — A language for typesetting graphics , 1982, Softw. Pract. Exp..

[30]  Terry Winograd,et al.  Language as a Cognitive Process , 1983, CL.

[31]  Robert A. Duisberg,et al.  Animation Using Temporal Constraints: an Overview of the Animus System , 1987, SGCH.

[32]  David H. Laidlaw,et al.  The application visualization system: a computational environment for scientific visualization , 1989, IEEE Computer Graphics and Applications.

[33]  John Alan Roach The Rectangle Placement Language , 1984, 21st Design Automation Conference Proceedings.

[34]  B. Kernighan PIC — A language for typesetting graphics , 1981, Softw. Pract. Exp..

[35]  Bjørn N. Freeman-Benson,et al.  Constraint hierarchies , 1987, OOPSLA '87.

[36]  Bradley T. Vander Zanden Incremental Constraint Satisfaction and its Application to Graphical Interfaces , 1988 .

[37]  鎌田 富久 On visualization of abstract objects and relations , 1989 .

[38]  Brad A. Myers,et al.  A user interface toolkit based on graphical objects and constraints , 1988, OOPSLA 1988.

[39]  Hahn,et al.  Tools for Automted Statistical Graphics , 1981, IEEE Computer Graphics and Applications.

[40]  José Monteiro da Mata ALLENDE: A Procedural Language for the Hierarchical Specification of VLSI Layouts , 1985, 22nd ACM/IEEE Design Automation Conference.

[41]  Y. Futamura,et al.  Development of computer programs by problem analysis Diagram(PAD) , 1981, ICSE '81.

[42]  Georg Raeder A Survey of Current Graphical Programming Techniques , 1985, Computer.

[43]  Luis A. Pineda,et al.  GRAFLOG: Programming with Interactive Graphics and PROLOG , 1988 .

[44]  Satoru Kawai,et al.  An Algorithm for Drawing General Undirected Graphs , 1989, Inf. Process. Lett..

[45]  C. R. Rao,et al.  Linear Statistical Inference and its Applications , 1968 .

[46]  Alan Borning Graphically Defining New Building Blocks in Thinglab , 1987, SGCH.

[47]  Greg Nelson,et al.  Juno, a constraint-based graphics system , 1985, SIGGRAPH.

[48]  Peter P. Chen The entity-relationship model: toward a unified view of data , 1975, VLDB '75.

[49]  Luis A. Pineda A Compositional Semantics for Graphics , 1988, Eurographics.

[50]  Jonathan Slocum,et al.  A Survey of Machine Translation: Its History, Current Status and Future Prospects , 1985, CL.

[51]  Alain Colmerauer,et al.  Opening the Prolog III universe , 1987 .

[52]  Takao Shimomura A Method for Automatically Generating Business Graphs , 1983, IEEE Computer Graphics and Applications.

[53]  Brad A. Myers,et al.  A user interface toolkit based on graphical objects and constraints , 1988, OOPSLA '88.

[54]  Gerald Jay Sussman,et al.  CONSTRAINTS - A Language for Expressing Almost-Hierarchical Descriptions , 1980, Artif. Intell..

[55]  James Arthur Gosling,et al.  Algebraic constraints , 1983 .

[56]  Stuart C. Shapiro,et al.  Automatic Construction of User-Interface Displays , 1988, AAAI.

[57]  Peter P. Chen The Entity-Relationship Model: Towards a unified view of Data , 1976 .

[58]  Günter Enderle,et al.  Computer graphics programming: GKS, the graphics standard , 1984, Symbolic computation.

[59]  Calyampudi R. Rao,et al.  Linear Statistical Inference and Its Applications. , 1975 .

[60]  M. Konopasek,et al.  Constraint and declarative languages for engineering applications: The TK!Solver contribution , 1985, Proceedings of the IEEE.

[61]  Ivan E. Sutherland,et al.  Sketchpad a Man-Machine Graphical Communication System , 1899, Outstanding Dissertations in the Computer Sciences.

[62]  Wallace W. Tourtellotte,et al.  Interaction , 1988 .

[63]  Satoru Kawai,et al.  A simple method for computing general position in displaying three-dimensional objects , 1988, Comput. Vis. Graph. Image Process..

[64]  William Leler,et al.  Constraint programming languages: their specification and generation , 1988 .

[65]  B. Shneiderman,et al.  Flowchart techniques for structured programming , 1973, SIGP.

[66]  Bjørn N. Freeman-Benson,et al.  Constraint Hierarchies , 1992, LISP Symb. Comput..

[67]  Joxan Jaffar,et al.  Constraint logic programming , 1987, POPL '87.

[68]  Robert H. Henry,et al.  Automatic layout of large directed graphs , 1988 .

[69]  Shi-Kuo Chang,et al.  Visual Languages: A Tutorial and Survey , 1986, IEEE Software.

[70]  Robert Sedgewick,et al.  SYSTEM FOR ALGORITHM ANIMATION. , 1984 .

[71]  Akira Aiba,et al.  CAL: A Theoretical Background of Constraint Logic Programming and its Applications , 1988, J. Symb. Comput..

[72]  Christopher J. Van Wyk,et al.  A High-Level Language for Specifying Pictures , 1982, TOGS.

[73]  Terry Winograd,et al.  Language as a cognitive process 1: Syntax , 1982 .

[74]  Hiroyuki Watanabe,et al.  Heuristic Graph Displayer for G-BASE , 1989, Int. J. Man Mach. Stud..

[75]  Alan K. Mackworth,et al.  ANTICS: A system for animating LISP programs , 1978 .

[76]  Robert Duisberg Animation Using Temporal Constraints: An Overview of the Animus System , 1987, Hum. Comput. Interact..

[77]  Daniel Thalmann An interactive data visualization system , 1984, Softw. Pract. Exp..