Recognizing and interpreting diagrams in design

Hand drawn diagrams are essential tools for thinking and communicating in the early phases of design, yet computer based drawing tools support diagramming and sketching only poorly. Key components of computational support for early design include recognition, interpretation, and management of diagrams. The paper describes the motivation for, implementation of, and initial experience with the “computer as cocktail napkin” project, a design environment based on diagrams. It explains low level recognition of glyphs, construction of higher-level recognizers, and routines for managing diagrams in the cocktail napkin prototype.

[1]  John E. Howland,et al.  Computer graphics , 1990, IEEE Potentials.

[2]  Peter van Sommers,et al.  Drawing and Cognition: Descriptive and Experimental Studies of Graphic Production Processes , 1984 .

[3]  Ioannis A. Kakadiaris,et al.  Understanding diagrams in technical documents , 1992, Computer.

[4]  Herbert A. Simon,et al.  Why a diagram is (sometimes) worth 10, 000 word , 1987 .

[5]  John S. Gero.  Artificial intelligence in engineering: design , 1988 .

[6]  Steven K. Feiner,et al.  Interactive constraint-based search and replace , 1992, CHI.

[7]  Stephen M. Ervin,et al.  Designing with diagrams: a role for computing in design education and exploration , 1990 .

[8]  Sara A. Bly,et al.  Media spaces: bringing people together in a video, audio, and computing environment , 1993, CACM.

[9]  N. Hari Narayanan,et al.  Reasoning with Diagrammatic Representations: A Report on the Spring Symposium , 1993, AI Mag..

[10]  Fay Sudweeks,et al.  Artificial Intelligence in Design ’96 , 1996, Springer Netherlands.

[11]  N. Chater,et al.  Proceedings of the fourteenth annual conference of the cognitive science society , 1992 .

[12]  Dean Rubine,et al.  Specifying gestures by example , 1991, SIGGRAPH.

[13]  Eric A. Bier,et al.  Graphical search and replace , 1988, SIGGRAPH.

[14]  Nils J. Nilsson,et al.  Artificial Intelligence , 1974, IFIP Congress.

[15]  Hiroshi Ishii,et al.  Toward an open shared workspace: computer and video fusion approach of TeamWorkStation , 1991, CACM.

[16]  Louis Weitzman,et al.  Visual grammars and incremental parsing for interface languages , 1990, Proceedings of the 1990 IEEE Workshop on Visual Languages.

[17]  Takayuki Dan Kimura,et al.  Recognizing multistroke geometric shapes: an experimental evaluation , 1993, UIST '93.

[18]  H. W. Zeevat,et al.  Reasoning with Diagrammatic Representations , 1995 .

[19]  Nicholas Negroponte,et al.  Recent advances in sketch recognition , 1973, AFIPS National Computer Conference.

[20]  Pascal Van Hentenryck,et al.  A Generic Arc-Consistency Algorithm and its Specializations , 1992, Artif. Intell..

[21]  Rui Zhao,et al.  Incremental recognition in gesture-based and syntax-directed diagram editors , 1993, INTERCHI.

[22]  G. Goldschmidt.  The dialectics of sketching , 1991 .

[23]  V. Goel.  "Ill-Structured Representations" for Ill-Structured Problems , 1992 .

[24]  Eric J. Golin,et al.  The specification of visual language syntax , 1990, J. Vis. Lang. Comput..

[25]  Martin Odersky,et al.  Building visual language parsers , 1991, CHI '91.