Automatically Transforming Symbolic Shape Descriptions for Use in Sketch Recognition

Sketch recognition systems are currently being developed for many domains, but can be time consuming to build if they are to handle the intricacies of each domain. This paper presents the first translator that takes symbolic shape descriptions (written in the LADDER sketch language) and automatically transforms them into shape recognizers, editing recognizers, and shape exhibitors for use in conjunction with a domain independent sketch recognition system. This transformation allows us to build a single domain independent recognition system that can be customized for multiple domains. We have tested our framework by writing several domain descriptions and automatically created a domain specific sketch recognition system for each domain.

[1]  Dean Rubine,et al.  Specifying gestures by example , 1991, SIGGRAPH.

[2]  James V. Mahoney,et al.  Handling ambiguity in constraint-based recognition of stick figure sketches , 2001, IS&T/SPIE Electronic Imaging.

[3]  Ellen Yi-Luen Do,et al.  Demonstrating the electronic cocktail napkin: a paper-like interface for early design , 1996, CHI Conference Companion.

[4]  James V. Mahoney,et al.  Three main concerns in sketch recognition and an approach to addressing them , 2002 .

[5]  Joaquim A. Jorge,et al.  JavaSketchIt: Issues in Sketching the Look of User Interfaces , 2002 .

[6]  Christine J. Alvarado,et al.  A natural sketching environment : bringing the computer into early stages of mechanical design , 2000 .

[7]  E. J. Friedman-hill,et al.  Jess, the Java expert system shell , 1997 .

[8]  Manuel J. Fonseca,et al.  Sketching User Interfaces with Visual Patterns , .

[9]  Victor Zue,et al.  Conversational interfaces: advances and challenges , 1997, Proceedings of the IEEE.

[10]  R. Davis,et al.  Perceptually Based Learning of Shape Descriptions , 2002 .

[11]  Oliver Bimber,et al.  A multi-layered architecture for sketch-based interaction within virtual environments , 2000, Comput. Graph..

[12]  Randall Davis,et al.  Tahuti: a geometrical sketch recognition system for UML class diagrams , 2006, SIGGRAPH Courses.

[13]  Tracy Anne Hammond,et al.  LADDER: a language to describe drawing, display, and editing in sketch recognition , 2003, IJCAI.

[14]  Ellen Yi-Luen Do.  VR Sketchpad. Create Instant 3D Worlds by Sketching on a Transparent Window , 2001 .

[15]  George Stiny,et al.  Shape Grammars and the Generative Specification of Painting and Sculpture , 1971, IFIP Congress.

[16]  James A. Landay,et al.  Sketch-based user interfaces for collaborative object-oriented modeling , 1999 .

[17]  Christine Alvarado.  Dynamically Constructed Bayesian Networks for Sketch Understanding , 2003 .

[18]  Robert P. Futrelle,et al.  Constraint based vectorization , 1989, ICS '89.

[19]  Tevfik Metin Sezgin.  Recognition efficiency issues for freehand sketches , 2004 .

[20]  P. H. Lindsay.  Human Information Processing , 1977 .

[21]  Mark W. Newman,et al.  DENIM: finding a tighter fit between tools and practice for Web site design , 2000, CHI.

[22]  M. GROSS,et al.  Using diagrams to access a case library of architectural designs , 1996 .

[23]  James A. Landay,et al.  Quill: a gesture design tool for pen-based user interfaces , 2001 .

[24]  Genny Tortora,et al.  Automatic Generation of Visual Programming Environments , 1995, Computer.

[25]  Eric Lecolinet.  Designing GUIs by sketch drawing and visual programming , 1998, AVI '98.

[26]  Robert J. K. Jacob,et al.  A software model and specification language for non-WIMP user interfaces , 1999, TCHI.