Sketch based interfaces: early processing for sketch understanding

Freehand sketching is a natural and crucial part of everyday human interaction, yet is almost totally unsupported by current user interfaces. We are working to combine the flexibility and ease of use of paper and pencil with the processing power of a computer, to produce a user interface for design that feels as natural as paper, yet is considerably smarter. One of the most basic steps in accomplishing this is converting the original digitized pen strokes in a sketch into the intended geometric objects. In this paper we describe an implemented system that combines multiple sources of knowledge to provide robust early processing for freehand sketching.

[1]  S. Matsuoka,et al.  Interactive beautification: a technique for rapid geometric design , 1997, SIGGRAPH '07.

[2]  J. Hughes,et al.  SKETCH: an interface for sketching 3D scenes , 1996, SIGGRAPH Courses.

[3]  James A. Landay,et al.  Sketching Interfaces: Toward More Human Interface Design , 2001, Computer.

[4]  Nicholas J. Redding,et al.  Implicit Polynomials, Orthogonal Distance Regression, and the Closest Point on a Curve , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Christine J. Alvarado,et al.  A natural sketching environment : bringing the computer into early stages of mechanical design , 2000 .

[6]  Karl Tombre.  Analysis of Engineering Drawings: State of the Art and Challenges , 1997, GREC.

[7]  Paul L. Rosin.  Techniques for Assessing Polygonal Approximations of Curves , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Tony Lindeberg,et al.  Edge Detection and Ridge Detection with Automatic Scale Selection , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  Kazuhiko Yamamoto,et al.  Structured Document Image Analysis , 1992, Springer Berlin Heidelberg.

[10]  Dean Rubine,et al.  Specifying gestures by example , 1991, SIGGRAPH.

[11]  Jan-Olof Eklundh,et al.  Shape Representation by Multiscale Contour Approximation , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  A. Rattarangsi,et al.  Scale-based detection of corners of planar curves , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[13]  Elaine Cohen,et al.  Real time spline curves from interactively sketched data , 1990, I3D '90.

[14]  Lee D. Erman,et al.  The Hearsay-II Speech-Understanding System: Integrating Knowledge to Resolve Uncertainty , 1980, CSUR.