Segmentation of Pen Strokes Using Pen Speed

We present a technique for segmenting pen strokes into lines and arcs. The technique uses pen speed information to help infer the segmentation intended by the drawer. To begin, a set of candidate segment points is identified. This set includes speed minima below a threshold computed from the average pen speed. It also includes curvature maxima at which the pen speed is again below a threshold. The ink between each pair of consecutive segment points is then classified as either a line or arc, depending on which fits best. Finally, a feedback process is employed, and segments are judiciously merged and split as necessary to improve the quality of the segmentation. Formal user studies were conducted, and our system was observed to perform accurately, even for new users.

[1]  Christopher F. Herot Graphical input through machine recognition of sketches , 1976, SIGGRAPH '76.

[2]  Levent Burak Kara,et al.  A Sketch-Based Interface for the Design and Analysis of Simple Vibratory Mechanical Systems , 2004, DAC 2004.

[3]  Dean Rubine,et al.  Specifying gestures by example , 1991, SIGGRAPH.

[4]  Chin-Hsing Chen,et al.  Multiscale corner detection by using wavelet transform , 1995, IEEE Trans. Image Process..

[5]  Bo Yu Recognition of freehand sketches using mean shift , 2003, IUI '03.

[6]  Roland T. Chin,et al.  On the Detection of Dominant Points on Digital Curves , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  James A. Landay,et al.  Sketching Interfaces: Toward More Human Interface Design , 2001, Computer.

[8]  Tevfik Metin Sezgin,et al.  Feature point detection and curve approximation for early processing of free-hand sketches , 2001 .

[9]  Roland T. Chin,et al.  Scale-Based Detection of Corners of Planar Curves , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  L. Kara,et al.  Recognizing Multi-Stroke Symbols , 2002 .

[11]  Hod Lipson,et al.  Classification of Sketch Strokes and Corner Detection Using Conic Sections and Adaptive Clustering , 1997 .

[12]  John K. Tsotsos,et al.  Shape Representation and Recognition from Multiscale Curvature , 1997, Comput. Vis. Image Underst..

[13]  Kevin L. Novins,et al.  Polygon recognition in sketch-based interfaces with immediate and continuous feedback , 2003, GRAPHITE '03.

[14]  Levent Burak Kara,et al.  Combining geometry and domain knowledge to interpret hand-drawn diagrams , 2005, Comput. Graph..