Constellation models for sketch recognition

Sketch-based modeling shares many of the difficulties of the branch of computer vision that deals with single image interpretation. Most obviously, they must both identify the parts observed in a given 2D drawing or image.We draw on constellation models first proposed in the computer vision literature to develop probabilistic models for object sketches, based on multiple example drawings. These models are then applied to estimate the most-likely labels for a new sketch. A multi-pass branch-and-bound algorithm allows well-formed sketches to be quickly labelled, while still supporting the recognition of more ambiguous sketches. Results are presented for five classes of objects.

[1]  Levent Burak Kara,et al.  Hierarchical parsing and recognition of hand-sketched diagrams , 2007, SIGGRAPH '07.

[2]  Daniel P. Huttenlocher,et al.  Spatial priors for part-based recognition using statistical models , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[3]  Martin A. Fischler,et al.  The Representation and Matching of Pictorial Structures , 1973, IEEE Transactions on Computers.

[4]  Paul A. Viola,et al.  Spatial recognition and grouping of text and graphics , 2004, SBM'04.

[5]  James V. Mahoney,et al.  Three main concerns in sketch recognition and an approach to addressing them , 2002 .

[6]  Chen Yang,et al.  Sketch-based modeling of parameterized objects , 2005, SIGGRAPH '05.

[7]  David J. Fleet,et al.  Perceptual Organization as a Foundation for Intelfigent Sketch Editing , 2002 .

[8]  Levent Burak Kara,et al.  Hierarchical parsing and recognition of hand-sketched diagrams , 2004, UIST '04.

[9]  Dean Rubine,et al.  Specifying gestures by example , 1991, SIGGRAPH.

[10]  Yuan Qi,et al.  Diagram structure recognition by Bayesian conditional random fields , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[11]  Christine Alvarado,et al.  SketchREAD: a multi-domain sketch recognition engine , 2004, UIST '04.

[12]  Leslie Pack Kaelbling,et al.  Learning Three-Dimensional Shape Models for Sketch Recognition , 2005 .

[13]  Natasha Alechina,et al.  Classifying Sketches of Animals Using an Agent-Based System , 2003, CAIP.

[14]  Daniel P. Huttenlocher,et al.  Pictorial Structures for Object Recognition , 2004, International Journal of Computer Vision.