Selecting Objects With Freehand Sketches

We present in this paper the design of an interactive tool for selecting objects using simple freehand sketches. The objective is to extract object boundaries precisely while requiring little skill and time from the user. The tool proposed achieves this objective by integrating user input and image computation in a two-phase algorithm. In the first phase, the input sketch is used along with a coarse global segmentation of the image to derive an initial selection and a triangulation of the region around the boundary. The triangles are used to formulate subproblems of local finer-grained segmentation and selection. Each of the subproblems is processed independently in the second phase, where a linear approximation of the local boundary as well as a local, finer-grained segmentation are computed. The approximate boundary is then used with the local segmentation to compute a final selection, represented with an alpha channel to f . l l y capture diffiised object boundaries. Experimental results show that the tool allows veiy simple sketches to be used to select objects with complex boundaries. Therefore, the tool has immediate applications in graphics systems for image editing, manipdation, synthesis, retrieval, and processing.

[1]  Alberto Del Bimbo,et al.  Visual Image Retrieval by Elastic Matching of User Sketches , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Eric Saund,et al.  Perceptual organization in an interactive sketch editing application , 1995, Proceedings of IEEE International Conference on Computer Vision.

[3]  Dean Rubine,et al.  Specifying gestures by example , 1991, SIGGRAPH.

[4]  Tom Duff,et al.  Compositing digital images , 1984, SIGGRAPH.

[5]  William A. Barrett,et al.  Intelligent scissors for image composition , 1995, SIGGRAPH.

[6]  Mubarak Shah,et al.  A Fast algorithm for active contours and curvature estimation , 1992, CVGIP Image Underst..

[7]  Christophe Chesnaud,et al.  Statistical Region Snake-Based Segmentation Adapted to Different Physical Noise Models , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Narendra Ahuja,et al.  Multiscale image segmentation by integrated edge and region detection , 1997, IEEE Trans. Image Process..

[9]  Thomas P. Moran,et al.  Tivoli: an electronic whiteboard for informal workgroup meetings , 1993, INTERCHI.

[10]  Narendra Ahuja,et al.  A Transform for Multiscale Image Segmentation by Integrated Edge and Region Detection , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  James H. Elder,et al.  Image editing in the contour domain , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[12]  Yair Weiss,et al.  Segmentation using eigenvectors: a unifying view , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[13]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.