Painterly Rendering with Vector Field Based Feature Extraction

In this paper, a novel technique is presented to incorporate vector field based feature extraction schemes into painterly rendering. This approach takes a raster photograph as input and automatically creates a hand-painting style picture. Via techniques formerly used in image segmentation, a vector field representation are generated, identifying color and texture variations at each pixel location, and a series of brush strokes are created with sizes and alignments controlled by the vector field and color matched from the original picture. Moreover, different scale parameters could be utilized to produce several vector fields depicting images features of the original photograph from rough outline to detail. The final output could be rendered first by brushstrokes in the coarsest scale and refined progressively. Unlike conventional techniques that used taking account only of local color gradients, this approach employs multi-scale feature extraction scheme to guide stroke generation with image structure on larger scale.

[1]  Tony Lindeberg,et al.  Edge Detection and Ridge Detection with Automatic Scale Selection , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[2]  Nelson Siu-Hang Chu,et al.  Real-time painting with an expressive virtual Chinese brush , 2004, IEEE Computer Graphics and Applications.

[3]  Levente Kovács,et al.  Painterly rendering controlled by multiscale image features , 2004, SCCG '04.

[4]  Peter Litwinowicz,et al.  Processing images and video for an impressionist effect , 1997, SIGGRAPH.

[5]  B. S. Manjunath,et al.  Multi-scale edge detection and image segmentation , 2005, 2005 13th European Signal Processing Conference.

[6]  Paul Haeberli,et al.  Paint by numbers: abstract image representations , 1990, SIGGRAPH.

[7]  Peter Shirley,et al.  Artistic Vision: painterly rendering using computer vision techniques , 2002, NPAR '02.

[8]  B. S. Manjunath,et al.  EdgeFlow: a technique for boundary detection and image segmentation , 2000, IEEE Trans. Image Process..

[9]  David Salesin,et al.  Computer-generated watercolor , 1997, SIGGRAPH.

[10]  Taku Komura,et al.  Topology matching for fully automatic similarity estimation of 3D shapes , 2001, SIGGRAPH.

[11]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Chiew-Lan Tai,et al.  MoXi: real-time ink dispersion in absorbent paper , 2005, SIGGRAPH '05.

[13]  Narendra Ahuja,et al.  Multiscale image segmentation by integrated edge and region detection , 1997, IEEE Trans. Image Process..

[14]  Fredrik Bergholm,et al.  Edge Focusing , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Barbara J. Meier Painterly rendering for animation , 1996, SIGGRAPH.

[16]  Aaron Hertzmann,et al.  Painterly rendering with curved brush strokes of multiple sizes , 1998, SIGGRAPH.