PicWords: Render a Picture by Packing Keywords

In this paper, we propose a novel text-art system: input a source picture and some keywords introducing the information about the picture, and the output is the so-called PicWords in the form of the source picture composed of the introduction keywords. Different from traditional text-graphics which are created by highly skilled artists and involve a huge amount of tedious manual work, PicWords is an automatic non-photorealistic rendering (NPR) packing system. Given a source picture, we first generate its silhouette, which is a binary image containing a Yang part and a Yin part. Yang part is for keywords placing while the Yin part can be ignored. Next, the Yang part is further over-segmented into small patches, each of which serves as a container for one keyword. To make sure that more important keywords are put into more salient and larger image patches, we rank both the patches and keywords and construct a correspondence between the patch list and keyword list. Then, mean value coordinates method is used for the keyword-patch warping. Finally, certain post-processing techniques are adopted to improve the aesthetics of PicWords. Extensive experimental results well demonstrate the effectiveness of the proposed PicWords system.

[1]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Stefan Schlechtweg,et al.  Non-photorealistic computer graphics: modeling, rendering, and animation , 2002 .

[3]  Tien-Tsin Wong,et al.  Structure-based ASCII art , 2010, ACM Trans. Graph..

[4]  Tobias Isenberg,et al.  State of the "Art”: A Taxonomy of Artistic Stylization Techniques for Images and Video , 2013, IEEE Transactions on Visualization and Computer Graphics.

[5]  Kai Hormann,et al.  Mean value coordinates for arbitrary planar polygons , 2006, TOGS.

[6]  Ariel Shamir,et al.  Digital micrography , 2011, ACM Trans. Graph..

[7]  Junsong Yuan,et al.  Minimum near-convex decomposition for robust shape representation , 2011, 2011 International Conference on Computer Vision.

[8]  Fabio Pellacini,et al.  Jigsaw image mosaics , 2002, ACM Trans. Graph..

[9]  Maneesh Agrawala,et al.  Image warps for artistic perspective manipulation , 2010, ACM Trans. Graph..

[10]  Peter Meer,et al.  Synergism in low level vision , 2002, Object recognition supported by user interaction for service robots.

[11]  Masakatu Morii,et al.  Expansion of Image Displayable Area in Design QR Code and Its Applications , 2011 .

[12]  Jie Xu,et al.  Calligraphic packing , 2007, GI '07.

[13]  J.-L. Wu,et al.  Video Adaptation for Small Display Based on Content Recomposition , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Charless C. Fowlkes,et al.  Contour Detection and Hierarchical Image Segmentation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Alejo Hausner,et al.  Simulating decorative mosaics , 2001, SIGGRAPH.

[16]  M. Sheelagh T. Carpendale,et al.  FatFonts: combining the symbolic and visual aspects of numbers , 2012, AVI.

[17]  Min-Chun Hu,et al.  Interactive digital scrapbook generation for travel photos based on design principles of typography , 2011, MM '11.

[18]  Craig S. Kaplan,et al.  Cut-out image mosaics , 2008, NPAR.