Content Based Image Synthesis

A new method allowing for semantically guided image editing and synthesis is introduced. The editing process is made considerably easier and more powerful with our content-aware tool. We construct a database of image regions annotated with a carefully chosen vocabulary and utilize recent advances in texture synthesis algorithms to generate new and unique image regions from this database of material. These new regions are then seamlessly composited into a user’s existing photograph. The goal is to empower the end user with the ability to edit existing photographs and synthesize new ones on a high semantic level. Plausible results are generated using a small prototype database and showcase some of the editing possibilities that such a system affords.

[1]  R. Barthes,et al.  Image-Music-Text , 1977 .

[2]  Irfan A. Essa,et al.  Graphcut textures: image and video synthesis using graph cuts , 2003, ACM Trans. Graph..

[3]  Aleksandra Mojsilovic.  A method for color naming and description of color composition in images , 2002, Proceedings. International Conference on Image Processing.

[4]  L. Manovich,et al.  The language of new media , 2001 .

[5]  Jiebo Luo,et al.  Probabilistic spatial context models for scene content understanding , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[6]  Patrick Pérez,et al.  Object removal by exemplar-based inpainting , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[7]  David A. Forsyth,et al.  Object Recognition as Machine Translation: Learning a Lexicon for a Fixed Image Vocabulary , 2002, ECCV.

[8]  Alberto Del Bimbo,et al.  Image retrieval by color semantics , 1999, Multimedia Systems.

[9]  David Salesin,et al.  Image Analogies , 2001, SIGGRAPH.

[10]  L. Gool,et al.  Parallel composite texture synthesis , 2002 .

[11]  Michael Ashikhmin,et al.  Synthesizing natural textures , 2001, I3D '01.

[12]  Alexei A. Efros,et al.  Image quilting for texture synthesis and transfer , 2001, SIGGRAPH.

[13]  Jitendra Malik,et al.  Textons, contours and regions: cue integration in image segmentation , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[14]  David A. Forsyth,et al.  Motion synthesis from annotations , 2003, ACM Trans. Graph..

[15]  Simone Santini,et al.  Similarity Measures , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Daniel Chandler,et al.  Semiotics: The Basics , 2001 .

[17]  Patrick Pérez,et al.  Poisson image editing , 2003, ACM Trans. Graph..

[18]  Luc Van Gool,et al.  Composite Texture Descriptions , 2002, ECCV.