Structure-preserving manipulation of photographs

Visual content is often better communicated by simplified or exaggerated images than by the "real world like" images. In this paper, we offer a tool for creating such enhanced representations of photographs in a way consistent with the original image content. To do so, we develop a method to identify the relevant image structures and their importance. Our approach (a) uses edges as the basic structural unit in the image, (b) proposes tools to manipulate this structure in a flexible way, and (c) employs gradient domain image processing techniques to reconstruct the final image from a "cropped" gradient information. This edge-based approach to non-photorealistic image processing is made feasible by two new techniques we introduce: an addition to the Gaussian scale space theory to compute a perceptually meaningful hierarchy of structures, and a contrast estimation method necessary for faithful gradient-based reconstructions. We finally present various applications that manipulate image structure in different ways.

[1]  Bruce Gooch,et al.  Color2Gray: salience-preserving color removal , 2005, ACM Trans. Graph..

[2]  Tony Lindeberg Edge Detection and Ridge Detection with Automatic Scale Selection , 2004, International Journal of Computer Vision.

[3]  Michael Cohen,et al.  Video tooning , 2004, SIGGRAPH 2004.

[4]  Tony Lindeberg,et al.  Edge Detection and Ridge Detection with Automatic Scale Selection , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  J. Andrew Bangham,et al.  The Art of Scale-Space , 2003, BMVC.

[6]  Harry Shum,et al.  Color sketch generation , 2006, NPAR.

[7]  J. Koenderink The structure of images , 2004, Biological Cybernetics.

[8]  Rama Chellappa,et al.  Direct Analytical Methods for Solving Poisson Equations in Computer Vision Problems , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Hyung W. Kang,et al.  A unified scheme for adaptive stroke-based rendering , 2006, The Visual Computer.

[10]  Ramesh Raskar,et al.  Image fusion for context enhancement and video surrealism , 2004, NPAR '04.

[11]  Douglas DeCarlo,et al.  Visual interest and NPR: an evaluation and manifesto , 2004, NPAR '04.

[12]  Holger Winnemöller,et al.  Real-time video abstraction , 2006, SIGGRAPH 2006.

[13]  Dani Lischinski,et al.  Gradient Domain High Dynamic Range Compression , 2023 .

[14]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Fredrik Bergholm,et al.  Edge Focusing , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Douglas DeCarlo,et al.  Stylization and abstraction of photographs , 2002, ACM Trans. Graph..

[17]  James H. Elder,et al.  Image Editing in the Contour Domain , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  John P. Collomosse,et al.  Genetic Paint: A Search for Salient Paintings , 2005, EvoWorkshops.

[19]  H. Reeves,et al.  The Guild handbook of scientific illustration , 1991 .

[20]  Aaron Hertzmann,et al.  Painterly rendering with curved brush strokes of multiple sizes , 1998, SIGGRAPH.

[21]  B. Wandell Foundations of vision , 1995 .

[22]  David Salesin,et al.  Interactive digital photomontage , 2004, ACM Trans. Graph..

[23]  S. Palmer Vision Science : Photons to Phenomenology , 1999 .

[24]  Alessandro Neri,et al.  A Biologically Motivated Multiresolution Approach to Contour Detection , 2007, EURASIP J. Adv. Signal Process..

[25]  John P. Collomosse,et al.  Cubist Style Rendering from Photographs , 2003, IEEE Trans. Vis. Comput. Graph..

[26]  Steven W. Zucker,et al.  Local Scale Control for Edge Detection and Blur Estimation , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  David Salesin,et al.  Interactive digital photomontage , 2004, SIGGRAPH 2004.

[28]  Bart M. ter Haar Romeny,et al.  Front-End Vision and Multi-Scale Image Analysis , 2003, Computational Imaging and Vision.

[29]  Patrick Pérez,et al.  Poisson image editing , 2003, ACM Trans. Graph..

[30]  J. Galayda Edge Focusing , 1981, IEEE Transactions on Nuclear Science.