Efficient antialiased edit propagation for images and videos

Edit propagation on images/videos has become more and more popular in recent years due to simple and intuitive interaction. It propagates sparse user edits to the whole data following the policy that nearby regions with similar appearances receive similar edits. While it gives a friendly editing mode, it often produces aliasing artifacts on edge pixels. In this paper, we present a simple algorithm to resolve this artifact for edit propagation. The key in our method is a new representation called Antialias Map, in which we represent each antialiased edge pixel by a linear interpolation of neighboring pixels around the edge, and instead of considering the original edge pixels in solving edit propagation, we consider those neighboring pixels. We demonstrate that our work is effective in preserving antialiased edges for edit propagation and could be easily integrated with existing edit propagation methods such as [1,2].

[1]  Jason Lawrence,et al.  AppWand: editing measured materials using appearance-driven optimization , 2007, SIGGRAPH 2007.

[2]  Ralph R. Martin,et al.  Automatic and topology-preserving gradient mesh generation for image vectorization , 2009, ACM Trans. Graph..

[3]  Dipl.-Ing,et al.  Real-time Rendering , 2022 .

[4]  Shi-Min Hu,et al.  RepFinder: finding approximately repeated scene elements for image editing , 2010, ACM Trans. Graph..

[5]  J. Tumblin,et al.  Supplemental Material for Color 2 Gray : Salience-Preserving Color Removal , 2005 .

[6]  Jiawen Chen,et al.  Real-time edge-aware image processing with the bilateral grid , 2007, SIGGRAPH 2007.

[7]  Ruofeng Tong,et al.  Content-aware copying and pasting in images , 2010, The Visual Computer.

[8]  Tomas Akenine-Möller,et al.  Real-time rendering , 1997 .

[9]  Minghao Pan,et al.  Fast, Sub‐pixel Antialiased Shadow Maps , 2009, Comput. Graph. Forum.

[10]  Dani Lischinski,et al.  Depixelizing pixel art , 2011 .

[11]  Shi-Min Hu,et al.  Sketch2Photo: internet image montage , 2009, ACM Trans. Graph..

[12]  Maneesh Agrawala,et al.  Edge-based image coarsening , 2009, TOGS.

[13]  Hua Huang,et al.  Arcimboldo-like collage using internet images , 2011, ACM Trans. Graph..

[14]  Patrick Pérez,et al.  Poisson image editing , 2003, ACM Trans. Graph..

[15]  Lizhuang Ma,et al.  Color transfer in correlated color space , 2006, VRCIA '06.

[16]  Baomin Li,et al.  Unsupervised learning of spatial structures shared among images , 2011, The Visual Computer.

[17]  Klaus Mueller,et al.  Transferring color to greyscale images , 2002, ACM Trans. Graph..

[18]  Ralph R. Martin,et al.  Vectorizing Cartoon Animations , 2009, IEEE Transactions on Visualization and Computer Graphics.

[19]  Lei Yang,et al.  Antialiasing recovery , 2011, TOGS.

[20]  Raanan Fattal,et al.  Diffusion maps for edge-aware image editing , 2010, SIGGRAPH 2010.

[21]  Jizhou Sun,et al.  Video dehazing with spatial and temporal coherence , 2011, The Visual Computer.

[22]  Rynson W. H. Lau,et al.  A gradient-domain-based edge-preserving sharpen filter , 2011, The Visual Computer.

[23]  Baining Guo,et al.  Pocket reflectometry , 2011, SIGGRAPH 2011.

[24]  Greg Humphreys,et al.  Physically Based Rendering: From Theory to Implementation , 2004 .

[25]  Guillermo Sapiro,et al.  Fast image and video colorization using chrominance blending , 2006, IEEE Transactions on Image Processing.

[26]  XiaoChunxia,et al.  Fast image dehazing using guided joint bilateral filter , 2012 .

[27]  Edward H. Adelson,et al.  Eurographics Symposium on Rendering 2008 Scribbleboost: Adding Classification to Edge-aware Interpolation of Local Image and Video Adjustments , 2022 .

[28]  J. H. Hateren,et al.  Independent component filters of natural images compared with simple cells in primary visual cortex , 1998 .

[29]  Shi-Min Hu,et al.  RepFinder: finding approximately repeated scene elements for image editing , 2010, SIGGRAPH 2010.

[30]  Hui Du,et al.  Object cloning using constrained mean value interpolation , 2012, The Visual Computer.

[31]  Raanan Fattal,et al.  Single image dehazing , 2008, ACM Trans. Graph..

[32]  Martin White,et al.  Implementing an anisotropic texture filter , 2000, Comput. Graph..

[33]  Bruce Gooch,et al.  Color2Gray: salience-preserving color removal , 2005, SIGGRAPH 2005.

[34]  Shi-Min Hu,et al.  Efficient affinity-based edit propagation using K-D tree , 2009, ACM Trans. Graph..

[35]  Fabio Pellacini,et al.  AppProp: all-pairs appearance-space edit propagation , 2008, ACM Trans. Graph..

[36]  Aapo Hyvärinen,et al.  Natural Image Statistics - A Probabilistic Approach to Early Computational Vision , 2009, Computational Imaging and Vision.

[37]  Baining Guo,et al.  Edit Propagation on Bidirectional Texture Functions , 2009, Comput. Graph. Forum.

[38]  Yeongho Seol,et al.  Weighted pose space editing for facial animation , 2012, The Visual Computer.

[39]  Shree K. Nayar,et al.  Reflectance and texture of real-world surfaces , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[40]  Hans-Peter Seidel,et al.  Contrast prescription for multiscale image editing , 2010, The Visual Computer.

[41]  Patrick Pérez,et al.  Geodesic image and video editing , 2010, TOGS.

[42]  Hans-Peter Seidel,et al.  Hardware-accelerated rendering of antialiased shadows with shadow maps , 2001, Proceedings. Computer Graphics International 2001.

[43]  Dani Lischinski,et al.  Colorization using optimization , 2004, ACM Trans. Graph..

[44]  Wencheng Wang,et al.  Real Time Edit Propagation by Efficient Sampling , 2011, Comput. Graph. Forum.

[45]  Erik Reinhard,et al.  High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting (The Morgan Kaufmann Series in Computer Graphics) , 2005 .

[46]  Hua Huang,et al.  RepSnapping: Efficient Image Cutout for Repeated Scene Elements , 2011, Comput. Graph. Forum.

[47]  Fabio Pellacini,et al.  AppProp: all-pairs appearance-space edit propagation , 2008, SIGGRAPH 2008.

[48]  ZhangJiawan,et al.  Video dehazing with spatial and temporal coherence , 2011 .

[49]  Xiaoou Tang,et al.  Single Image Haze Removal Using Dark Channel Prior , 2011 .

[50]  Hua Huang,et al.  Painterly rendering with content-dependent natural paint strokes , 2011, The Visual Computer.

[51]  Baining Guo,et al.  AppGen: interactive material modeling from a single image , 2011, ACM Trans. Graph..

[52]  Richard J. Cant,et al.  Texture potential MIP mapping, a new high-quality texture antialiasing algorithm , 2000, TOGS.

[53]  Kun Xu,et al.  Antialiasing recovery for edit propagation , 2011, VRCAI '11.

[54]  Ligang Liu,et al.  Interactive two-scale color-to-gray , 2012, The Visual Computer.

[55]  Erik Reinhard,et al.  High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting , 2010 .

[56]  David Salesin,et al.  Rendering antialiased shadows with depth maps , 1987, SIGGRAPH.

[57]  Hua Huang,et al.  Example-based contrast enhancement by gradient mapping , 2010, The Visual Computer.

[58]  Chunxia Xiao,et al.  Fast image dehazing using guided joint bilateral filter , 2012, The Visual Computer.

[59]  Baining Guo,et al.  Condenser‐Based Instant Reflectometry , 2010, Comput. Graph. Forum.

[60]  Zeev Farbman,et al.  Interactive local adjustment of tonal values , 2006, ACM Trans. Graph..

[61]  John M. Snyder,et al.  Manifold bootstrapping for SVBRDF capture , 2010, ACM Trans. Graph..

[62]  Ding Meng,et al.  Efficient dark channel based image dehazing using quadtrees , 2013 .

[63]  Yongwei Nie,et al.  Efficient Edit Propagation Using Hierarchical Data Structure , 2011, IEEE Transactions on Visualization and Computer Graphics.

[64]  Alexander Reshetov Morphological antialiasing , 2009, High Performance Graphics.

[65]  Raanan Fattal,et al.  Edge-avoiding wavelets and their applications , 2009, ACM Trans. Graph..

[66]  Shi-Min Hu,et al.  Instant Propagation of Sparse Edits on Images and Videos , 2010, Comput. Graph. Forum.

[67]  Yun Zhang,et al.  Environment-Sensitive cloning in images , 2011, The Visual Computer.