Real Time Edit Propagation by Efficient Sampling

It is popular to edit the appearance of images using strokes, owing to their ease of use and convenience of conveying the user's intention. However, propagating the user inputs to the rest of the images requires solving an enormous optimization problem, which is very time consuming, thus preventing its practical use. In this paper, a two‐step edit propagation scheme is proposed, first to solve edits on clusters of similar pixels and then to interpolate individual pixel edits from cluster edits. The key in our scheme is that we use efficient stroke sampling to compute the affinity between image pixels and strokes. Based on this, our clustering does not need to be stroke‐adaptive and thus the number of clusters is greatly reduced, resulting in a significant speedup. The proposed method has been tested on various images, and the results show that it is more than one order of magnitude faster than existing methods, while still achieving precise results compared with the ground truth. Moreover, its efficiency is not sensitive to the number of strokes, making it suitable for performing dense edits in practice.

[1]  Baining Guo,et al.  Edit Propagation on Bidirectional Texture Functions , 2009, Comput. Graph. Forum.

[2]  Fabio Pellacini,et al.  User‐Controllable Color Transfer , 2010, Comput. Graph. Forum.

[3]  Bing-Yu Chen,et al.  Example‐based Multiple Local Color Transfer by Strokes , 2008, Comput. Graph. Forum.

[4]  Fabio Pellacini,et al.  AppProp: all-pairs appearance-space edit propagation , 2008, SIGGRAPH 2008.

[5]  Shi-Min Hu,et al.  Efficient affinity-based edit propagation using K-D tree , 2009, SIGGRAPH 2009.

[6]  Dani Lischinski,et al.  Colorization using optimization , 2004, ACM Trans. Graph..

[7]  Jiawen Chen,et al.  Real-time edge-aware image processing with the bilateral grid , 2007, ACM Trans. Graph..

[8]  Zeev Farbman,et al.  Interactive local adjustment of tonal values , 2006, ACM Trans. Graph..

[9]  Maneesh Agrawala,et al.  Edge-based image coarsening , 2009, TOGS.

[10]  Fabio Pellacini,et al.  AppProp: all-pairs appearance-space edit propagation , 2008, ACM Trans. Graph..

[11]  Greg Humphreys,et al.  Physically Based Rendering: From Theory to Implementation , 2004 .

[12]  Shi-Min Hu,et al.  Instant Propagation of Sparse Edits on Images and Videos , 2010, Comput. Graph. Forum.

[13]  Edward H. Adelson,et al.  Eurographics Symposium on Rendering 2008 Scribbleboost: Adding Classification to Edge-aware Interpolation of Local Image and Video Adjustments , 2022 .

[14]  Hans-Peter Seidel,et al.  MovieReshape: tracking and reshaping of humans in videos , 2010, SIGGRAPH 2010.

[15]  Jason Lawrence,et al.  AppWand: editing measured materials using appearance-driven optimization , 2007, ACM Trans. Graph..