Color-luminance adjustment for image cloning based on mean-value coordinates

Image cloning could seamlessly copy and paste the interesting region from the source image into the target image to produce natural-looking and pleasing cloned result. This paper proposes an efficient color-luminance adjustment method to preserve the color of source image in object cloned region while insure the seamless transition between the source image and target image. We use an improved mean-value coordinates cloning to generate a mean-value membrane, and modulate the membrane according to automatic computed weighted parameter in different color channels. Furthermore, a constrained weighted parameter is utilized to make the cloned result match well with the target image on the luminance. The experimental results demonstrate that our method could obtain natural-looking and pleasing cloned result.

[1]  Michael Kazhdan,et al.  Streaming multigrid for gradient-domain operations on large images , 2008, SIGGRAPH 2008.

[2]  Ruofeng Tong,et al.  Content-aware copying and pasting in images , 2010, The Visual Computer.

[3]  Deepu Rajan,et al.  Sparse Coding for Alpha Matting , 2016, IEEE Transactions on Image Processing.

[4]  Richard Szeliski,et al.  Locally adapted hierarchical basis preconditioning , 2006, SIGGRAPH '06.

[5]  Chongzhao Han,et al.  Poisson image fusion based on Markov random field fusion model , 2013, Inf. Fusion.

[6]  Dani Lischinski,et al.  A Closed-Form Solution to Natural Image Matting , 2008 .

[7]  Hui Du,et al.  Object cloning using constrained mean value interpolation , 2012, The Visual Computer.

[8]  Zeev Farbman,et al.  Coordinates for instant image cloning , 2009, ACM Trans. Graph..

[9]  Aseem Agarwala,et al.  Efficient gradient-domain compositing using quadtrees , 2007, ACM Trans. Graph..

[10]  Ning Xu,et al.  Deep Image Matting , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Yehu Shen,et al.  A simple and fast image cloning algorithm , 2016, 2016 12th World Congress on Intelligent Control and Automation (WCICA).

[12]  Wojciech Matusik,et al.  Multi-scale image harmonization , 2010, SIGGRAPH 2010.

[13]  In-Kwon Lee,et al.  Improved coordinate-based image and video cloning algorithm , 2009, SIGGRAPH ASIA '09.

[14]  Michael Werman,et al.  Improving Perceptual Color Difference using Basic Color Terms , 2012, ArXiv.

[15]  Manuel Menezes de Oliveira Neto,et al.  Independent color-channel adjustment for seamless cloning based on Laplacian-membrane modulation , 2016, Comput. Graph..

[16]  Wencheng Wang,et al.  Intent-aware image cloning , 2013, The Visual Computer.

[17]  Peter Wonka,et al.  A GPU Laplacian solver for diffusion curves and Poisson image editing , 2009, ACM Transactions on Graphics.

[18]  Manuel Menezes de Oliveira Neto,et al.  Shared Sampling for Real‐Time Alpha Matting , 2010, Comput. Graph. Forum.

[19]  Harry Shum,et al.  To appear in the ACM SIGGRAPH conference proceedings Drag-and-Drop Pasting , 2022 .

[20]  Jun Cheng,et al.  Improving Sampling Criterion for Alpha Matting , 2013, 2013 2nd IAPR Asian Conference on Pattern Recognition.

[21]  Hui Zhou,et al.  Automatic defocus spectral matting , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[22]  Sylvain Paris,et al.  Error-Tolerant Image Compositing , 2010, ECCV.

[23]  Shi-Min Hu,et al.  Sketch2Photo: internet image montage , 2009, ACM Trans. Graph..

[24]  Jiaya Jia,et al.  Poisson matting , 2004, SIGGRAPH 2004.

[25]  Hujun Bao,et al.  Harmonic coordinates for real-time image cloning , 2010, Journal of Zhejiang University SCIENCE C.

[26]  Lei Wei,et al.  A simple real-time image cloning algorithm based on modified mean-value coordinates , 2015, 2015 International Conference on Control, Automation and Information Sciences (ICCAIS).

[27]  Lizhuang Ma,et al.  Seamless video composition using optimized mean-value cloning , 2010, The Visual Computer.

[28]  Dong Guo,et al.  Color Me Right-Seamless Image Compositing , 2009, CAIP.

[29]  Zeev Farbman,et al.  Convolution pyramids , 2011, ACM Trans. Graph..

[30]  Manuel Menezes de Oliveira Neto,et al.  Color Adjustment for Seamless Cloning Based on Laplacian-Membrane Modulation , 2015, 2015 28th SIBGRAPI Conference on Graphics, Patterns and Images.

[31]  Patrick Pérez,et al.  Poisson image editing , 2003, ACM Trans. Graph..

[32]  Xiaowu Chen,et al.  LLE Coordinates for Image Blending , 2014, 2014 International Conference on Virtual Reality and Visualization.

[33]  Dani Lischinski,et al.  Spectral Matting , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.