A framework for interactive image color editing

We propose a new method for interactive image color replacement that creates smooth and naturally looking results with minimal user interaction. Our system expects as input a source image and rawly scribbled target color values and generates high quality results in interactive rates. To achieve this goal we introduce an algorithm that preserves pairwise distances of the signatures in the original image and simultaneously maps the color to the user defined target values. We propose efficient sub-sampling in order to reduce the computational load and adapt semi-supervised locally linear embedding to optimize the constraints in one objective function. We show the application of the algorithm on typical photographs and compare the results to other color replacement methods.

[1]  Maneesh Agrawala,et al.  Illumination decomposition for material recoloring with consistent interreflections , 2011, SIGGRAPH 2011.

[2]  Raanan Fattal,et al.  Diffusion maps for edge-aware image editing , 2010, SIGGRAPH 2010.

[3]  Yizhou Yu,et al.  Example-based image color and tone style enhancement , 2011, ACM Trans. Graph..

[4]  François Pitié,et al.  Automated colour grading using colour distribution transfer , 2007, Comput. Vis. Image Underst..

[5]  Lawrence K. Saul,et al.  Think Globally, Fit Locally: Unsupervised Learning of Low Dimensional Manifold , 2003, J. Mach. Learn. Res..

[6]  Jason Lawrence,et al.  AppWand: editing measured materials using appearance-driven optimization , 2007, SIGGRAPH 2007.

[7]  Daniel Cohen-Or,et al.  Image Appearance Exploration by Model‐Based Navigation , 2009, Comput. Graph. Forum.

[8]  Masayuki Nakajima,et al.  Example-Based Color Transformation of Image and Video Using Basic Color Categories , 2007, IEEE Transactions on Image Processing.

[9]  Shi-Min Hu,et al.  Efficient affinity-based edit propagation using K-D tree , 2009, ACM Trans. Graph..

[10]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[11]  David A. Forsyth,et al.  Generalizing motion edits with Gaussian processes , 2009, ACM Trans. Graph..

[12]  H. Seidel,et al.  Pattern-aware Deformation Using Sliding Dockers , 2011, SIGGRAPH 2011.

[13]  O. Sorkine,et al.  Color harmonization , 2006, SIGGRAPH 2006.

[14]  Chung-Ming Wang,et al.  Example-based color alternation for images , 2010, 2010 2nd International Conference on Computer Engineering and Technology.

[15]  Fabio Pellacini,et al.  AppProp: all-pairs appearance-space edit propagation , 2008, ACM Trans. Graph..

[16]  Michael F. Cohen,et al.  Optimized Color Sampling for Robust Matting , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Lizhuang Ma,et al.  Color transfer in correlated color space , 2006, VRCIA '06.

[18]  Klaus Mueller,et al.  Transferring color to greyscale images , 2002, ACM Trans. Graph..

[19]  Fabio Pellacini,et al.  AppProp: all-pairs appearance-space edit propagation , 2008, SIGGRAPH 2008.

[20]  Dani Lischinski,et al.  Colorization using optimization , 2004, ACM Trans. Graph..

[21]  Ying-Qing Xu,et al.  Color Transfer Brush , 2007, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[22]  Ronald R. Coifman,et al.  Diffusion Maps, Spectral Clustering and Eigenfunctions of Fokker-Planck Operators , 2005, NIPS.

[23]  Chun Chen,et al.  Data-driven image color theme enhancement , 2010, SIGGRAPH 2010.

[24]  Stephen Lin,et al.  Intrinsic colorization , 2008, SIGGRAPH 2008.

[25]  Maureen C. Stone,et al.  A field guide to digital color , 2003 .

[26]  Zeev Farbman,et al.  Interactive local adjustment of tonal values , 2006, ACM Trans. Graph..

[27]  Lizhuang Ma,et al.  Gradient‐Preserving Color Transfer , 2009, Comput. Graph. Forum.

[28]  Fabio Pellacini,et al.  User‐Controllable Color Transfer , 2010, Comput. Graph. Forum.

[29]  Bing-Yu Chen,et al.  Example‐based Multiple Local Color Transfer by Strokes , 2008, Comput. Graph. Forum.

[30]  Bobby Bodenheimer,et al.  Synthesis and evaluation of linear motion transitions , 2008, TOGS.

[31]  Erik Reinhard,et al.  Color Transfer between Images , 2001, IEEE Computer Graphics and Applications.

[32]  Jitendra Malik,et al.  Spectral grouping using the Nystrom method , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Stephen Lin,et al.  Semantic colorization with internet images , 2011, ACM Trans. Graph..

[34]  Ieee Xplore,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence Information for Authors , 2022, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Shi-Min Hu,et al.  Efficient affinity-based edit propagation using K-D tree , 2009, SIGGRAPH 2009.

[36]  Chi-Keung Tang,et al.  Local color transfer via probabilistic segmentation by expectation-maximization , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[37]  Jiawen Chen,et al.  Real-time edge-aware image processing with the bilateral grid , 2007, SIGGRAPH 2007.

[38]  Anil Kokaram,et al.  The linear Monge-Kantorovitch linear colour mapping for example-based colour transfer , 2007 .

[39]  Shi-Min Hu,et al.  Instant Propagation of Sparse Edits on Images and Videos , 2010, Comput. Graph. Forum.

[40]  Lei Wang Toward A Discriminative Codebook: Codeword Selection across Multi-resolution , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[41]  stkiss Photoshop的“风”滤镜魔术 , 2002 .

[42]  Chi-Keung Tang,et al.  Soft Color Segmentation and Its Applications , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  Guillermo Sapiro,et al.  Fast image and video colorization using chrominance blending , 2006, IEEE Transactions on Image Processing.

[44]  Sunil Arya,et al.  ANN: library for approximate nearest neighbor searching , 1998 .

[45]  Ming C. Lin,et al.  Free-flowing granular materials with two-way solid coupling , 2010, SIGGRAPH 2010.

[46]  Luc Van Gool,et al.  Wide-baseline stereo matching with line segments , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[47]  Marc Jaeger,et al.  Virtual Reality Continuum And Its Applications , 2008 .

[48]  Masayuki Nakajima,et al.  Example-Based Color Stylization of Images , 2005, TAP.

[49]  Chuan-Kai Yang,et al.  Automatic Mood-Transferring between Color Images , 2008, IEEE Computer Graphics and Applications.