Palette-based photo recoloring

Image editing applications offer a wide array of tools for color manipulation. Some of these tools are easy to understand but offer a limited range of expressiveness. Other more powerful tools are time consuming for experts and inscrutable to novices. Researchers have described a variety of more sophisticated methods but these are typically not interactive, which is crucial for creative exploration. This paper introduces a simple, intuitive and interactive tool that allows non-experts to recolor an image by editing a color palette. This system is comprised of several components: a GUI that is easy to learn and understand, an efficient algorithm for creating a color palette from an image, and a novel color transfer algorithm that recolors the image based on a user-modified palette. We evaluate our approach via a user study, showing that it is faster and easier to use than two alternatives, and allows untrained users to achieve results comparable to those of experts using professional software.

[1]  Shi-Min Hu,et al.  Instant Propagation of Sparse Edits on Images and Videos , 2010, Comput. Graph. Forum.

[2]  Pat Hanrahan,et al.  Probabilistic color-by-numbers , 2013, ACM Trans. Graph..

[3]  O. Sorkine,et al.  Color harmonization , 2006, SIGGRAPH 2006.

[4]  Aaron Hertzmann,et al.  Color compatibility from large datasets , 2011, ACM Trans. Graph..

[5]  P. Deb.  Finite Mixture Models , 2008 .

[6]  Szymon Rusinkiewicz,et al.  AutoStyle: Automatic Style Transfer from Image Collections to Users' Images , 2014, Comput. Graph. Forum.

[7]  Erik Reinhard,et al.  Color Transfer between Images , 2001, IEEE Computer Graphics and Applications.

[8]  Gabriela Csurka,et al.  Learning moods and emotions from color combinations , 2010, ICVGIP '10.

[9]  Fabio Pellacini,et al.  AppProp: all-pairs appearance-space edit propagation , 2008, ACM Trans. Graph..

[10]  Tien-Tsin Wong,et al.  Manga colorization , 2006, ACM Trans. Graph..

[11]  A.C. Kokaram,et al.  N-dimensional probability density function transfer and its application to color transfer , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[12]  M. Luo,et al.  The development of the CIE 2000 Colour Difference Formula , 2001 .

[13]  Dani Lischinski,et al.  Non-rigid dense correspondence with applications for image enhancement , 2011, ACM Trans. Graph..

[14]  Greg Mori,et al.  Guiding model search using segmentation , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[15]  Sylvain Paris,et al.  Learning photographic global tonal adjustment with a database of input / output image pairs , 2011, CVPR 2011.

[16]  Fabio Pellacini,et al.  AppProp: all-pairs appearance-space edit propagation , 2008, SIGGRAPH 2008.

[17]  D.M. Mount,et al.  An Efficient k-Means Clustering Algorithm: Analysis and Implementation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Dani Lischinski,et al.  Gradient Domain High Dynamic Range Compression , 2023 .

[19]  Chun Chen,et al.  Data-driven image color theme enhancement , 2010, SIGGRAPH 2010.

[20]  Dani Lischinski,et al.  Optimizing color consistency in photo collections , 2013, ACM Trans. Graph..

[21]  Kwan H. Lee,et al.  Local color transfer between images using dominant colors , 2013, J. Electronic Imaging.

[22]  Daniel Cohen-Or,et al.  Image Appearance Exploration by Model‐Based Navigation , 2009, Comput. Graph. Forum.

[23]  Tien-Tsin Wong,et al.  Manga colorization , 2006, SIGGRAPH 2006.

[24]  Shi-Min Hu,et al.  Efficient affinity-based edit propagation using K-D tree , 2009, ACM Trans. Graph..

[25]  Liqing Zhang,et al.  Color conceptualization , 2007, ACM Multimedia.

[26]  Paul A. Beardsley,et al.  Design galleries: a general approach to setting parameters for computer graphics and animation , 1997, SIGGRAPH.

[27]  Pat Hanrahan,et al.  Modeling how people extract color themes from images , 2013, CHI.

[28]  Chi-Keung Tang,et al.  Local color transfer via probabilistic segmentation by expectation-maximization , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[29]  Aleksandra Mojsilovic,et al.  A computational model for color naming and describing color composition of images , 2005, IEEE Transactions on Image Processing.

[30]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[31]  Dani Lischinski,et al.  Colorization using optimization , 2004, ACM Trans. Graph..

[32]  Adrian Secord,et al.  Weighted Voronoi stippling , 2002, NPAR '02.

[33]  Andrew W. Moore,et al.  X-means: Extending K-means with Efficient Estimation of the Number of Clusters , 2000, ICML.

[34]  Lianhong Cai,et al.  Affective image adjustment with a single word , 2013, The Visual Computer.

[35]  Qinping Zhao,et al.  Sparse Dictionary Learning for Edit Propagation of High-Resolution Images , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[36]  Xiaowu Chen,et al.  Manifold preserving edit propagation , 2012, ACM Trans. Graph..

[37]  A. Mojsilovi.  A Computational Model for Color Naming and Describing Color Composition of Images , 2022 .

[38]  Edward H. Adelson,et al.  Eurographics Symposium on Rendering 2008 Scribbleboost: Adding Classification to Edge-aware Interpolation of Local Image and Video Adjustments , 2022 .

[39]  Tsuhan Chen,et al.  > Replace This Line with Your Paper Identification Number (double-click Here to Edit) < , 2022 .

[40]  Masayuki Nakajima,et al.  Example-Based Color Stylization of Images , 2005, TAP.