Expanding Color Query Results via Image Recoloring

An image’s color palette can be used to search an image collection to retrieve images that share similar colors to the query palette color. The results of this approach are naturally limited to only those images in the database that share similar colors to the query. The idea proposed in this paper is to expand the search results by finding additional images in the collection that can be computationally recolored to better match the query. This not only provides more results to the user but also helps to extend the usefulness of the image collection. We describe a prototype system to realize this idea, using a two-step procedure. First, images in the database with color palettes similar to the query are identified to produce a set of initial results. Then, additional images that are semantically similar to these initial results are found and are modified using palette-based recoloring such that they better match the color query. We demonstrate results from our prototype and discuss several challenges for developing such image search systems.

[1]  Leonidas J. Guibas,et al.  The Earth Mover's Distance as a Metric for Image Retrieval , 2000, International Journal of Computer Vision.

[2]  Xing Mei,et al.  Content‐Based Colour Transfer , 2013, Comput. Graph. Forum.

[3]  Chun Chen,et al.  Data-driven image color theme enhancement , 2010, SIGGRAPH 2010.

[4]  Lizhuang Ma,et al.  Gradient‐Preserving Color Transfer , 2009, Comput. Graph. Forum.

[5]  Stephen DiVerdi,et al.  Palette-based photo recoloring , 2015, ACM Trans. Graph..

[6]  Neus Sabater,et al.  Optimal Transportation for Example-Guided Color Transfer , 2014, ACCV.

[7]  A.C. Kokaram,et al.  N-dimensional probability density function transfer and its application to color transfer , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[8]  Bolei Zhou,et al.  Semantic Understanding of Scenes Through the ADE20K Dataset , 2016, International Journal of Computer Vision.

[9]  Erik Reinhard,et al.  Colour Mapping: A Review of Recent Methods, Extensions and Applications , 2016, Comput. Graph. Forum.

[10]  Chi-Keung Tang,et al.  Local color transfer via probabilistic segmentation by expectation-maximization , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[11]  Michael S. Brown,et al.  Illuminant Aware Gamut‐Based Color Transfer , 2014, Comput. Graph. Forum.

[12]  Erik Reinhard,et al.  Progressive color transfer for images of arbitrary dynamic range , 2011, Comput. Graph..

[13]  Bart Thomee,et al.  New trends and ideas in visual concept detection: the MIR flickr retrieval evaluation initiative , 2010, MIR '10.

[14]  Erik Reinhard,et al.  Color Transfer between Images , 2001, IEEE Computer Graphics and Applications.