Using Color Compatibility for Assessing Image Realism

Why does placing an object from one photograph into another often make the colors of that object suddenly look wrong? One possibility is that humans prefer distributions of colors that are often found in nature; that is, we find pleasing these color combinations that we see often. Another possibility is that humans simply prefer colors to be consistent within an image, regardless of what they are. In this paper, we explore some of these issues by studying the color statistics of a large dataset of natural images, and by looking at differences in color distribution in realistic and unrealistic images. We apply our findings to two problems: 1) classifying composite images into realistic vs. non- realistic, and 2) recoloring image regions for realistic compositing.

[1]  Daniel Cohen-Or,et al.  Color harmonization , 2006, ACM Trans. Graph..

[2]  Leonidas J. Guibas,et al.  The Earth Mover's Distance as a Metric for Image Retrieval , 2000, International Journal of Computer Vision.

[3]  Yan Ke,et al.  The Design of High-Level Features for Photo Quality Assessment , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[4]  Patrick Pérez,et al.  Poisson image editing , 2003, ACM Trans. Graph..

[5]  Graham D. Finlayson,et al.  Color by Correlation: A Simple, Unifying Framework for Color Constancy , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Masayuki Nakajima,et al.  Example-Based Color Stylization of Images , 2005, TAP.

[7]  Siwei Lyu,et al.  How realistic is photorealistic? , 2005, IEEE Transactions on Signal Processing.

[8]  P. Cavanagh The artist as neuroscientist , 2005, Nature.

[9]  Riad I. Hammoud,et al.  Estimating the photorealism of images: distinguishing paintings from photographs , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[10]  Dale Purves,et al.  The empirical basis of color perception , 2002, Consciousness and Cognition.

[11]  M. J. Luque,et al.  Implementations of a novel algorithm for colour constancy , 1997, Vision Research.

[12]  Rong Jin,et al.  Discriminative Cluster Refinement: Improving Object Category Recognition Given Limited Training Data , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Erik Reinhard,et al.  Color Transfer between Images , 2001, IEEE Computer Graphics and Applications.

[14]  David A. Forsyth,et al.  A novel algorithm for color constancy , 1990, International Journal of Computer Vision.

[15]  Antonio Torralba,et al.  LabelMe: A Database and Web-Based Tool for Image Annotation , 2008, International Journal of Computer Vision.

[16]  Erik Reinhard,et al.  Real-time color blending of rendered and captured video , 2004 .

[17]  Siwei Lyu,et al.  A digital technique for art authentication , 2004, Proc. Natl. Acad. Sci. USA.

[18]  Alexei A. Efros,et al.  Photo clip art , 2007, ACM Trans. Graph..