Example-based color transformation for image and video

Color is very important in setting the mood of images and video sequences. For this reason, color transformation is one of the most important features in photo-editing or video post-production tools because even slight modifications of colors in an image can strongly increase its visual appeal. However, conventional color editing tools require user's manual operation for detailed color manipulation. Such manual operation becomes burden especially when editing video frame sequences. To avoid this problem, we previously suggested a method [Chang et al. 2004] that performs an example-based color stylization of images using perceptual color categories. In this paper, we extend this method to make the algorithm more robust and to stylize the colors of video frame sequences. The main extension is the following 5 points: applicable to images taken under a variety of light conditions; speeding up the color naming step; improving the mapping between source and reference colors when there is a disparity in size of the chromatic categories; separate handling of achromatic categories from chromatic categories; and extending the algorithm along the temporal axis to allow video processing. We present a variety of results, arguing that these images and videos convey a different, but coherent mood.

[1]  Klaus Mueller,et al.  Transferring color to greyscale images , 2002, ACM Trans. Graph..

[2]  David Salesin,et al.  Image Analogies , 2001, SIGGRAPH.

[3]  D H Brainard,et al.  Bayesian color constancy. , 1997, Journal of the Optical Society of America. A, Optics, image science, and vision.

[4]  Erik Reinhard,et al.  Color Transfer between Images , 2001, IEEE Computer Graphics and Applications.

[5]  Maya R. Gupta,et al.  Simulating the effect of illumination using color transformations , 2005, IS&T/SPIE Electronic Imaging.

[6]  P. Kay.  Basic Color Terms: Their Universality and Evolution , 1969 .

[7]  Brian V. Funt,et al.  A data set for color research , 2002 .

[8]  Brian V. Funt,et al.  Colour by Correlation in a Three-Dimensional Colour Space , 2000, ECCV.

[9]  R. M. Boynton,et al.  Categorical color perception of Japanese observers: Comparison with that of Americans , 1987, Vision Research.

[10]  Graham D. Finlayson,et al.  Color in Perspective , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  David A. Forsyth,et al.  A novel algorithm for color constancy , 1990, International Journal of Computer Vision.

[12]  Donald I. A. MacLeod,et al.  Influence of scene statistics on colour constancy , 2002, Nature.

[13]  C. L. Hardin,et al.  Color categories in thought and language: Author index , 1997 .

[14]  Peter Shirley,et al.  A Spatial Post-Processing Algorithm for Images of Night Scenes , 2002, J. Graphics, GPU, & Game Tools.

[15]  Brian V. Funt,et al.  Learning Color Constancy , 1996, CIC.

[16]  H. S. Straight.  Color Categories in Thought and Language , 2003 .

[17]  E. R. Heider.  Universals in color naming and memory. , 1972, Journal of experimental psychology.

[18]  E. Land.  The retinex theory of color vision. , 1977, Scientific American.

[19]  Graham D. Finlayson,et al.  Color by Correlation: A Simple, Unifying Framework for Color Constancy , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Keiji Uchikawa,et al.  Example-based color stylization based on categorical perception , 2004, APGV '04.

[21]  Graham D. Finlayson,et al.  A theory of selection for gamut mapping colour constancy , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).