Image Colorization with Neural Networks

We propose a method for colorizing photos, this is, providing a color version of a given gray scale image. The method does not depend on human input, and is completely automatic. It does not depend on segmentation, scribbling or sophisticated image processing techniques. It is based on training a simple classifier using back propagation over a training set of color and corresponding gray scale pictures. The classifier predicts the color of a pixel based on the gray level of the pixels surrounding it. This small patch captures a local texture. To keep the domain for the predictor small, the colors are reduced using Self Organizing Maps. This reduction produces a small set of chroma values with enough variation as to generate good approximations for all colors in the training set.

[1]  Antonio Torralba,et al.  Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope , 2001, International Journal of Computer Vision.

[2]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[3]  Dani Lischinski,et al.  Colorization by example , 2005, EGSR '05.

[4]  Guillermo Sapiro,et al.  Fast image and video colorization using chrominance blending , 2006, IEEE Transactions on Image Processing.

[5]  Bin Sheng,et al.  Deep Colorization , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[6]  Jang-Hee Yoo,et al.  A Coloring Method of Gray-Level Image Using Neural Networks , 1997, International Conference on Neural Information Processing.

[7]  Jeff Hwang,et al.  Image Colorization with Deep Convolutional Neural Networks , 2016 .

[8]  Robert M. Gray,et al.  An Algorithm for Vector Quantizer Design , 1980, IEEE Trans. Commun..

[9]  Teuvo Kohonen,et al.  Self-organized formation of topologically correct feature maps , 2004, Biological Cybernetics.

[10]  Gregory Shakhnarovich,et al.  Learning Representations for Automatic Colorization , 2016, ECCV.

[11]  Dani Lischinski,et al.  Colorization using optimization , 2004, ACM Trans. Graph..

[12]  Klaus Mueller,et al.  Transferring color to greyscale images , 2002, ACM Trans. Graph..

[13]  Alexei A. Efros,et al.  Colorful Image Colorization , 2016, ECCV.