Image Colorization: A Study of Coloring of Monochrome Image@@@—白黒画像・映像を自動でカラー化する—

Image colorization has been studied to obtain color images from monochrome images. Recently, deep-learningbased colorization algorithms have enabled the automatic colorization of an image. In this manuscript, we describe some image colorization algorithms, which can be classified into three kinds on the basis of the difference in the intervention by the user: some color scribbles by the user, the source color image provided by the user, and no intervention of the user. Furthermore, colorization applications, such as medical image processing, animation production, and color image coding, are also described.

[1]  C. PrashanthK.  Colorization-Based Compression Using Optimization by L 1 Minimization Prashanth , 2014 .

[2]  Hiroshi Ishikawa,et al.  Let there be color! , 2016, ACM Trans. Graph..

[3]  Bogdan Smolka,et al.  Colorization of Medical Images , 2009 .

[4]  Toshihiro Furukawa,et al.  High resolution depth image recovery algorithm based on the modeling of the sum of an average distance image and a surface image , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[5]  Shunsuke Ono,et al.  Image colorization based on ADMM with fast singular value thresholding by Chebyshev polynomial approximation , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[6]  Ami A. Shah,et al.  Medical Image Colorization using Optimization Technique , 2013 .

[7]  Muhammad Usman Ghani Khan,et al.  Medical Image Colorization for Better Visualization and Segmentation , 2017, Annual Conference on Medical Image Understanding and Analysis.

[8]  Horst Bischof,et al.  Image Guided Depth Upsampling Using Anisotropic Total Generalized Variation , 2013, 2013 IEEE International Conference on Computer Vision.

[9]  Xueting Liu,et al.  Deep extraction of manga structural lines , 2017, ACM Trans. Graph..

[10]  Ralph R. Martin,et al.  Vectorizing Cartoon Animations , 2009, IEEE Transactions on Visualization and Computer Graphics.

[11]  Sumana Gupta,et al.  Colorization of grayscale images and videos using a semiautomatic approach , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[12]  Yoshinori Sakai,et al.  Novel inverse colorization for image compression , 2009, 2009 Picture Coding Symposium.

[13]  Klaus Mueller,et al.  Transferring color to greyscale images , 2002, ACM Trans. Graph..

[14]  Hujun Bao,et al.  A unified active and semi-supervised learning framework for image compression , 2009, CVPR.

[15]  Dani Lischinski,et al.  Colorization using optimization , 2004, SIGGRAPH 2004.

[16]  Bo Li,et al.  Example-Based Image Colorization Using Locality Consistent Sparse Representation , 2017, IEEE Transactions on Image Processing.

[17]  Furukawa Toshihiro,et al.  Image Colorization Based on The Mixed L0/L1 Norm Minimization , 2012 .

[18]  Oscar C. Au,et al.  Image colorization using sparse representation , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[19]  Yao Wang,et al.  Color-Guided Depth Recovery From RGB-D Data Using an Adaptive Autoregressive Model , 2014, IEEE Transactions on Image Processing.

[20]  Uri Lipowezky,et al.  Grayscale aerial and space image colorization using texture classification , 2006, Pattern Recognit. Lett..

[21]  Guillermo Sapiro,et al.  Fast image and video colorization using chrominance blending , 2006, IEEE Transactions on Image Processing.

[22]  Masaaki Ikehara,et al.  Color image coding based on linear combination of adaptive colorspaces , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[23]  Shunsuke Ono,et al.  Colorization-based coding by focusing on characteristics of colorization bases , 2010, 28th Picture Coding Symposium.

[24]  Joachim Weickert,et al.  Turning Diffusion-Based Image Colorization Into Efficient Color Compression , 2017, IEEE Transactions on Image Processing.

[25]  S. V. N. Vishwanathan,et al.  Learning to compress images and videos , 2007, ICML '07.

[26]  Deepu Rajan,et al.  Image colorization using similar images , 2012, ACM Multimedia.

[27]  Zhihua Zhang,et al.  Colorization by Matrix Completion , 2012, AAAI.

[28]  Michael Elad,et al.  Sparse Representation for Color Image Restoration , 2008, IEEE Transactions on Image Processing.

[29]  Aurélie Bugeau,et al.  Variational Exemplar-Based Image Colorization , 2014, IEEE Transactions on Image Processing.

[30]  Oscar C. Au,et al.  Image colorization via color propagation and rank minimization , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[31]  Toshihiro Furukawa,et al.  Representative pixels compression algorithm using graph signal processing for colorization-based image coding , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[32]  Dani Lischinski,et al.  Colorization using optimization , 2004, ACM Trans. Graph..

[33]  Sven Behnke,et al.  RGB-D object recognition and pose estimation based on pre-trained convolutional neural network features , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[34]  Domonkos Varga,et al.  Automatic Cartoon Colorization Based on Convolutional Neural Network , 2017, CBMI.

[35]  Tien-Tsin Wong,et al.  Manga colorization , 2006, ACM Trans. Graph..

[36]  Tsuyoshi Nakamura,et al.  Color Transfer between Images with IEC , 2004 .

[37]  Jirí Zára,et al.  Unsupervised colorization of black-and-white cartoons , 2004, NPAR '04.

[38]  Hendrik P. A. Lensch,et al.  Infrared Colorization Using Deep Convolutional Neural Networks , 2016, 2016 15th IEEE International Conference on Machine Learning and Applications (ICMLA).

[39]  Tien-Tsin Wong,et al.  Manga colorization , 2006, SIGGRAPH 2006.

[40]  Bin Sheng,et al.  Deep Colorization , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[41]  Ying Chen,et al.  Efficient manifold-preserving edit propagation using quad-tree data structures , 2018, Multimedia Tools and Applications.

[42]  Alexei A. Efros,et al.  Colorful Image Colorization , 2016, ECCV.