Automatic colourization of grayscale images based on tensor decomposition

In this paper a colourizing technique based on some tensor properties is proposed. Toward this goal, it is clarified that tensor decomposition possesses the ability of extracting and gathering overall colour information. The methodology considers a grayscale pixel as a balanced vector in RGB colour space. Any deviation to unbalance the colour coordinates means adding colour information to the initial pixel. For finding the appropriate direction of deviation, the proposed technique uses tensor decomposition to extract colour information from a block divided exemplar colour image called reference. Then apply this direction to the best matched block of the grayscale image based on a similarity criterion while its basic structure is preserved. Finally by retrieving from tensor space into spatial domain the conversion is fulfilled. The similarity criteria for block matching and the plausibility of the system output are the most challenging problems. Both images blocks are considered as 3D tensors and Tucker3 with its unique properties is utilized for transferring the colour information. The novelty, simplicity, accuracy, and the conversion speed are some parameters which are introduced and developed by the proposed algorithm. This approach proves that in comparison with spatial or frequency domain, transforming the colour information into tensor space make it more clear and give us better ability of rendering. The results show that the proposed algorithm is able to present the average structural similarity up to 94%.

[1]  Klaus Mueller,et al.  Transferring color to greyscale images , 2002, ACM Trans. Graph..

[2]  Bo Li,et al.  Example-Based Image Colorization Using Locality Consistent Sparse Representation , 2017, IEEE Transactions on Image Processing.

[3]  Tamara G. Kolda,et al.  Tensor Decompositions and Applications , 2009, SIAM Rev..

[4]  Yiannis S. Boutalis,et al.  FCTH: Fuzzy Color and Texture Histogram - A Low Level Feature for Accurate Image Retrieval , 2008, 2008 Ninth International Workshop on Image Analysis for Multimedia Interactive Services.

[5]  Dani Lischinski,et al.  Colorization using optimization , 2004, ACM Trans. Graph..

[6]  Aurélie Bugeau,et al.  Exemplar-based colorization in RGB color space , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[7]  C. Saravanan,et al.  Color Image to Grayscale Image Conversion , 2010, 2010 Second International Conference on Computer Engineering and Applications.

[8]  Nozha Boujemaa,et al.  Using Fuzzy Histograms and Distances for Color Image Retrieval , 2000 .

[9]  Aurélie Bugeau,et al.  Luminance-Chrominance Model for Image Colorization , 2015, SIAM J. Imaging Sci..

[10]  Bernhard Schölkopf,et al.  Automatic Image Colorization Via Multimodal Predictions , 2008, ECCV.

[11]  Andrzej Cichocki,et al.  Tensor Decompositions for Signal Processing Applications: From two-way to multiway component analysis , 2014, IEEE Signal Processing Magazine.

[12]  Hui Huang,et al.  Manifold-preserving image colorization with nonlocal estimation , 2015, Multimedia Tools and Applications.

[13]  Stefanos D. Kollias,et al.  A fuzzy video content representation for video summarization and content-based retrieval , 2000, Signal Process..

[14]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[15]  Tamara G. Kolda,et al.  Multilinear Algebra for Analyzing Data with Multiple Linkages , 2006, Graph Algorithms in the Language of Linear Algebra.

[16]  Gregory Shakhnarovich,et al.  Learning Representations for Automatic Colorization , 2016, ECCV.

[17]  Deepu Rajan,et al.  Image colorization using similar images , 2012, ACM Multimedia.

[18]  Afonso Paiva,et al.  Colorization by Multidimensional Projection , 2012, 2012 25th SIBGRAPI Conference on Graphics, Patterns and Images.

[19]  Morten Mørup,et al.  Applications of tensor (multiway array) factorizations and decompositions in data mining , 2011, WIREs Data Mining Knowl. Discov..

[20]  David A. Forsyth,et al.  Learning Large-Scale Automatic Image Colorization , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[21]  Mark S. Drew,et al.  Realistic colorization via the structure tensor , 2008, 2008 15th IEEE International Conference on Image Processing.

[22]  Vassilios Morellas,et al.  Tensor Sparse Coding for Positive Definite Matrices. , 2013, IEEE transactions on pattern analysis and machine intelligence.

[23]  Dani Lischinski,et al.  Colorization by example , 2005, EGSR '05.

[24]  Bin Sheng,et al.  Deep Colorization , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[25]  Aurélie Bugeau,et al.  Variational Exemplar-Based Image Colorization , 2014, IEEE Transactions on Image Processing.

[26]  Joos Vandewalle,et al.  A Multilinear Singular Value Decomposition , 2000, SIAM J. Matrix Anal. Appl..

[27]  Min Hu,et al.  Efficient image colorization based on seed pixel selection , 2016, Multimedia Tools and Applications.

[28]  Mohammed Abdul Waheed,et al.  Turning Diffusion Based Image Colorization Into Efficient Color Compression , 2018, International Journal of Trend in Scientific Research and Development.

[29]  Haiping Lu,et al.  A survey of multilinear subspace learning for tensor data , 2011, Pattern Recognit..

[30]  Stephen Lin,et al.  Semantic colorization with internet images , 2011, ACM Trans. Graph..

[31]  Yi Wan,et al.  A Novel Framework for Optimal RGB to Grayscale Image Conversion , 2016, 2016 8th International Conference on Intelligent Human-Machine Systems and Cybernetics (IHMSC).

[32]  Giulia Boato,et al.  RAISE: a raw images dataset for digital image forensics , 2015, MMSys.