Colorization Using Quaternion Algebra with Automatic Scribble Generation

In current colorization techniques, major user intervention is required in the form of tedious, time-consuming scribble drawing. Moreover, color leakage usually occurs across contours and object boundaries. In this paper, we focus on automatic scribble generation and structure-preservation mechanism, which are still open issues of colorization. Firstly, we generate scribbles automatically along points where the spatial distribution entropy achieves locally extreme value. Given the color scribbles, we compute quaternion wavelet phases to conduct colorization along equal-phase lines. These lines across scribbles and monochrome patches locate textures with similar pattern distribution. Contour 'strength' model is also established in scale space to direct color propagation among similar edge structures. Finally, we reconstruct color image patches as vector elements using polar representation in quaternion algebra, well-preserving interrelationship between color channels. The experimental results demonstrate that the proposed colorization method can achieve natural color transitions between different objects with automatically generated scribbles.

[1]  Mark S. Drew,et al.  Realistic colorization via the structure tensor , 2008, 2008 15th IEEE International Conference on Image Processing.

[2]  Klaus Mueller,et al.  Transferring color to greyscale images , 2002, ACM Trans. Graph..

[3]  Rohini K. Srihari,et al.  Spatial color histograms for content-based image retrieval , 1999, Proceedings 11th International Conference on Tools with Artificial Intelligence.

[4]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[6]  Sang Uk Lee,et al.  Image and video colorization based on prioritized source propagation , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[7]  Abderrahim Elmoataz,et al.  Nonlocal graph regularization for image colorization , 2008, 2008 19th International Conference on Pattern Recognition.

[8]  Dani Lischinski,et al.  Colorization using optimization , 2004, ACM Trans. Graph..

[9]  Thomas S. Huang,et al.  Image processing , 1971 .

[10]  Stephen Lin,et al.  Intrinsic colorization , 2008, SIGGRAPH 2008.

[11]  Dani Lischinski,et al.  Colorization by example , 2005, EGSR '05.

[12]  Wen-Yuan Chen,et al.  Transferring color to grayscale images using vector quantization of luminance mapping techniques , 2009 .

[13]  Eduardo Bayro-Corrochano,et al.  The Theory and Use of the Quaternion Wavelet Transform , 2005, Journal of Mathematical Imaging and Vision.

[14]  Jirí Zára,et al.  Unsupervised colorization of black-and-white cartoons , 2004, NPAR '04.

[15]  Xiaokang Yang,et al.  QWT: Retrospective and New Applications , 2010, Geometric Algebra Computing.

[16]  Sang Uk Lee,et al.  Edge-preserving colorization using data-driven Random Walks with Restart , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[17]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.