Complementary Color Wavelet: A Novel Tool for the Color Image/Video Analysis and Processing

In human vision, it has been well understood that the red, green, and blue (RGB) trichromatic system, whose colors can be well expressed by an RGB hue ring with complementary color relations, is the most accessible and extensible color representation. However, such color relations rarely play a role in color image/video processing tools such as wavelets. In this paper, the gap between wavelets and complementary color relations is filled by designing a novel color image/video processing tool called the complementary color wavelet transform. Our novel wavelets consist of a family of well-designed 2-D complex wavelets with $2\pi /3$ phase differences copied from the R, G, and B angle relations on the RGB hue ring. Analyses show that our new wavelets can not only utilize the complementary color relations but also inherit and improve upon the advantages of classical complex wavelets, such as their multi-resolution, directional selectivity, and shift-invariance properties. By the newly designed wavelets and by properly adding and/or subtracting the wavelet coefficients of a color image/video, some color-related image/video processing applications that are typically seen as infeasible or difficult to achieve by traditional methods, for instance, capturing and classifying local color changes, statistical modeling of the wavelet coefficients among the color channels, and multi-resolution directional color filtering, can be performed very easily. The cost for this is simply a transform redundancy increase (2.25 times that of classical complex wavelets). We provide three application examples of our method: color filtering, texture retrieval, and video quality assessment. The results show that our new wavelet tool greatly outperforms traditional methods.

[1]  Rajiv Soundararajan,et al.  Study of Subjective and Objective Quality Assessment of Video , 2010, IEEE Transactions on Image Processing.

[2]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  L. Demanet,et al.  Wave atoms and sparsity of oscillatory patterns , 2007 .

[4]  Michael Felsberg,et al.  The monogenic signal , 2001, IEEE Trans. Signal Process..

[5]  Ivan W. Selesnick,et al.  The design of approximate Hilbert transform pairs of wavelet bases , 2002, IEEE Trans. Signal Process..

[6]  Joost van de Weijer,et al.  Boosting color saliency in image feature detection , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Christine Fernandez-Maloigne,et al.  Vector Extension of Monogenic Wavelets for Geometric Representation of Color Images , 2013, IEEE Transactions on Image Processing.

[8]  Alan C. Bovik,et al.  RRED Indices: Reduced Reference Entropic Differencing for Image Quality Assessment , 2012, IEEE Transactions on Image Processing.

[9]  J. Thiran Recursive digital filters with maximally flat group delay , 1971 .

[10]  Laurent Demanet,et al.  Fast Discrete Curvelet Transforms , 2006, Multiscale Model. Simul..

[11]  Allan Hanbury,et al.  Constructing cylindrical coordinate colour spaces , 2008, Pattern Recognit. Lett..

[12]  Hua Huang,et al.  No-reference image quality assessment in curvelet domain , 2014, Signal Process. Image Commun..

[13]  Stephen J. Sangwine,et al.  Hypercomplex Fourier Transforms of Color Images , 2007, IEEE Trans. Image Process..

[14]  C. Eddie Moxey,et al.  Hypercomplex correlation techniques for vector images , 2003, IEEE Trans. Signal Process..

[15]  N. Kingsbury Complex Wavelets for Shift Invariant Analysis and Filtering of Signals , 2001 .

[16]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[17]  Philippe Carré,et al.  Elliptical Monogenic Wavelets for the Analysis and Processing of Color Images , 2016, IEEE Transactions on Signal Processing.

[18]  H. Ozkaramanli,et al.  Hilbert transform pairs of orthogonal wavelet bases: necessary and sufficient conditions , 2005, IEEE Transactions on Signal Processing.

[19]  Licheng Yu,et al.  Vector Sparse Representation of Color Image Using Quaternion Matrix Analysis , 2015, IEEE Transactions on Image Processing.

[20]  Rajiv Soundararajan,et al.  Video Quality Assessment by Reduced Reference Spatio-Temporal Entropic Differencing , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[21]  Stephen J. Sangwine,et al.  Colour image edge detector based on quaternion convolution , 1998 .

[22]  Richard Baraniuk,et al.  The Dual-tree Complex Wavelet Transform , 2007 .

[23]  I. Selesnick Hilbert transform pairs of wavelet bases , 2001, IEEE Signal Processing Letters.

[24]  R. W. Pridmore Complementary colors theory of color vision: physiology, color mixture, color constancy and color perception , 2011 .

[25]  Yap-Peng Tan,et al.  Edge-preserving image denoising via optimal color space projection , 2006, IEEE Transactions on Image Processing.

[26]  Fionn Murtagh,et al.  Gray and color image contrast enhancement by the curvelet transform , 2003, IEEE Trans. Image Process..

[27]  Martin J. Wainwright,et al.  Image denoising using scale mixtures of Gaussians in the wavelet domain , 2003, IEEE Trans. Image Process..

[28]  Philippe Carré,et al.  Color monogenic wavelets for image analysis , 2011, 2011 18th IEEE International Conference on Image Processing.

[29]  Ramesh A. Gopinath,et al.  The phaselet transform-an integral redundancy nearly shift-invariant wavelet transform , 2003, IEEE Trans. Signal Process..

[30]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[31]  Azeddine Beghdadi,et al.  Image quality assessment based on wave atoms transform , 2010, 2010 IEEE International Conference on Image Processing.

[32]  Andreas Uhl,et al.  Efficient Texture Image Retrieval Using Copulas in a Bayesian Framework , 2011, IEEE Transactions on Image Processing.

[33]  Minh N. Do,et al.  Wavelet-based texture retrieval using generalized Gaussian density and Kullback-Leibler distance , 2002, IEEE Trans. Image Process..

[34]  Ralph W. Pridmore Complementary colors: The structure of wavelength discrimination, uniform hue, spectral sensitivity, saturation, chromatic adaptation, and chromatic induction , 2009 .

[35]  Zhou Wang,et al.  Reduced-Reference Image Quality Assessment Using Divisive Normalization-Based Image Representation , 2009, IEEE Journal of Selected Topics in Signal Processing.

[36]  Li Chen,et al.  Automatic movie restoration based on wave atom transform and nonparametric model , 2012, EURASIP J. Adv. Signal Process..

[37]  Richard G. Baraniuk,et al.  Coherent Multiscale Image Processing Using Dual-Tree Quaternion Wavelets , 2008, IEEE Transactions on Image Processing.