Color Image Analysis by Quaternion-Type Moments

In this paper, by using the quaternion algebra, the conventional complex-type moments (CTMs) for gray-scale images are generalized to color images as quaternion-type moments (QTMs) in a holistic manner. We first provide a general formula of QTMs from which we derive a set of quaternion-valued QTM invariants (QTMIs) to image rotation, scale and translation transformations by eliminating the influence of transformation parameters. An efficient computation algorithm is also proposed so as to reduce computational complexity. The performance of the proposed QTMs and QTMIs are evaluated considering several application frameworks ranging from color image reconstruction, face recognition to image registration. We show they achieve better performance than CTMs and CTM invariants (CTMIs). We also discuss the choice of the unit pure quaternion influence with the help of experiments. $$(i-j-k)/\sqrt{3}$$(i-j-k)/3 appears to be an optimal choice.

[1]  S. Sangwine.  Fourier transforms of colour images using quaternion or hypercomplex, numbers , 1996 .

[2]  Soo-Chang Pei,et al.  Quaternion matrix singular value decomposition and its applications for color image processing , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[3]  Nicolas Le Bihan,et al.  Quaternion principal component analysis of color images , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[4]  Henning Rasmussen,et al.  Local quaternion Fourier transform and color image texture analysis , 2010, Signal Process..

[5]  Huazhong Shu,et al.  Moment-based approaches in imaging. Part 1, basic features. , 2007, IEEE engineering in medicine and biology magazine : the quarterly magazine of the Engineering in Medicine & Biology Society.

[6]  Limin Luo,et al.  Moment-Based Approaches in Imaging. 1. Basic Features [A Look At ...] , 2007, IEEE Engineering in Medicine and Biology Magazine.

[7]  Huazhong Shu,et al.  Combined Invariants to Similarity Transformation and to Blur Using Orthogonal Zernike Moments , 2011, IEEE Transactions on Image Processing.

[8]  William Rowan Hamilton,et al.  Elements of Quaternions , 1969 .

[9]  Ming Zhu,et al.  Quaternion Fourier-Mellin moments for color images , 2011, Pattern Recognit..

[10]  Huazhong Shu,et al.  Construction of a complete set of orthogonal Fourier-Mellin moment invariants for pattern recognition applications , 2010, Image Vis. Comput..

[11]  Dimitrios S. Alexiadis,et al.  Estimation of Motions in Color Image Sequences Using Hypercomplex Fourier Transforms , 2009, IEEE Transactions on Image Processing.

[12]  Chee-Way Chong,et al.  Translation invariants of Zernike moments , 2003, Pattern Recognit..

[13]  Stephen J. Sangwine,et al.  Decomposition of 2D Hypercomplex Fourier transforms into pairs of complex fourier transforms , 2000, 2000 10th European Signal Processing Conference.

[14]  Luigi Fortuna,et al.  Neural networks for quaternion-valued function approximation , 1994, Proceedings of IEEE International Symposium on Circuits and Systems - ISCAS '94.

[15]  Roland T. Chin,et al.  On Image Analysis by the Methods of Moments , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Eckhard Hitzer.  Quaternionic Fourier-Mellin Transform , 2013, ArXiv.

[17]  Yanfeng Sun,et al.  Color face recognition based on quaternion matrix representation , 2011, Pattern Recognit. Lett..

[18]  Mawardi Bahri,et al.  Clifford Algebra Cl3, 0-Valued Wavelet Transformation, Clifford Wavelet Uncertainty inequality and Clifford Gabor Wavelets , 2007, Int. J. Wavelets Multiresolution Inf. Process..

[19]  Nicolas Le Bihan,et al.  Color image watermarking using quaternion Fourier transform , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[20]  Bei Jing Chen,et al.  Color Face Recognition Based on Quaternion Zernike Moment Invariants and Quaternion BP Neural Network , 2013 .

[21]  Yue Zhang,et al.  Affine Legendre Moment Invariants for Image Watermarking Robust to Geometric Distortions , 2011, IEEE Transactions on Image Processing.

[22]  Yasuaki Kuroe,et al.  Applications of Clifford’s Geometric Algebra , 2013, ArXiv.

[23]  Bo Fu,et al.  Magnitude-Phase of Quaternion Wavelet Transform for Texture Representation Using Multilevel Copula , 2013, IEEE Signal Processing Letters.

[24]  Eduardo Bayro-Corrochano,et al.  The Theory and Use of the Quaternion Wavelet Transform , 2005, Journal of Mathematical Imaging and Vision.

[25]  Yi-Hsien Lin,et al.  Template matching using the parametric template vector with translation, rotation and scale invariance , 2008, Pattern Recognit..

[26]  Weixing Wang,et al.  Algorithm for automatic image registration on Harris-Laplace features , 2009 .

[27]  Stephen J. Sangwine,et al.  Hypercomplex Fourier Transforms of Color Images , 2001, IEEE Transactions on Image Processing.

[28]  Baba C. Vemuri,et al.  A Quaternion Framework for Color Image Smoothing and Segmentation , 2011, International Journal of Computer Vision.

[29]  Chaoyang Zhang,et al.  A New Color Pattern Recognition Algorithm Based On Quaternion Correlation , 2008, 2008 IEEE International Conference on Networking, Sensing and Control.

[30]  Chandan Singh,et al.  On the fast computation of orthogonal Fourier–Mellin moments with improved numerical stability , 2010, Journal of Real-Time Image Processing.

[31]  Yue-Nan Li.  Quaternion Polar Harmonic Transforms for Color Images , 2013, IEEE Signal Processing Letters.

[32]  C. Malsburg,et al.  The role of complex cells in object recognition , 2002, Vision Research.

[33]  Wang Weijiang,et al.  Color Watermarking Algorithm Based on Modified QFFT and DCT , 2010, 2010 International Conference on Optoelectronics and Image Processing.

[34]  Richard G. Baraniuk,et al.  Directional hypercomplex wavelets for multidimensional signal analysis and processing , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[35]  Sameer A. Nene,et al.  Columbia Object Image Library (COIL100) , 1996 .

[36]  Justin Pearson,et al.  Neural networks in the Clifford domain , 1994, Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94).

[37]  Eduardo Bayro-Corrochano,et al.  Clifford Support Vector Machines for Classification, Regression, and Recurrence , 2010, IEEE Transactions on Neural Networks.

[38]  Laurent Mascarilla,et al.  Color Fourier-Mellin descriptors for image recognition , 2014, Pattern Recognit. Lett..

[39]  T. Ell.  Hypercomplex spectral transformations , 1992 .

[40]  N. L. Bihan,et al.  Quaternionic Independent Component Analysis using hypercomplex nonlinearities , 2006 .

[41]  Huazhong Shu,et al.  General method to derive the relationship between two sets of Zernike coefficients corresponding to different aperture sizes. , 2006, Journal of the Optical Society of America. A, Optics, image science, and vision.

[42]  Gang Chen,et al.  Quaternion Zernike moments and their invariants for color image analysis and object recognition , 2012, Signal Process..

[43]  Andreas Koschan,et al.  Digital Color Image Processing , 2008 .

[44]  Laurent Mascarilla,et al.  Color Object Recognition Based on a Clifford Fourier Transform , 2011, Guide to Geometric Algebra in Practice.

[45]  Fugui Wang,et al.  Potential of MODIS EVI in Identifying Hurricane Disturbance to Coastal Vegetation in the Northern Gulf of Mexico , 2009, Remote. Sens..

[46]  Chandan Singh,et al.  Analysis of algorithms for fast computation of pseudo Zernike moments and their numerical stability , 2012, Digit. Signal Process..

[47]  Miroslaw Pawlak,et al.  On Image Analysis by Moments , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[48]  Min Wang,et al.  Fast computation of Zernike moments in polar coordinates , 2012 .

[49]  Gerik Scheuermann,et al.  Detection of Outer Rotations on 3D-Vector Fields with Iterative Geometric Correlation and its Efficiency , 2013, ArXiv.

[50]  Jan Flusser,et al.  Affine Moment Invariants of Color Images , 2009, CAIP.

[51]  Thomas Batard,et al.  Clifford-Fourier Transform for Color Image Processing , 2010, Geometric Algebra Computing.

[52]  Huazhong Shu,et al.  Reconstruction of tomographic images from limited range projections using discrete Radon transform and Tchebichef moments , 2010, Pattern Recognit..

[53]  Jezekiel Ben-Arie,et al.  Generalized feature extraction using expansion matching , 1999, IEEE Trans. Image Process..

[54]  Soo-Chang Pei,et al.  A novel block truncation coding of color images by using quaternion-moment-preserving principle , 1996, 1996 IEEE International Symposium on Circuits and Systems. Circuits and Systems Connecting the World. ISCAS 96.

[55]  Stephen J. Sangwine,et al.  Color image decomposition using quaternion singular value decomposition , 2003 .

[56]  Daniel Pérez Palomar,et al.  Quaternion ICA From Second-Order Statistics , 2011, IEEE Transactions on Signal Processing.

[57]  Parham Aarabi,et al.  On the importance of phase in human speech recognition , 2006, IEEE Transactions on Audio, Speech, and Language Processing.

[58]  J. Flusser,et al.  Moments and Moment Invariants in Pattern Recognition , 2009 .

[59]  Rick S. Blum,et al.  A hybrid image registration technique for a digital camera image fusion application , 2001, Inf. Fusion.

[60]  Chan-Yun Yang,et al.  Classification of rotifers with machine vision by shape moment invariants. , 2000 .

[61]  C. Eddie Moxey,et al.  Hypercomplex correlation techniques for vector images , 2003, IEEE Trans. Signal Process..

[62]  Miroslaw Pawlak,et al.  On the Accuracy of Zernike Moments for Image Analysis , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[63]  Heydi Mendez Vazquez,et al.  Illumination Invariant Face Recognition Using Quaternion-Based Correlation Filters , 2012, Journal of Mathematical Imaging and Vision.

[64]  T. Nitta,et al.  A quaternary version of the back-propagation algorithm , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[65]  Soo-Chang Pei,et al.  Color image processing by using binary quaternion-moment-preserving thresholding technique , 1999, IEEE Trans. Image Process..

[66]  Stephen J. Sangwine,et al.  Quaternion and Clifford Fourier Transforms and Wavelets , 2013 .

[67]  Gang Chen,et al.  Color Image Analysis by Quaternion Zernike Moments , 2010, 2010 20th International Conference on Pattern Recognition.

[68]  Alireza Khotanzad,et al.  Invariant Image Recognition by Zernike Moments , 1990, IEEE Trans. Pattern Anal. Mach. Intell..