Complex Zernike Moments Features for Shape-Based Image Retrieval

Shape is a fundamental image feature used in content-based image-retrieval systems. This paper proposes a robust and effective shape feature, which is based on a set of orthogonal complex moments of images known as Zernike moments (ZMs). As the rotation of an image has an impact on the ZM phase coefficients of the image, existing proposals normally use magnitude-only ZM as the image feature. In this paper, we compare, by using a mathematical form of analysis, the amount of visual information captured by ZM phase and the amount captured by ZM magnitude. This analysis shows that the ZM phase captures significant information for image reconstruction. We therefore propose combining both the magnitude and phase coefficients to form a new shape descriptor, referred to as invariant ZM descriptor (IZMD). The scale and translation invariance of IZMD could be obtained by prenormalizing the image using the geometrical moments. To make the phase invariant to rotation, we perform a phase correction while extracting the IZMD features. Experiment results show that the proposed shape feature is, in general, robust to changes caused by image shape rotation, translation, and/or scaling. The proposed IZMD feature also outperforms the commonly used magnitude-only ZMD in terms of noise robustness and object discriminability.

[1]  Eric Mjolsness,et al.  New Algorithms for 2D and 3D Point Matching: Pose Estimation and Correspondence , 1998, NIPS.

[2]  Sameer A. Nene,et al.  Columbia Object Image Library (COIL100) , 1996 .

[3]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[4]  Dong-Gyu Sim,et al.  A modified Zernike moment shape descriptor invariant to translation, rotation and scale for similarity-based image retrieval , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[5]  Donald D. Hoffman,et al.  Parts of recognition , 1984, Cognition.

[6]  Arnold W. M. Smeulders,et al.  The PicToSeek WWW image search system , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[7]  King-Sun Fu,et al.  Shape Discrimination Using Fourier Descriptors , 1977, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Azriel Rosenfeld,et al.  Computer Vision , 1988, Adv. Comput..

[9]  Shigeru Akamatsu,et al.  Automatic detection of human faces in natural scene images by use of a skin color model and of invariant moments , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[10]  M. Teague Image analysis via the general theory of moments , 1980 .

[11]  Dragutin Petkovic,et al.  Query by Image and Video Content: The QBIC System , 1995, Computer.

[12]  Yufeng Chen,et al.  Local moment invariant analysis , 2005, International Conference on Computer Graphics, Imaging and Visualization (CGIV'05).

[13]  MokhtarianFarzin,et al.  A Theory of Multiscale, Curvature-Based Shape Representation for Planar Curves , 1992 .

[14]  Miroslaw Bober,et al.  MPEG-7 visual shape descriptors , 2001, IEEE Trans. Circuits Syst. Video Technol..

[15]  Dinggang Shen,et al.  HAMMER: hierarchical attribute matching mechanism for elastic registration , 2002, IEEE Transactions on Medical Imaging.

[16]  Jens-Rainer Ohm,et al.  Shape retrieval with robustness against partial occlusion , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[17]  Mehmet Celenk,et al.  Higher-order spectra (HOS) invariants for shape recognition , 2001, Pattern Recognit..

[18]  Guojun Lu,et al.  Content-based shape retrieval using different shape descriptors: a comparative study , 2001, IEEE International Conference on Multimedia and Expo, 2001. ICME 2001..

[19]  Miguel A. Ferrer,et al.  Slant estimation of handwritten characters by means of Zernike moments , 2005 .

[20]  Yehezkel Lamdan,et al.  Affine invariant model-based object recognition , 1990, IEEE Trans. Robotics Autom..

[21]  William I. Grosky,et al.  Index-based object recognition in pictorial data management , 1990, Comput. Vis. Graph. Image Process..

[22]  King-Sun Fu,et al.  Shape Discrimination Using Fourier Descriptors , 1977, IEEE Trans. Syst. Man Cybern..

[23]  Linda G. Shapiro,et al.  Computer Vision , 2001 .

[24]  Ralph Roskies,et al.  Fourier Descriptors for Plane Closed Curves , 1972, IEEE Transactions on Computers.

[25]  Olaf Kübler,et al.  Complete Sets of Complex Zernike Moment Invariants and the Role of the Pseudoinvariants , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Alex Pentland,et al.  Photobook: Content-based manipulation of image databases , 1996, International Journal of Computer Vision.

[27]  King Ngi Ngan,et al.  Unsupervised extraction of visual attention objects in color images , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[28]  Roland T. Chin,et al.  On image analysis by the methods of moments , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[29]  Alireza Khotanzad,et al.  Invariant Image Recognition by Zernike Moments , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  N. Kehtarnavaz,et al.  Zernike moment invariants based photo-identification using Fisher discriminant model , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[31]  Kaleem Siddiqi,et al.  Parts of Visual Form: Computational Aspects , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Jin Zhang,et al.  A Distance and Angle Similarity Measure Method , 1999, J. Am. Soc. Inf. Sci..

[33]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[34]  G. Schaefer,et al.  Content-based image retrieval for medical infrared images , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[35]  R. Rautkorpi,et al.  Content-based image retrieval of Web surface defects with PicSOM , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[36]  Guojun Lu,et al.  Shape-based image retrieval using generic Fourier descriptor , 2002, Signal Process. Image Commun..

[37]  H. V. Jagadish Spatial search with polyhedra , 1990, [1990] Proceedings. Sixth International Conference on Data Engineering.

[38]  Euripides G. M. Petrakis,et al.  Shape retrieval based on dynamic programming , 2000, IEEE Trans. Image Process..

[39]  Hélène Laurent,et al.  2D color shape recognition using Zernike moments , 2005, IEEE International Conference on Image Processing 2005.

[40]  Ching Y. Suen,et al.  Extraction of peripheral shape features in Chinese character recognition , 1994, Proceedings of the 12th IAPR International Conference on Pattern Recognition, Vol. 3 - Conference C: Signal Processing (Cat. No.94CH3440-5).

[41]  Alex Pentland,et al.  Modal Matching for Correspondence and Recognition , 1995, IEEE Trans. Pattern Anal. Mach. Intell..