Zernike moments and LDP-weighted patches for content-based image retrieval

This paper proposes a new algorithm using global and local features for content-based image retrieval. Global features are extracted using the magnitude of Zernike moments (ZMs). Local features are obtained through local directional pattern (LDP). Generally, LDP is used to extract texture-based features from an image. In this paper, LDP is used to encode both texture and shape information of an image to represent more meaningful features. To encode texture-based features, original image is used to compute the LDP features. To extract shape information from an image, dual-tree complex wavelet transform (DT-CWT) is applied on image which generates six directional wavelets. These six directional wavelets are superimposed in order to obtain shape-encoded image. LDP is then applied on this wavelet-based shape-encoded image. Further, to enhance retrieval accuracy, LDP features are extracted from patches of both original and shape-encoded images. These patches are assigned with weights based on average discrimination capability of features in a patch. Experiments are performed using three different standard databases with various variations such as pose, distortion, partial occlusion and complex structure. The proposed technique achieves 96.4 and 98.76 % retrieval accuracy at a recall of 50 %, for Kimia-99 and COIL-100 databases, respectively. For MPEG-7 CE-2 shape database, retrieval accuracy of 61.93 % is achieved in terms of average Bull’s eye performance (BEP). The proposed technique is also tested on Springer medical image database to explore its scope in other areas, wherein it attains average BEP of 69.68 % in comparison with 61.52 % with ZMs. It is observed that the proposed technique outperforms other well-known existing methods of image retrieval.

[1]  Shan Li,et al.  Complex Zernike Moments Features for Shape-Based Image Retrieval , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[2]  Naveen K. Nishchal,et al.  Retrieval and classification of objects using generic Fourier, Legendre moment, and wavelet Zernike moment descriptors and recognition using joint transform correlator , 2008 .

[3]  Ekta Walia,et al.  Variants of dense descriptors and Zernike moments as features for accurate shape-based image retrieval , 2014, Signal Image Video Process..

[4]  Shih-Fu Chang,et al.  Image Retrieval: Current Techniques, Promising Directions, and Open Issues , 1999, J. Vis. Commun. Image Represent..

[5]  Raveendran Paramesran,et al.  On the computational aspects of Zernike moments , 2007, Image Vis. Comput..

[6]  Anil K. Jain,et al.  Shape-Based Retrieval: A Case Study With Trademark Image Databases , 1998, Pattern Recognit..

[7]  Dao-Qing Dai,et al.  Face Recognition Using Dual-Tree Complex Wavelet Features , 2009, IEEE Transactions on Image Processing.

[8]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Guojun Lu,et al.  Review of shape representation and description techniques , 2004, Pattern Recognit..

[10]  Jing Li,et al.  A comprehensive review of current local features for computer vision , 2008, Neurocomputing.

[11]  Arnold W. M. Smeulders,et al.  PicToSeek: combining color and shape invariant features for image retrieval , 2000, IEEE Trans. Image Process..

[12]  Xiaojun Wu,et al.  A novel contour descriptor for 2D shape matching and its application to image retrieval , 2011, Image Vis. Comput..

[13]  Seong-Whan Lee Off-Line Recognition of Totally Unconstrained Handwritten Numerals Using Multilayer Cluster Neural Network , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[15]  M. Esmel ElAlami,et al.  A novel image retrieval model based on the most relevant features , 2011, Knowl. Based Syst..

[16]  M. Teague Image analysis via the general theory of moments , 1980 .

[17]  Whoi-Yul Kim,et al.  A region-based shape descriptor using Zernike moments , 2000, Signal Process. Image Commun..

[18]  Oksam Chae,et al.  Local Directional Pattern (LDP) – A Robust Image Descriptor for Object Recognition , 2010, 2010 7th IEEE International Conference on Advanced Video and Signal Based Surveillance.

[19]  Atilla Baskurt,et al.  Improving Zernike Moments Comparison for Optimal Similarity and Rotation Angle Retrieval , 2009, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Filson H. Glanz,et al.  An Autoregressive Model Approach to Two-Dimensional Shape Classification , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Mohan S. Kankanhalli,et al.  Shape Measures for Content Based Image Retrieval: A Comparison , 1997, Inf. Process. Manag..

[22]  James M. Rehg,et al.  Automated macular pathology diagnosis in retinal OCT images using multi-scale spatial pyramid and local binary patterns in texture and shape encoding , 2011, Medical Image Anal..

[23]  Ekta Walia,et al.  Improved Accuracy in Shape Based Image Retrieval with Complex Zernike Moments Using Wavelets , 2009, 2009 2nd International Congress on Image and Signal Processing.

[24]  Guojun Lu,et al.  Shape-based image retrieval using generic Fourier descriptor , 2002, Signal Process. Image Commun..

[25]  James Ze Wang,et al.  Image retrieval: Ideas, influences, and trends of the new age , 2008, CSUR.

[26]  Claudio Gutierrez,et al.  Survey of graph database models , 2008, CSUR.

[27]  Guoping Qiu,et al.  Visual guided navigation for image retrieval , 2007, Pattern Recognit..

[28]  Guojun Lu,et al.  A comparative study of curvature scale space and Fourier descriptors for shape-based image retrieval , 2003, J. Vis. Commun. Image Represent..

[29]  N. Kingsbury Complex Wavelets for Shift Invariant Analysis and Filtering of Signals , 2001 .

[30]  Zhenhua Guo,et al.  A Completed Modeling of Local Binary Pattern Operator for Texture Classification , 2010, IEEE Transactions on Image Processing.

[31]  Chang-Tsun Li,et al.  Trademark image retrieval using synthetic features for describing global shape and interior structure , 2009, Pattern Recognit..

[32]  Kpalma Kidiyo,et al.  A Survey of Shape Feature Extraction Techniques , 2008 .

[33]  Roland T. Chin,et al.  On Image Analysis by the Methods of Moments , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[35]  M. Oussalah,et al.  Content Based Image Retrieval: Review of State of Art and Future Directions , 2008, 2008 First Workshops on Image Processing Theory, Tools and Applications.

[36]  Naveen K. Nishchal,et al.  Retrieval and classification of shape-based objects using Fourier, generic Fourier, and wavelet-Fourier descriptors technique: A comparative study , 2007 .

[37]  Rajiv Mehrotra,et al.  Edge detection using orthogonal moment-based operators , 1992, Proceedings., 11th IAPR International Conference on Pattern Recognition. Vol. III. Conference C: Image, Speech and Signal Analysis,.

[38]  Toby Berger,et al.  Reliable On-Line Human Signature Verification Systems , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  Miroslaw Bober,et al.  MPEG-7 visual shape descriptors , 2001, IEEE Trans. Circuits Syst. Video Technol..

[40]  Chee-Way Chong,et al.  A comparative analysis of algorithms for fast computation of Zernike moments , 2003, Pattern Recognit..

[41]  S. Mallat A wavelet tour of signal processing , 1998 .

[42]  Dragutin Petkovic,et al.  Query by Image and Video Content: The QBIC System , 1995, Computer.

[43]  Ying Liu,et al.  A survey of content-based image retrieval with high-level semantics , 2007, Pattern Recognit..

[44]  Ali Aghagolzadeh,et al.  Feature extraction using discrete cosine transform and discrimination power analysis with a face recognition technology , 2010, Pattern Recognit..

[45]  Farzin Mokhtarian,et al.  A Theory of Multiscale, Curvature-Based Shape Representation for Planar Curves , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[46]  Subrahmanyam Murala,et al.  Directional Binary Wavelet Patterns for Biomedical Image Indexing and Retrieval , 2012, Journal of Medical Systems.

[47]  Ekta Walia,et al.  Gabor Wavelet Enabled Zernike Moments for Effective Content Based Image Retrieval , 2013, ICIAR.

[48]  R. Balasubramanian,et al.  Local maximum edge binary patterns: A new descriptor for image retrieval and object tracking , 2012, Signal Process..

[49]  Ekta Walia,et al.  An Analysis of Shape Based Image Retrieval Using Variants of Zernike Moments as Features , 2012 .

[50]  Subrahmanyam Murala,et al.  Local Tetra Patterns: A New Feature Descriptor for Content-Based Image Retrieval , 2012, IEEE Transactions on Image Processing.

[51]  Chandan Singh Improved quality of reconstructed images using floating point arithmetic for moment calculation , 2006, Pattern Recognit..

[52]  Pooja,et al.  Local and global features based image retrieval system using orthogonal radial moments , 2012 .

[53]  Chandan Singh,et al.  Robust two-stage face recognition approach using global and local features , 2011, The Visual Computer.

[54]  Keqiu Li,et al.  An effective solution for trademark image retrieval by combining shape description and feature matching , 2010, Pattern Recognit..

[55]  Kaamran Raahemifar,et al.  An effective feature extraction method for face recognition , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[56]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[57]  Oksam Chae,et al.  Robust Facial Expression Recognition Based on Local Directional Pattern , 2010 .

[58]  Oksam Chae,et al.  Local Directional Pattern (LDP) for face recognition , 2010, 2010 Digest of Technical Papers International Conference on Consumer Electronics (ICCE).

[59]  Zen Chen,et al.  A Zernike Moment Phase-Based Descriptor for Local Image Representation and Matching , 2010, IEEE Transactions on Image Processing.

[60]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..