Interactive image retrieval using M-band wavelet, earth mover’s distance and fuzzy relevance feedback

We propose an interactive content based image retrieval (CBIR) system using M-band wavelet features with earth mover’s distance (EMD). A fuzzy relevance feedback (FRF) method is proposed to enhance the retrieval mechanism in order to retrieve more images which are semantically close to the query. M × M sub-bands coefficient are used as primitive features, on which, for each pixel, energies are computed over a neighborhood and are taken as features for each pixel to characterize its color and texture properties. Based on the energy property, pixels are clustered using fuzzy C-means algorithm to obtain an image signature. The EMD is used as a distance measure between the signatures for different images of the database. Combining information both from relevant and irrelevant images marked by the user, fuzzy entropy based feature evaluation mechanism is used for automatic computation of revised feature importance and similarity distance at the end of each iteration. The proposed CBIR system performance using M-band wavelets feature are compared to that of Moving Picture Expert Group-7 visual features which have almost become a standard benchmark for both video and image representation and comparison. The proposed FRF technique using EMD is compared with different other similarity measures to test the effectiveness of the system on standard image database.

[1]  Korris Fu-Lai Chung,et al.  Positive and negative fuzzy rule system, extreme learning machine and image classification , 2011, Int. J. Mach. Learn. Cybern..

[2]  Xuequn Li,et al.  Content-Based Image Retrieval by Relevance Feedback , 2000, VISUAL.

[3]  Malay Kumar Kundu,et al.  Interactive Image Retrieval in a Fuzzy Framework , 2009, WILF.

[4]  Sankar K. Pal,et al.  Fuzzy Mathematical Approach to Pattern Recognition , 1986 .

[5]  Wei-Ying Ma,et al.  Learning a semantic space from user's relevance feedback for image retrieval , 2003, IEEE Trans. Circuits Syst. Video Technol..

[6]  C. Burrus,et al.  Introduction to Wavelets and Wavelet Transforms: A Primer , 1997 .

[7]  Mausumi Acharyya,et al.  M-Band Wavelets: Application to Texture Segmentation for Real Life Image Analysis , 2003, Int. J. Wavelets Multiresolution Inf. Process..

[8]  Carlo Tomasi,et al.  Perceptual metrics for image database navigation , 1999 .

[9]  Daniel Heesch,et al.  A survey of browsing models for content based image retrieval , 2008, Multimedia Tools and Applications.

[10]  Mausumi Acharyya,et al.  An adaptive approach to unsupervised texture segmentation using M-Band wavelet transform , 2001, Signal Process..

[11]  Leonidas J. Guibas,et al.  The Earth Mover's Distance as a Metric for Image Retrieval , 2000, International Journal of Computer Vision.

[12]  Qing He,et al.  Bayes-Based Relevance Feedback Method for CBIR , 2008, Innovations in Hybrid Intelligent Systems.

[13]  Bo Zhang,et al.  Constructive Learning Algorithm-Based RBF Network for Relevance Feedback in Image Retrieval , 2003, CIVR.

[14]  Sudeep D. Thepade,et al.  Image Retrieval using Fractional Coefficients of Transformed Image using DCT and Walsh Transform , 2010 .

[15]  Remco C. Veltkamp,et al.  Properties and Performance of Shape Similarity Measures , 2006, Data Science and Classification.

[16]  Wei Song,et al.  Clustering based on Steiner points , 2011, International Journal of Machine Learning and Cybernetics.

[17]  Malay Kumar Kundu,et al.  Content-based image retrieval using visually significant point features , 2009, Fuzzy Sets Syst..

[18]  Victoria S. Uren,et al.  Comparing Dissimilarity Measures for Content-Based Image Retrieval , 2008, AIRS.

[19]  B. S. Manjunath,et al.  Introduction to MPEG-7: Multimedia Content Description Interface , 2002 .

[20]  Thomas S. Huang,et al.  Content-based image retrieval with relevance feedback in MARS , 1997, Proceedings of International Conference on Image Processing.

[21]  Georgy L. Gimel'farb,et al.  On retrieving textured images from an image database , 1996, Pattern Recognit..

[22]  Xi-Zhao Wang,et al.  Improving Generalization of Fuzzy IF--THEN Rules by Maximizing Fuzzy Entropy , 2009, IEEE Transactions on Fuzzy Systems.

[23]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Ieee Xplore,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence Information for Authors , 2022, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Guillermo Ayala,et al.  A novel Bayesian framework for relevance feedback in image content-based retrieval systems , 2006, Pattern Recognit..

[26]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[27]  Xizhao Wang,et al.  Induction of multiple fuzzy decision trees based on rough set technique , 2008, Inf. Sci..

[28]  Feng-Cheng Chang,et al.  A relevance feedback image retrieval scheme using multi-instance and pseudo-image concepts , 2005, IS&T/SPIE Electronic Imaging.

[29]  Bir Bhanu,et al.  Integrating relevance feedback techniques for image retrieval using reinforcement learning , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Woo-Cheol Kim,et al.  Image retrieval model based on weighted visual features determined by relevance feedback , 2008, Inf. Sci..

[31]  Chongjun Yang,et al.  Application of M-band wavelet theory to texture analysis in content-based aerial image retrieval , 2004, IGARSS 2004. 2004 IEEE International Geoscience and Remote Sensing Symposium.

[32]  James Ze Wang,et al.  SIMPLIcity: Semantics-Sensitive Integrated Matching for Picture LIbraries , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  François Dubeau,et al.  Image Retrieval Based on Region Separation and Multiresolution Analysis , 2006, Int. J. Wavelets Multiresolution Inf. Process..

[34]  James Ze Wang,et al.  Image retrieval: Ideas, influences, and trends of the new age , 2008, CSUR.

[35]  Simone Santini,et al.  Similarity Measures , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  Yixin Chen,et al.  CLUE: cluster-based retrieval of images by unsupervised learning , 2005, IEEE Transactions on Image Processing.

[37]  Nikolas P. Galatsanos,et al.  Probabilistic relevance feedback approach for content-based image retrieval based on gaussian mixture models , 2009, IET Image Process..

[38]  Mausumi Acharyya,et al.  Extraction of Noise Tolerant, Gray-Scale Transform and Rotation Invariant Features for Texture Segmentation Using Wavelet Frames , 2008, Int. J. Wavelets Multiresolution Inf. Process..

[39]  B. S. Manjunath,et al.  Color and texture descriptors , 2001, IEEE Trans. Circuits Syst. Video Technol..

[40]  Si Chen,et al.  Soft subspace clustering with an improved feature weight self-adjustment mechanism , 2012, Int. J. Mach. Learn. Cybern..

[41]  Wang Xiaoling,et al.  Enhancing Color histogram for Image Retrieval , 2009 .

[42]  King Ngi Ngan,et al.  A memory learning framework for effective image retrieval , 2005, IEEE Transactions on Image Processing.

[43]  Andries Petrus Engelbrecht,et al.  Clustering data in stationary environments with a local network neighborhood artificial immune system , 2012, Int. J. Mach. Learn. Cybern..

[44]  Mausumi Acharyya,et al.  Extraction of Features Using M-Band Wavelet Packet Frame and Their Neuro-Fuzzy Evaluation for Multitexture Segmentation , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[45]  B. S. Manjunath,et al.  A texture descriptor for browsing and similarity retrieval , 2000, Signal Process. Image Commun..