A Robust CBIR Approach Using Local Color Histograms

Global color histograms are well-known as a simple and often way to perform color-based image retrieval. However, it lacks spatial information about the image colors. The use of a grid of cells superimposed on the images and the use of local color histograms for each such cell improves retrieval in the sense that some notion of color location is taken into account. In such an approach however, retrieval becomes sensitive to image rotation and translation. In this thesis we present a new way to model image similarity, also using colors and a superimposing grid, via bipartite graphs. As a result, the technique is able to take advantage of color location but is not sensitive to rotation and translation. Experimental results have shown the approach to be very effective. If one uses global color histograms as a filter then our approach, named Harbin, becomes quite effcient as well (i.e., it imposes very little overhead over the use of global color histograms).

[1]  Shih-Fu Chang,et al.  Image Retrieval: Current Techniques, Promising Directions, and Open Issues , 1999, J. Vis. Commun. Image Represent..

[2]  Rosalind W. Picard,et al.  Interactive Learning Using a "Society of Models" , 2017, CVPR 1996.

[3]  Christos Faloutsos,et al.  QBIC project: querying images by content, using color, texture, and shape , 1993, Electronic Imaging.

[4]  James Dowe,et al.  Content-based retrieval in multimedia imaging , 1993, Electronic Imaging.

[5]  H. D. Cheng,et al.  A fuzzy logic approach to image segmentation , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[6]  Frank Harary,et al.  Graph Theory , 2016 .

[7]  Max J. Egenhofer,et al.  Reasoning about Binary Topological Relations , 1991, SSD.

[8]  Hanan Samet,et al.  The Quadtree and Related Hierarchical Data Structures , 1984, CSUR.

[9]  Fritz Albregtsen,et al.  Fast computation of invariant geometric moments: a new method giving correct results , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[10]  Tom Minka,et al.  Interactive learning with a "Society of Models" , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[11]  Robert E. Tarjan,et al.  Fibonacci heaps and their uses in improved network optimization algorithms , 1984, JACM.

[12]  Oliver Günther,et al.  Multidimensional access methods , 1998, CSUR.

[13]  Alberto Del Bimbo,et al.  Symbolic Description and Visual Querying of Image Sequences Using Spatio-Temporal Logic , 1995, IEEE Trans. Knowl. Data Eng..

[14]  Hans-Peter Kriegel,et al.  The R*-tree: an efficient and robust access method for points and rectangles , 1990, SIGMOD '90.

[15]  Ramin Zabih,et al.  Comparing images using color coherence vectors , 1997, MULTIMEDIA '96.

[16]  Shih-Fu Chang,et al.  Tools and techniques for color image retrieval , 1996, Electronic Imaging.

[17]  Thomas S. Huang,et al.  Modified Fourier Descriptors for Shape Representation - A Practical Approach , 1996 .

[18]  William E. Higgins,et al.  Watershed-driven relaxation labeling for image segmentation , 1994, Proceedings of 1st International Conference on Image Processing.

[19]  Fang Liu,et al.  Periodicity, Directionality, and Randomness: Wold Features for Image Modeling and Retrieval , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Vishal Chitkara Color-Based Image Retrieval Using Compact Binary Signatures , 2001 .

[21]  B. S. Manjunath,et al.  Texture Features for Browsing and Retrieval of Image Data , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Hideyuki Tamura,et al.  Textural Features Corresponding to Visual Perception , 1978, IEEE Transactions on Systems, Man, and Cybernetics.

[23]  Shih-Fu Chang,et al.  Visually Searching the Web for Content , 1997, IEEE Multim..

[24]  Sharon Flank,et al.  PhotoFile: a digital library for image retrieval , 1995, Proceedings of the International Conference on Multimedia Computing and Systems.

[25]  Robert S. Gray,et al.  Content-based image retrieval: color and edges , 1995 .

[26]  Kannan Ramchandran,et al.  Multimedia Analysis and Retrieval System (MARS) Project , 1996, Data Processing Clinic.

[27]  Sven J. Dickinson,et al.  Viewpoint-invariant indexing for content-based image retrieval , 1998, Proceedings 1998 IEEE International Workshop on Content-Based Access of Image and Video Database.

[28]  Euripides G. M. Petrakis,et al.  Methodology for the representation, indexing and retrieval of images by content , 1993, Image Vis. Comput..

[29]  Cyrus Shahabi,et al.  Image retrieval by shape: a comparative study , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[30]  I. Biederman Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[31]  Theo Gevers,et al.  Image segmentation by directed region subdivision , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[32]  Jing Huang,et al.  Image indexing using color correlograms , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[33]  Mario A. Nascimento,et al.  On “shapes” of colors for content-based image retrieval , 2000, MULTIMEDIA '00.

[34]  Harold N. Gabow,et al.  Scaling algorithms for network problems , 1983, 24th Annual Symposium on Foundations of Computer Science (sfcs 1983).

[35]  Shi-Kuo Chang,et al.  Iconic Indexing by 2-D Strings , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  K. Wakimoto,et al.  Efficient and Effective Querying by Image Content , 1994 .

[37]  Shi-Kuo Chang,et al.  Picture Indexing and Abstraction Techniques for Pictorial Databases , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Jin-Long Chen,et al.  Indexing to 3D model aspects using 2D contour features , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[39]  Romain Murenzi,et al.  Fast texture database retrieval using extended fractal features , 1997, Electronic Imaging.

[40]  Markus A. Stricker,et al.  Similarity of color images , 1995, Electronic Imaging.

[41]  Peter Stanchev,et al.  Content-Based Image Retrieval Systems , 2001 .

[42]  Markus A. Stricker,et al.  Color indexing with weak spatial constraints , 1996, Electronic Imaging.

[43]  Richard M. Karp,et al.  Theoretical Improvements in Algorithmic Efficiency for Network Flow Problems , 1972, Combinatorial Optimization.

[44]  Shih-Fu Chang,et al.  VisualSEEk: a fully automated content-based image query system , 1997, MULTIMEDIA '96.

[45]  Alex Pentland,et al.  Photobook: tools for content-based manipulation of image databases , 1994, Electronic Imaging.

[46]  Arif Ghafoor Multimedia database management systems , 1995, CSUR.

[47]  Jürg Nievergelt,et al.  The Grid File: An Adaptable, Symmetric Multikey File Structure , 1984, TODS.

[48]  Pavel Zezula,et al.  M-tree: An Efficient Access Method for Similarity Search in Metric Spaces , 1997, VLDB.

[49]  Alberto Del Bimbo,et al.  Visual information retrieval , 1999 .

[50]  Tat-Seng Chua,et al.  An integrated color-spatial approach to content-based image retrieval , 1995, MULTIMEDIA '95.