A Unified Framework to Incorporate Soft Query into Image Retrieval Systems

We explore the use of soft computing and user defined classifications in multimedia database systems for content-based queries. With multimedia databases, due to subjectivity of human perception, an object may belong to different classes with different probabilities ("soft" membership), as opposed to "hard" mem- bership supported by conventional database systems. Therefore, we propose a unified model that captures both hard and soft memberships. In practice, however, our model significantly increases the computation complexity (both online and off-line) and the storage complexity of content-based queries. Previously, we introduced a novel fuzzy-logic based aggregation technique to address the online computation complexity. In this paper, we propose novel techniques to cluster sparse user profiles (i.e., items with missing data) to reduce both the off-line computation complexity and the storage complexity.

[1]  Ronald Fagin,et al.  Fuzzy queries in multimedia database systems , 1998, PODS '98.

[2]  Ambuj K. Singh,et al.  Efficient retrieval for browsing large image databases , 1996, CIKM '96.

[3]  Ronald Fagin,et al.  Incorporating User Preferences in Multimedia Queries , 1997, ICDT.

[4]  Ronald Fagin,et al.  Combining Fuzzy Information from Multiple Systems , 1999, J. Comput. Syst. Sci..

[5]  B. S. Manjunath,et al.  NeTra: A toolbox for navigating large image databases , 1997, Proceedings of International Conference on Image Processing.

[6]  Surya Nepal,et al.  A fuzzy object query language (FOQL) for image databases , 1999, Proceedings. 6th International Conference on Advanced Systems for Advanced Applications.

[7]  Henning Müller,et al.  Relevance Feedback and Term Weighting Schemes for Content-Based Image Retrieval , 1999, VISUAL.

[8]  Thomas S. Huang,et al.  A novel relevance feedback technique in image retrieval , 1999, MULTIMEDIA '99.

[9]  M. J. R. Healy,et al.  New Trends in Data Analysis and Applications , 1984 .

[10]  B. S. Duran,et al.  Cluster Analysis: A Survey , 1976 .

[11]  Sougata Mukherjea,et al.  Integrating image matching and classification for multimedia retrieval on the Web , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[12]  Jiawei Han,et al.  Efficient and Effective Clustering Methods for Spatial Data Mining , 1994, VLDB.

[13]  D. Rubin,et al.  Statistical Analysis with Missing Data , 1988 .

[14]  Tian Zhang,et al.  BIRCH: an efficient data clustering method for very large databases , 1996, SIGMOD '96.

[15]  Cyrus Shahabi,et al.  EFFICIENT SUPPORT OF SOFT QUERY IN IMAGE RETRIEVAL SYSTEMS , 2000 .

[16]  Ali S. Hadi,et al.  Finding Groups in Data: An Introduction to Chster Analysis , 1991 .

[17]  K. Wakimoto,et al.  Efficient and Effective Querying by Image Content , 1994 .

[18]  Shih-Fu Chang,et al.  VisualSEEk: a fully automated content-based image query system , 1997, MULTIMEDIA '96.

[19]  Jing Huang,et al.  Combining supervised learning with color correlograms for content-based image retrieval , 1997, MULTIMEDIA '97.

[20]  Cyrus Shahabi,et al.  Efficient retrieval and spatial querying of 2D objects , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[21]  Michael I. Jordan,et al.  Supervised learning from incomplete data via an EM approach , 1993, NIPS.

[22]  Neill W. Campbell,et al.  Iterative refinement by relevance feedback in content-based digital image retrieval , 1998, MULTIMEDIA '98.

[23]  Gérard G. Medioni,et al.  Finding Waldo, or focus of attention using local color information , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Markus A. Stricker,et al.  Similarity of color images , 1995, Electronic Imaging.

[25]  Yi-Shin Chen,et al.  Soft query in image retrieval systems , 1999, Electronic Imaging.

[26]  L. Zadeh.  Fuzzy sets as a basis for a theory of possibility , 1999 .

[27]  Christos Faloutsos,et al.  QBIC project: querying images by content, using color, texture, and shape , 1993, Electronic Imaging.

[28]  Stefanos D. Kollias,et al.  Interactive content-based retrieval in video databases using fuzzy classification and relevance feedback , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[29]  Sharad Mehrotra,et al.  Query reformulation for content based multimedia retrieval in MARS , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[30]  Piotr Indyk,et al.  Similarity Search in High Dimensions via Hashing , 1999, VLDB.

[31]  Majid Mirmehdi,et al.  Segmentation of Color Textures , 2000, IEEE Trans. Pattern Anal. Mach. Intell..