Finding textures by textual descriptions, visual examples, and relevance feedbacks

In this study, we propose a fuzzy logic CBIR (content-based image retrieval) system for finding textures. In our CBIR system, a user can submit textual descriptions and/or visual examples to find the desired textures. After the initial search, the user can give relevant and/or irrelevant examples to refine the query and improve the retrieval efficiency. Contributions of this study are fourfold. (1) Our CBIR system maps low-level statistical features to high-level textual concepts; it bridges the semantic gap between these two levels. (2) Our CBIR system characterizes texture properties of these two levels; and further, it achieves high-level texture manipulations through textual concepts. (3) Our CBIR system models the human perception subjectivity via relevance feedbacks to perform more accurate retrieval. (4) Our CBIR system provides intuitive and simple methods of similarity definitions and computations. Experimental results reveal our CBIR system is indeed effective. The retrieved images are perceptually satisfactory, and the retrieval time is very short.

[1]  Anil K. Jain,et al.  Texture Analysis , 2018, Handbook of Image Processing and Computer Vision.

[2]  Shi-Nine Yang,et al.  Regular-texture image retrieval based on texture-primitive extraction , 1999, Image Vis. Comput..

[3]  Dragutin Petkovic,et al.  Representation and Retrieval of Visual Media in Multimedia Systems , 1996, Springer US.

[4]  Shi-Nine Yang,et al.  Color image retrieval based on hidden Markov models , 1997, IEEE Trans. Image Process..

[5]  Sethuraman Panchanathan,et al.  Review of Image and Video Indexing Techniques , 1997, J. Vis. Commun. Image Represent..

[6]  Fang Liu,et al.  Periodicity, Directionality, and Randomness: Wold Features for Image Modeling and Retrieval , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Hideyuki Tamura,et al.  Textural Features Corresponding to Visual Perception , 1978, IEEE Transactions on Systems, Man, and Cybernetics.

[8]  Azriel Rosenfeld,et al.  Computer Vision , 1988, Adv. Comput..

[9]  Alex Pentland,et al.  Photobook: Content-based manipulation of image databases , 1996, International Journal of Computer Vision.

[10]  Shih-Fu Chang,et al.  Image Retrieval: Current Techniques, Promising Directions, and Open Issues , 1999, J. Vis. Commun. Image Represent..

[11]  Mohan S. Kankanhalli,et al.  Content-Based Image Retrieval Using a Composite Color-Shape Approach , 1998, Inf. Process. Manag..

[12]  Alex Pentland,et al.  Photobook: tools for content-based manipulation of image databases , 1994, Other Conferences.

[13]  Richard W. Conners,et al.  Toward a Structural Textural Analyzer Based on Statistical Methods , 1980 .

[14]  Dragutin Petkovic,et al.  Content-Based Representation and Retrieval of Visual Media: A State-of-the-Art Review , 1996 .

[15]  Alex Pentland,et al.  Photobook: tools for content-based manipulation of image databases , 1994, Electronic Imaging.

[16]  Abby Goodrum,et al.  Image Information Retrieval: An Overview of Current Research , 2000, Informing Sci. Int. J. an Emerg. Transdiscipl..

[17]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[18]  Hans-Jürgen Zimmermann,et al.  Fuzzy Set Theory - and Its Applications , 1985 .

[19]  Christos Faloutsos,et al.  QBIC project: querying images by content, using color, texture, and shape , 1993, Electronic Imaging.

[20]  Shih-Fu Chang,et al.  Finding Images/Video in Large Archives: Columbia's Content-Based Visual Query Project , 1997, D Lib Mag..

[21]  Robert M. Haralick,et al.  18 Image texture survey , 1982, Classification, Pattern Recognition and Reduction of Dimensionality.

[22]  Thomas S. Huang,et al.  Relevance feedback: a power tool for interactive content-based image retrieval , 1998, IEEE Trans. Circuits Syst. Video Technol..

[23]  Linda G. Shapiro,et al.  Computer Vision , 2001 .

[24]  Dragutin Petkovic,et al.  Query by Image and Video Content: The QBIC System , 1995, Computer.

[25]  J. Ashley,et al.  Automatic and Semi-Automatic Methods for Image Annotation and Retrieval in QBIC , 1995 .

[26]  Mohan S. Kankanhalli,et al.  Shape Measures for Content Based Image Retrieval: A Comparison , 1997, Inf. Process. Manag..

[27]  C. H. Chen,et al.  Handbook of Pattern Recognition and Computer Vision , 1993 .

[28]  Alberto Del Bimbo,et al.  Visual information retrieval , 1999 .

[29]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Dragutin Petkovic,et al.  Automatic and semiautomatic methods for image annotation and retrieval in query by image content (QBIC) , 1995, Electronic Imaging.