Image retrieval via isotropic and anisotropic mappings

Abstract This paper presents an approach for content-based image retrieval via isotropic and anisotropic mappings. Isotropic mappings are defined as mappings invariant to the action of the planar Euclidean group on the image space—invariant to the translation, rotation and reflection of image data, and hence, invariant to orientation and position. Anisotropic mappings, on the other hand, are defined as those mappings that are correspondingly variant. Structure extraction (via a perceptual grouping process) and color histogram are shown to be representations of isotropic mappings. Texture analysis using a channel energy model comprised of even-symmetric Gabor filters is considered to be a representation of anisotropic mapping. An integration framework for these mappings is developed. Results of retrieval of outdoor images by query and by classification using a nearest neighbor classifier are presented.

[1]  D. Jacobs.  What Makes Viewpoint Invariant Properties Perceptually Salient?: A Computational Perspective , 2000 .

[2]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[3]  H. O. Foulkes.  Abstract Algebra , 1967, Nature.

[4]  Martin Szummer,et al.  Indoor-outdoor image classification , 1998, Proceedings 1998 IEEE International Workshop on Content-Based Access of Image and Video Database.

[5]  E. Kreyszig.  Introductory Functional Analysis With Applications , 1978 .

[6]  Gunther Wyszecki,et al.  Color Science: Concepts and Methods, Quantitative Data and Formulae, 2nd Edition , 2000 .

[7]  Anil K. Jain,et al.  On image classification: city images vs. landscapes , 1998, Pattern Recognit..

[8]  R. Tennant.  Algebra , 1941, Nature.

[9]  Lance R. Williams,et al.  Euclidean Group Invariant Computation of Stochastic Completion Fields Using Shiftable-Twistable Functions , 2000, ECCV.

[10]  Alex Pentland,et al.  Photobook: Content-based manipulation of image databases , 1996, International Journal of Computer Vision.

[11]  Thierry Pun,et al.  Performance evaluation in content-based image retrieval: overview and proposals , 2001, Pattern Recognit. Lett..

[12]  T. Poggio.  Vision by man and machine. , 1984, Scientific American.

[13]  J. McCafferty.  Human and machine vision: computing perceptual organisation , 1990 .

[14]  M. Golubitsky,et al.  Geometric visual hallucinations, Euclidean symmetry and the functional architecture of striate cortex. , 2001, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[15]  N. Cartwright,et al.  Abstract and Concrete@@@Nature's Capacities and Their Measurement. , 1995 .

[16]  Martin Golubitsky,et al.  What Geometric Visual Hallucinations Tell Us about the Visual Cortex , 2002, Neural Computation.

[17]  A. Gibbons.  Algorithmic Graph Theory , 1985 .

[18]  Jake K. Aggarwal,et al.  Applying perceptual grouping to content-based image retrieval: building images , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[19]  David G. Stork,et al.  Pattern Classification , 1973 .

[20]  B. S. Manjunath,et al.  Texture Features for Browsing and Retrieval of Image Data , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Dragutin Petkovic,et al.  Automatic and semiautomatic methods for image annotation and retrieval in query by image content (QBIC) , 1995, Electronic Imaging.

[22]  B. Ripley,et al.  Pattern Recognition , 1968, Nature.

[23]  B. S. Manjunath,et al.  Texture features and learning similarity , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[24]  Shih-Fu Chang,et al.  VisualSEEk: a fully automated content-based image query system , 1997, MULTIMEDIA '96.

[25]  Jake K. Aggarwal,et al.  Retrieval by classification of images containing large manmade objects using perceptual grouping , 2002, Pattern Recognit..

[26]  David G. Lowe,et al.  Perceptual Organization and Visual Recognition , 2012 .

[27]  Thomas O. Binford,et al.  Inferring Surfaces from Images , 1981, Artif. Intell..

[28]  W. Geisler,et al.  Perceptual organization of two-dimensional patterns. , 2000, Psychological review.

[29]  Lance R. Williams,et al.  Euclidean Group Invariant Computation of Stochastic Completion Fields Using Shiftable-Twistable Functions , 2000, Journal of Mathematical Imaging and Vision.

[30]  J. Ashley,et al.  Automatic and Semi-Automatic Methods for Image Annotation and Retrieval in QBIC , 1995 .

[31]  Allen R. Hanson,et al.  Extracting Straight Lines , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  J. K. AggarwalComputer.  Image Retrieval via Isotropic and Anisotropic Mappings , 2001 .

[33]  Rosalind W. Picard,et al.  Texture orientation for sorting photos "at a glance" , 1994, Proceedings of 12th International Conference on Pattern Recognition.