Interactive learning with a "society of models"

Digital library access is driven by features, but the relevance of a feature for a query is not always obvious. This paper describes an approach for integrating a large number of context-dependent features into a semi-automated tool. Instead of requiring universal similarity measures or manual selection of relevant features, the approach provides a learning algorithm for selecting and combining groupings of the data, where groupings can be induced by highly specialized features. The selection process is guided by positive and negative examples from the user. The inherent combinatorics of using multiple features is reduced by a multistage grouping generation, weighting, and collection process. The stages closest to the user are trained fastest and slowly propagate their adaptations back to earlier stages, improving overall performance.

[1]  Alex Pentland,et al.  Cooperative Robust Estimation Using Layers of Support , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  C.-C. Jay Kuo,et al.  Texture analysis and classification with tree-structured wavelet transform , 1993, IEEE Trans. Image Process..

[3]  Anil K. Jain,et al.  Texture classification and segmentation using multiresolution simultaneous autoregressive models , 1992, Pattern Recognit..

[4]  T. Kanade,et al.  Color information for region segmentation , 1980 .

[5]  Phil Brodatz,et al.  Textures: A Photographic Album for Artists and Designers , 1966 .

[6]  Alex Pentland,et al.  Photobook: tools for content-based manipulation of image databases , 1994, Electronic Imaging.

[7]  Rosalind W. Picard,et al.  Finding similar patterns in large image databases , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[8]  HongJiang Zhang,et al.  Scheme for visual feature-based image indexing , 1995, Electronic Imaging.

[9]  John P. Oakley,et al.  Storage and Retrieval for Image and Video Databases , 1993 .

[10]  Charles A. Bouman,et al.  Multiple Resolution Segmentation of Textured Images , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Reiner Eschbach,et al.  Annotation of natural scenes using adaptive color segmentaion , 1995, Electronic Imaging.

[12]  Hideyuki Tamura,et al.  Textural Features Corresponding to Visual Perception , 1978, IEEE Transactions on Systems, Man, and Cybernetics.

[13]  Richard L. Delanoy.  Machine learning for a Toolkit for Image Mining , 1995 .

[14]  Thomas P. Minka,et al.  An image database browser that learns from user interaction , 1996 .

[15]  Ryszard S. Michalski,et al.  A Theory and Methodology of Inductive Learning , 1983, Artificial Intelligence.

[16]  Eric Saund,et al.  Perceptual organization in an interactive sketch editing application , 1995, Proceedings of IEEE International Conference on Computer Vision.

[17]  Christos Faloutsos,et al.  QBIC project: querying images by content, using color, texture, and shape , 1993, Electronic Imaging.

[18]  M. Kunt,et al.  Second-generation image-coding techniques , 1985, Proceedings of the IEEE.

[19]  Stephen W. Smoliar,et al.  Developing power tools for video indexing and retrieval , 1994, Electronic Imaging.

[20]  Ramesh Jain,et al.  Storage and Retrieval for Image and Video Databases III , 1995 .

[21]  Fang Liu,et al.  Periodicity, Directionality, and Randomness: Wold Features for Image Modeling and Retrieval , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Ray A. Jarvis,et al.  Clustering Using a Similarity Measure Based on Shared Near Neighbors , 1973, IEEE Transactions on Computers.

[23]  Tai Sing Lee,et al.  Region competition: unifying snakes, region growing, energy/Bayes/MDL for multi-band image segmentation , 1995, Proceedings of IEEE International Conference on Computer Vision.

[24]  Fang Liu,et al.  Real-time recognition with the entire Brodatz texture database , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Michael A. Arbib,et al.  An algorithm for competitive learning in clustering problems , 1994, Pattern Recognit..

[26]  David B. Cooper,et al.  Simple Parallel Hierarchical and Relaxation Algorithms for Segmenting Noncausal Markovian Random Fields , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Teuvo Kohonen,et al.  Learning vector quantization , 1998 .

[28]  Thomas M. Strat,et al.  Context-Based Vision: Recognizing Objects Using Information from Both 2D and 3D Imagery , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[30]  Anil K. Jain,et al.  Algorithms for Clustering Data , 1988 .

[31]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.