Active concept learning for image retrieval in dynamic databases

Concept learning in content-based image retrieval (CBIR) systems is a challenging task. We present an active concept learning approach based on mixture model to deal with the two basic aspects of a database system: changing (image insertion or removal) nature of a database and user queries. To achieve concept learning, we develop a novel model selection method based on Bayesian analysis that evaluates the consistency of hypothesized models with the available information. The analysis of exploitation vs. exploration in the search space helps to find optimal model efficiently. Experimental results on Corel database show the efficacy of our approach.

[1]  Adrien Bartoli,et al.  Towards gauge invariant bundle adjustment: a solution based on gauge dependent damping , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[2]  Kalle Åström,et al.  An affine invariant deformable shape representation for general curves , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[3]  Shree K. Nayar,et al.  A class of photometric invariants: separating material from shape and illumination , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[4]  Anil K. Jain,et al.  Unsupervised Learning of Finite Mixture Models , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Luc Van Gool,et al.  Dense matching of multiple wide-baseline views , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[6]  Adrian Hilton,et al.  Model-based multiple view reconstruction of people , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[7]  Shree K. Nayar,et al.  What does motion reveal about transparency? , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[8]  Tanveer F. Syeda-Mahmood,et al.  View-invariant alignment and matching of video sequences , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[9]  Nikos Paragios,et al.  Background modeling and subtraction of dynamic scenes , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[10]  Robert Pless,et al.  Image spaces and video trajectories: using Isomap to explore video sequences , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[11]  Paul Smith,et al.  Computing MAP trajectories by representing, propagating and combining PDFs over groups , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[12]  Kristin J. Dana,et al.  A novel approach for texture shape recovery , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[13]  Jesse Hoey,et al.  Bayesian clustering of optical flow fields , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[14]  Matthew Toews,et al.  Entropy-of-likelihood feature selection for image correspondence , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[15]  A. Murat Tekalp,et al.  Markov-based failure prediction for human motion analysis , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[16]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[17]  Chris Stauffer.  Minimally-supervised classification using multiple observation sets , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[18]  Thomas S. Huang,et al.  Tracking articulated hand motion with eigen dynamics analysis , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[19]  Ramakant Nevatia,et al.  Large-scale event detection using semi-hidden Markov models , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[20]  Joshua Gluckman.  On the use of marginal statistics of subband images , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[21]  Allen Y. Yang,et al.  Geometric segmentation of perspective images based on symmetry groups , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[22]  Rajesh P. N. Rao,et al.  Probabilistic bilinear models for appearance-based vision , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[23]  Tao Zhang,et al.  Tracking objects using density matching and shape priors , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[24]  Song-Chun Zhu,et al.  A multi-scale generative model for animate shapes and parts , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[25]  Pietro Perona,et al.  A Bayesian approach to unsupervised one-shot learning of object categories , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[26]  Theo Gevers.  Reflectance-based classification of color edges , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[27]  Olivier D. Faugeras,et al.  Shape gradients for histogram segmentation using active contours , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[28]  Jiahua Wu,et al.  Combining gradient and albedo data for rotation invariant classification of 3D surface texture , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[29]  P. Anandan,et al.  Recovery of epipolar geometry as a manifold fitting problem , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[30]  Shree K. Nayar,et al.  Adaptive dynamic range imaging: optical control of pixel exposures over space and time , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[31]  Adele Cutler,et al.  Information Ratios for Validating Mixture Analysis , 1992 .

[32]  Mubarak Shah,et al.  Tracking across multiple cameras with disjoint views , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[33]  Russell H. Taylor,et al.  Assessing accuracy factors in deformable 2D/3D medical image registration using a statistical pelvis model , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[34]  Katsushi Ikeuchi,et al.  Polarization-based inverse rendering from a single view , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[35]  Andrew J. Davison,et al.  Real-time simultaneous localisation and mapping with a single camera , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[36]  Stephen Lin,et al.  Multiple-cue illumination estimation in textured scenes , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[37]  Martial Hebert,et al.  Discriminative random fields: a discriminative framework for contextual interaction in classification , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[38]  Katsushi Ikeuchi,et al.  Appearance sampling for obtaining a set of basis images for variable illumination , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[39]  Ryuzo Okada,et al.  Obstacle detection using projective invariant and vanishing lines , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[40]  Olivier D. Faugeras,et al.  How to deal with point correspondences and tangential velocities in the level set framework , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[41]  Matthias Heiler Christoph Schn.  Natural Image Statistics for Natural Image Segmentation , 2003 .

[42]  Dorin Comaniciu,et al.  Conditional feature sensitivity: a unifying view on active recognition and feature selection , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[43]  Barbara Caputo,et al.  Recognition with local features: the kernel recipe , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[44]  Haifeng Chen,et al.  Robust regression with projection based M-estimators , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[45]  Daphna Weinshall,et al.  On the epipolar geometry of the Crossed-Slits projection , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[46]  R. Hathaway.  Another interpretation of the EM algorithm for mixture distributions , 1986 .

[47]  Tomer Hertz,et al.  Learning and inferring image segmentations using the GBP typical cut algorithm , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[48]  Hai Tao,et al.  A background layer model for object tracking through occlusion , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[49]  Qiang Ji,et al.  Facial expression understanding in image sequences using dynamic and active visual information fusion , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[50]  Andrew Zisserman,et al.  Video Google: a text retrieval approach to object matching in videos , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[51]  R. Collins,et al.  On-line selection of discriminative tracking features , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[52]  Bir Bhanu,et al.  Probabilistic Feature Relevance Learning for Content-Based Image Retrieval , 1999, Comput. Vis. Image Underst..

[53]  Athinodoros S. Georghiades,et al.  Incorporating the Torrance and Sparrow model of reflectance in uncalibrated photometric stereo , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[54]  Ilan Shimshoni,et al.  Mean shift based clustering in high dimensions: a texture classification example , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[55]  Yiannis Aloimonos,et al.  Eye design in the plenoptic space of light rays , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[56]  Bir Bhanu,et al.  A new semi-supervised EM algorithm for image retrieval , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[57]  Andrew Blake,et al.  A sparse probabilistic learning algorithm for real-time tracking , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[58]  Assaf Zomet,et al.  Learning how to inpaint from global image statistics , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[59]  Gilles Trombettoni,et al.  Scene modeling based on constraint system decomposition techniques , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[60]  Stan Sclaroff,et al.  Stochastic refinement of the visual hull to satisfy photometric and silhouette consistency constraints , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[61]  Michael Brady,et al.  Unsupervised non-parametric region segmentation using level sets , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[62]  Kiriakos N. Kutulakos,et al.  Photo-consistent 3D fire by Flame-Sheet decomposition , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[63]  Dimitrios Katsoulas,et al.  Reliable recovery of piled box-like objects via parabolically deformable superquadrics , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[64]  Björn Stenger,et al.  Filtering using a tree-based estimator , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[65]  David A. Forsyth,et al.  Using temporal coherence to build models of animals , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[66]  Adrian Barbu,et al.  Graph partition by Swendsen-Wang cuts , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[67]  Vladimir Kolmogorov,et al.  Visual correspondence using energy minimization and mutual information , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[68]  Bir Bhanu,et al.  Concept learning and transplantation for dynamic image databases , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[69]  Luc Van Gool,et al.  SVM-based nonparametric discriminant analysis, an application to face detection , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[70]  Bir Bhanu,et al.  Concepts learning with fuzzy clustering and relevance feedback , 2002 .

[71]  Nuno Vasconcelos,et al.  Bayesian models for visual information retrieval , 2000 .

[72]  Frédéric Cao,et al.  Good continuations in digital image level lines , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[73]  Gang Hua,et al.  Tracking articulated body by dynamic Markov network , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[74]  Yunmei Chen,et al.  Using prior shape and intensity profile in medical image segmentation , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[75]  Bir Bhanu,et al.  Improving retrieval performance by long-term relevance information , 2002, Object recognition supported by user interaction for service robots.

[76]  Joost van de Weijer,et al.  Color edge detection by photometric quasi-invariants , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[77]  Geoffrey J. McLachlan,et al.  Finite Mixture Models , 2019, Annual Review of Statistics and Its Application.

[78]  Fumiaki Tomita,et al.  Plane-based calibration algorithm for multi-camera systems via factorization of homography matrices , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[79]  Olivier D. Faugeras,et al.  "Perspective shape from shading" and viscosity solutions , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[80]  Thomas S. Huang,et al.  Relevance feedback: a power tool for interactive content-based image retrieval , 1998, IEEE Trans. Circuits Syst. Video Technol..

[81]  Kostas Daniilidis,et al.  Mirrors in motion: epipolar geometry and motion estimation , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[82]  Ronen Basri,et al.  Dense shape reconstruction of a moving object under arbitrary, unknown lighting , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[83]  Sebastian Thrun,et al.  Text Classification from Labeled and Unlabeled Documents using EM , 2000, Machine Learning.

[84]  Antonio Torralba,et al.  Context-based vision system for place and object recognition , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[85]  Harry Wechsler,et al.  Controlling model complexity in flow estimation , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[86]  Shimon Ullman,et al.  Object recognition with informative features and linear classification , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[87]  Ying Wu,et al.  Towards self-exploring discriminating features for visual learning , 2002 .

[88]  Ullrich Köthe,et al.  Integrated Edge and Junction Detection with the Boundary Tensor , 2003, ICCV.

[89]  Rachid Deriche,et al.  The Beltrami flow over implicit manifolds , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[90]  Hui Gao,et al.  Recognizing human action efforts: an adaptive three-mode PCA framework , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[91]  Danijel Skocaj,et al.  Weighted and robust incremental method for subspace learning , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[92]  Yacov Hel-Or,et al.  Real-Time Pattern Matching Using Projection Kernels , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[93]  Mario Sznaier,et al.  A Caratheodory-Fejer approach to robust multiframe tracking , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[94]  Larry S. Davis,et al.  Camera calibration using spheres: a semi-definite programming approach , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[95]  Ingemar J. Cox,et al.  The Bayesian image retrieval system, PicHunter: theory, implementation, and psychophysical experiments , 2000, IEEE Trans. Image Process..

[96]  Frank Dellaert,et al.  Spectral partitioning for structure from motion , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[97]  Larry S. Davis,et al.  Improved fast gauss transform and efficient kernel density estimation , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[98]  J. J. Rocchio,et al.  Information Search Optimization and Iterative Retrieval Techniques , 1899 .

[99]  Yehezkel Yeshurun,et al.  A new perspective [on] shape-from-shading , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[100]  J. J. Rocchio,et al.  Information search optimization and interactive retrieval techniques , 1965, AFIPS '65 (Fall, part I).

[101]  Thomas S. Huang,et al.  Capturing subtle facial motions in 3D face tracking , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[102]  Helder Araújo,et al.  Paracatadioptric camera calibration using lines , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[103]  Song Wang,et al.  Landmark-based shape deformation with topology-preserving constraints , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.