Fast multiresolution image querying

We present a method for searching in an image database using a query image that is similar to the intended target. The query image may be a hand-drawn sketch or a (potentially low-quality) scan of the image to be retrieved. Our searching algorithm makes use of multiresolution wavelet decompositions of the query and database images. The coefficients of these decompositions are distilled into small “signatures” for each image. We introduce an “image querying metric” that operates on these signatures. This metric essentially compares how many significant wavelet coefficients the query has in common with potential targets. The metric includes parameters that can be tuned, using a statistical analysis, to accommodate the kinds of image distortions found in different types of image queries. The resulting algorithm is simple, requires very little storage overhead for the database of signatures, and is fast enough to be performed on a database of 20,000 images at interactive rates (on standard desktop machines) as a query is sketched. Our experiments with hundreds of queries in databases of 1000 and 20,000 images show dramatic improvement, in both speed and success rate, over using a conventional L1, L2, or color histogram norm. CR

[1]  H. Theil.  Introduction to econometrics , 1978 .

[2]  William H. Press,et al.  Numerical recipes , 1990 .

[3]  John E. Howland,et al.  Computer graphics , 1990, IEEE Potentials.

[4]  R. Coifman,et al.  Fast wavelet transforms and numerical algorithms I , 1991 .

[5]  Arnold W. M. Smeulders,et al.  An Approach to Image Indexing of Documents , 1991, VDB.

[6]  Toshikazu Kato,et al.  Database architecture for content-based image retrieval , 1992, Electronic Imaging.

[7]  William I. Grosky,et al.  Research directions in image database management , 1992, [1992] Eighth International Conference on Data Engineering.

[8]  William I. Grosky,et al.  Research Directions in Image Database Management (Panel) , 1992, IEEE International Conference on Data Engineering.

[9]  Edward H. Adelson,et al.  Shiftable multiscale transforms , 1992, IEEE Trans. Inf. Theory.

[10]  Ronald A. DeVore,et al.  Image compression through wavelet transform coding , 1992, IEEE Trans. Inf. Theory.

[11]  Gary E. Ford,et al.  Perceptually based coding of monochrome and color still images , 1992, Data Compression Conference, 1992..

[12]  Toshikazu Kato,et al.  Query by Visual Example - Content based Image Retrieval , 1992, EDBT.

[13]  Toshikazu Kato,et al.  A sketch retrieval method for full color image database-query by visual example , 1992, [1992] Proceedings. 11th IAPR International Conference on Pattern Recognition.

[14]  John P. Oakley,et al.  Detection and characterization of carboniferous foraminifera for content-based retrieval from an image database , 1993, Electronic Imaging.

[15]  Chin-Chen Chang,et al.  Similarity Retrieval on Pictorial Databases Based upon Module Operation , 1993, DASFAA.

[16]  T. Gevers,et al.  An Approach to Image Retrieval for Image Databases , 1993, DEXA.

[17]  Mikio Takagi,et al.  Similarity retrieval of NOAA satellite imagery by graph matching , 1993, Electronic Imaging.

[18]  Christos Faloutsos,et al.  QBIC project: querying images by content, using color, texture, and shape , 1993, Electronic Imaging.

[19]  Michael J. Swain,et al.  Interactive indexing into image databases , 1993, Electronic Imaging.

[20]  Robert J. Safranek,et al.  Perceptual coding of images , 1993, Electronic Imaging.

[21]  Mark Weiser,et al.  Some computer science issues in ubiquitous computing , 1993, CACM.

[22]  John P. Oakley,et al.  Storage and Retrieval for Image and Video Databases , 1993 .

[23]  Dragutin Petkovic,et al.  Efficient query by image content for very large image databases , 1993, Digest of Papers. Compcon Spring.

[24]  E. J. Stollnitz,et al.  Wavelets for Computer Graphics : A Primer , 1994 .

[25]  Patrick C. Teo,et al.  Perceptual image distortion , 1994, Proceedings of 1st International Conference on Image Processing.

[26]  B. Pinkerton,et al.  Finding What People Want : Experiences with the WebCrawler , 1994, WWW Spring 1994.

[27]  Stephen W. Smoliar,et al.  Content based video indexing and retrieval , 1994, IEEE MultiMedia.

[28]  Yihong Gong,et al.  An image database system with content capturing and fast image indexing abilities , 1994, 1994 Proceedings of IEEE International Conference on Multimedia Computing and Systems.

[29]  K. Wakimoto,et al.  Efficient and Effective Querying by Image Content , 1994 .

[30]  Patrick M. Kelly,et al.  CANDID: comparison algorithm for navigating digital image databases , 1994, Seventh International Working Conference on Scientific and Statistical Database Management.

[31]  Chin-Chen Chang,et al.  Application of geometric hashing to iconic database retrieval , 1994, Pattern Recognit. Lett..

[32]  David Salesin,et al.  Wavelets for computer graphics: a primer. 2 , 1995, IEEE Computer Graphics and Applications.

[33]  David Salesin,et al.  Wavelets for computer graphics: a primer.1 , 1995, IEEE Computer Graphics and Applications.

[34]  E. J. Stollnitz,et al.  Wavelets for Computer Graphics: A Primer Part 2 , 1995 .

[35]  Patrick M. Kelly,et al.  Experience with CANDID: comparison algorithm for navigating digital image databases , 1995, Other Conferences.

[36]  Thomas Ertl,et al.  Computer Graphics - Principles and Practice, 3rd Edition , 2014 .