Review of Image and Video Indexing Techniques

Visual database systems require efficient indexing to facilitate fast access to the images and video sequences in the database. Recently, several content-based indexing methods for image and video based on spatial relationships, color, texture, shape, sketch, object motion, and camera parameters have been reported in the literature. The goal of this paper is to provide a critical survey of existing literature on content-based indexing techniques and to point out the relative advantages and disadvantages of each approach.

[1]  Irene Gargantini,et al.  An effective way to represent quadtrees , 1982, CACM.

[2]  Philippe Aigrain,et al.  The automatic real-time analysis of film editing and transition effects and its applications , 1994, Comput. Graph..

[3]  Anil K. Jain,et al.  Texture Analysis , 2018, Handbook of Image Processing and Computer Vision.

[4]  Ullas Gargi,et al.  Evaluation of video sequence indexing and hierarchical video indexing , 1995, Electronic Imaging.

[5]  Thomas D. C. Little,et al.  A Survey of Technologies for Parsing and Indexing Digital Video1 , 1996, J. Vis. Commun. Image Represent..

[6]  Enn Tyugu,et al.  Three new-generation software environments , 1991, CACM.

[7]  John P. Eakins,et al.  ARTISAN: a shape retrieval system based on boundary family indexing , 1996, Electronic Imaging.

[8]  Akio Nagasaka,et al.  Automatic Video Indexing and Full-Video Search for Object Appearances , 1991, VDB.

[9]  Keh-Yih Su,et al.  An Efficient Algorithm for Matching Multiple Patterns , 1993, IEEE Trans. Knowl. Data Eng..

[10]  Suh-Yin Lee,et al.  Signature file as a spatial filter for iconic image database , 1992, J. Vis. Lang. Comput..

[11]  Yihong Gong,et al.  Video parsing using compressed data , 1994, Electronic Imaging.

[12]  Rajiv Mehrotra,et al.  Shape-similarity-based retrieval in image database systems , 1992, Electronic Imaging.

[13]  C.-C. Jay Kuo,et al.  Color distribution analysis and quantization for image retrieval , 1996, Electronic Imaging.

[14]  Svetha Venkatesh,et al.  Qualitative estimation of camera motion parameters from video sequences , 1997, Pattern Recognition.

[15]  Shi-Kuo Chang,et al.  Iconic Indexing by 2-D Strings , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Yoshinobu Tonomura,et al.  Video handling based on structured information for hypermedia systems , 1991 .

[17]  Stephen W. Smoliar,et al.  Developing power tools for video indexing and retrieval , 1994, Electronic Imaging.

[18]  Michael McGill,et al.  Introduction to Modern Information Retrieval , 1983 .

[19]  Ramesh C. Jain,et al.  Knowledge-guided parsing in video databases , 1993, Electronic Imaging.

[20]  Yoshinobu Tonomura,et al.  Projection Detecting Filter for Video Cut Detection , 1993, ACM Multimedia.

[21]  Jungwoo Lee,et al.  Multiresolution video indexing for subband coded video databases , 1994, Electronic Imaging.

[22]  A. Ravishankar Rao,et al.  Relationship between texture terms and texture images: a study in human texture perception , 1996, Electronic Imaging.

[23]  Anil K. Jain.  Fundamentals of Digital Image Processing , 2018, Control of Color Imaging Systems.

[24]  Dragutin Petkovic,et al.  Content-Based Representation and Retrieval of Visual Media: A State-of-the-Art Review , 1996 .

[25]  John S. Boreczky,et al.  Indexes for user access to large video databases , 1994, Electronic Imaging.

[26]  Ramesh C. Jain,et al.  Dynamic vision , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[27]  Xiaobo Li,et al.  A Study of Image Indexing Techniques for Multimedia Database Systems , 1995 .

[28]  Sim Heng Ong,et al.  Image retrieval based on multidimensional feature properties , 1995, Electronic Imaging.

[29]  Erland Jungert,et al.  Extended Symbolic Projections as a Knowledge Structure for Spatial Reasoning , 1988, Pattern Recognition.

[30]  Gregory L. Zick,et al.  Scene decomposition of MPEG-compressed video , 1995, Electronic Imaging.

[31]  Toshikazu Kato,et al.  A sketch retrieval method for full color image database-query by visual example , 1992, [1992] Proceedings. 11th IAPR International Conference on Pattern Recognition.

[32]  Phil Brodatz,et al.  Textures: A Photographic Album for Artists and Designers , 1966 .

[33]  Shi-Kuo Chang,et al.  Representation And Retrieval Of Symbolic Pictures Using Generalized 2D Strings , 1989, Other Conferences.

[34]  Ming Lei Liou,et al.  Overview of the p×64 kbit/s video coding standard , 1991, CACM.

[35]  Yihong Gong,et al.  Automatic parsing of news video , 1994, 1994 Proceedings of IEEE International Conference on Multimedia Computing and Systems.

[36]  Domenico Tegolo,et al.  Shape analysis for image retrieval , 1994, Electronic Imaging.

[37]  Sethuraman Panchanathan,et al.  Image indexing using wavelet vector quantization , 1995, Other Conferences.

[38]  C. H. Chen,et al.  Handbook of Pattern Recognition and Computer Vision , 1993 .

[39]  William I. Grosky,et al.  Hierarchical approach to feature indexing , 1992, Electronic Imaging.

[40]  David B. Cooper,et al.  Recognition and positioning of rigid objects using algebraic moment invariants , 1991, Optics & Photonics.

[41]  William I. Grosky,et al.  Hierarchical approach to feature indexing , 1994, Image Vis. Comput..

[42]  Ernest L. Hall,et al.  Computer Image Processing and Recognition , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  Ramez Elmasri,et al.  Fundamentals of Database Systems , 1989 .

[44]  King-Sun Fu,et al.  Shape Discrimination Using Fourier Descriptors , 1977, IEEE Trans. Syst. Man Cybern..

[45]  Glorianna Davenport,et al.  Cinematic primitives for multimedia , 1991, IEEE Computer Graphics and Applications.

[46]  C.-C. Jay Kuo,et al.  Content-based image retrieval using multiresolution histogram representation , 1995, Other Conferences.

[47]  Behzad Shahraray,et al.  Scene change detection and content-based sampling of video sequences , 1995, Electronic Imaging.

[48]  B. S. Manjunath,et al.  Texture Features for Browsing and Retrieval of Image Data , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[49]  Allen Gersho,et al.  Vector quantization and signal compression , 1991, The Kluwer international series in engineering and computer science.

[50]  Paul England,et al.  Comparison of automatic video segmentation algorithms , 1996, Other Conferences.

[51]  Filson H. Glanz,et al.  An Autoregressive Model Approach to Two-Dimensional Shape Classification , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[52]  Rajiv Mehrotra,et al.  Similar-Shape Retrieval in Shape Data Management , 1995, Computer.

[53]  Hideyuki Tamura,et al.  Textural Features Corresponding to Visual Perception , 1978, IEEE Transactions on Systems, Man, and Cybernetics.

[54]  Peiya Liu,et al.  Content-based indexing technique using relative geometry features , 1992, Electronic Imaging.

[55]  Forouzan Golshani,et al.  Rx for semantic video database retrieval , 1994, MULTIMEDIA '94.

[56]  Christos Faloutsos,et al.  The R+-Tree: A Dynamic Index for Multi-Dimensional Objects , 1987, VLDB.

[57]  Leonidas J. Guibas,et al.  Fixed-window image descriptors for image retrieval , 1995, Electronic Imaging.

[58]  Shi-Kuo Chang,et al.  Image Information Systems: Where Do We Go From Here? , 1992, IEEE Trans. Knowl. Data Eng..

[59]  Sethuraman Panchanathan,et al.  Storage and retrieval of compressed images , 1995 .

[60]  Arding Hsu,et al.  Feature management for large video databases , 1993, Electronic Imaging.

[61]  Gregory K. Wallace,et al.  The JPEG still picture compression standard , 1991, CACM.

[62]  Christos Faloutsos,et al.  QBIC project: querying images by content, using color, texture, and shape , 1993, Electronic Imaging.

[63]  Shih-Fu Chang,et al.  Scene change detection in an MPEG-compressed video sequence , 1995, Electronic Imaging.

[64]  Vijay V. Raghavan,et al.  Content-Based Image Retrieval Systems - Guest Editors' Introduction , 1995, Computer.

[65]  Hiroaki Sakamoto,et al.  Flexible montage retrieval for image data , 1994, Electronic Imaging.

[66]  James Lee Hafner,et al.  Efficient Color Histogram Indexing for Quadratic Form Distance Functions , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[67]  Stephen W. Smoliar,et al.  Content based video indexing and retrieval , 1994, IEEE MultiMedia.

[68]  Michael Unser,et al.  Sum and Difference Histograms for Texture Classification , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[69]  Boon-Lock Yeo,et al.  A unified approach to temporal segmentation of motion JPEG and MPEG compressed video , 1995, Proceedings of the International Conference on Multimedia Computing and Systems.

[70]  HongJiang Zhang,et al.  Scheme for visual feature-based image indexing , 1995, Electronic Imaging.

[71]  Hideo Hashimoto,et al.  Video indexing using motion vectors , 1992, Other Conferences.

[72]  Harpreet S. Sawhney.  Motion video analysis using planar parallax , 1994, Electronic Imaging.

[73]  A. Kundu,et al.  Rotation and Gray Scale Transform Invariant Texture Identification using Wavelet Decomposition and Hidden Markov Model , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[74]  Hans-Peter Kriegel,et al.  The R*-tree: an efficient and robust access method for points and rectangles , 1990, SIGMOD '90.

[75]  Arding Hsu,et al.  Image processing on compressed data for large video databases , 1993, MULTIMEDIA '93.

[76]  B. S. Manjunath,et al.  Image indexing using a texture dictionary , 1995, Other Conferences.

[77]  Shih-Fu Chang,et al.  Compressed-domain techniques for image/video indexing and manipulation , 1995, Proceedings., International Conference on Image Processing.

[78]  Suh-Yin Lee,et al.  Video indexing: an approach based on moving object and track , 1993, Electronic Imaging.

[79]  C.-C. Jay Kuo,et al.  Content-based retrieval of color and multispectral images using joint spatial-spectral indexing , 1995, Other Conferences.

[80]  Didier Le Gall,et al.  MPEG: a video compression standard for multimedia applications , 1991, CACM.

[81]  Yoshinobu Tonomura,et al.  Video tomography: an efficient method for camerawork extraction and motion analysis , 1994, MULTIMEDIA '94.

[82]  S. Chatterjee,et al.  Similarity measures for image databases , 1995, Proceedings of 1995 IEEE International Conference on Fuzzy Systems..

[83]  Rosalind W. Picard,et al.  Finding similar patterns in large image databases , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[84]  Laura Hartwick,et al.  Visual image retrieval for applications in art and art history , 1994, Electronic Imaging.

[85]  Ibrahim M. Elfadel,et al.  Gibbs Random Fields, Cooccurrences, and Texture Modeling , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[86]  Markus A. Stricker,et al.  Color indexing with weak spatial constraints , 1996, Electronic Imaging.

[87]  Michael Shneier,et al.  Exploiting the JPEG Compression Scheme for Image Retrieval , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[88]  T. John Stonham,et al.  Content-based image retrieval using color tuple histograms , 1996, Electronic Imaging.

[89]  Jürg Nievergelt,et al.  The Grid File: An Adaptable, Symmetric Multikey File Structure , 1984, TODS.

[90]  Remi Depommier,et al.  Content-based browsing of video sequences , 1994, MULTIMEDIA '94.

[91]  Markus A. Stricker,et al.  Similarity of color images , 1995, Electronic Imaging.

[92]  Yoshinobu Tonomura,et al.  Video browsing using brightness data , 1991, Other Conferences.

[93]  Shih-Fu Chang,et al.  Manipulation and Compositing of MC-DCT Compressed Video , 1995, IEEE J. Sel. Areas Commun..

[94]  Shi-Kuo Chang,et al.  Two-dimensional string matching algorithm for conceptual pictorial queries , 1992, Electronic Imaging.

[95]  Tat-Seng Chua,et al.  Content-based retrieval of segmented images , 1994, MULTIMEDIA '94.

[96]  Alex Pentland,et al.  Photobook: tools for content-based manipulation of image databases , 1994, Electronic Imaging.

[97]  B. S. Manjunath,et al.  Adaptive filtering and indexing for image databases , 1995, Electronic Imaging.

[98]  Terry E. Weymouth,et al.  Semantic Queries with Pictures: The VIMSYS Model , 1991, VLDB.

[99]  Brian Scassellati,et al.  Retrieving images by 2D shape: a comparison of computation methods with human perceptual judgments , 1994, Electronic Imaging.

[100]  Hans Muller.  LispView: leverage through integration , 1991, CACM.

[101]  Masato Kurokawa,et al.  Method for retrieving sequences of images on the basis of motion analysis , 1992, Electronic Imaging.

[102]  Ramesh C. Jain,et al.  Similarity measures for image databases , 1995, Electronic Imaging.

[103]  Hideyuki Tamura,et al.  Image database systems: A survey , 1984, Pattern Recognit..

[104]  Michael J. Swain,et al.  Interactive indexing into image databases , 1993, Electronic Imaging.

[105]  Yihong Gong,et al.  An image database system with content capturing and fast image indexing abilities , 1994, 1994 Proceedings of IEEE International Conference on Multimedia Computing and Systems.

[106]  Sethuraman Panchanathan,et al.  Image indexing using vector quantization , 1995, Electronic Imaging.

[107]  SUH-YIN LEE,et al.  Spatial reasoning and similarity retrieval of images using 2D C-string knowledge representation , 1992, Pattern Recognit..