CORE: a content-based retrieval engine for multimedia information systems

Rapid advances in multimedia technology necessitate the development of a generic multimedia information system with a powerful retrieval engine for prototyping multimedia applications. We develop a content-based retrieval engine (CORE) that makes use of novel indexing techniques for multimedia object retrieval. We formalize the concepts related to multimedia information systems such as multimedia objects and content-based retrieval. We bring out the requirements and challenges of a multimedia information system. The architecture of CORE is described in detail along with the associated retrieval mechanisms and indexing techniques. Various modules developed for efficient retrieval are presented with some APIs. The efficacy of CORE is demonstrated in the development of two multimedia systems, a computer-aided facial image inference and retrieval (CAFIIR) system and a system for trademark archival and retrieval (STAR), which have been developed at the Institute of Systems Science (ISS). We expect that CORE will be useful for effective prototyping of other such multimedia applications.

[1]  Teuvo Kohonen,et al.  Self-organization and associative memory: 3rd edition , 1989 .

[2]  King-Sun Fu,et al.  Picture Query Languages for Pictorial Data-Base Systems , 1981, Computer.

[3]  William I. Grosky,et al.  Multimedia information systems , 1994, IEEE MultiMedia.

[4]  William I. Grosky,et al.  Index-based object recognition in pictorial data management , 1990, Comput. Vis. Graph. Image Process..

[5]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[6]  D. McKeown MAPS: The Organization of a Spatial Database System Using Imagery, Terrain, and Map Data , 1983 .

[7]  C. Jaffe,et al.  Medical imaging databases. A National Institutes of Health workshop. , 1993, Investigative radiology.

[8]  Masahito Hirakawa,et al.  Knowledge-assisted content-based retrieval for multimedia databases , 1994, 1994 Proceedings of IEEE International Conference on Multimedia Computing and Systems.

[9]  Robert Milton Underwood Object-Oriented Database Technology , 2002 .

[10]  P B Berra,et al.  Architecture for distributed multimedia database systems , 1990, Comput. Commun..

[11]  Euripides G. M. Petrakis,et al.  Methodology for the representation, indexing and retrieval of images by content , 1993, Image Vis. Comput..

[12]  Raimondo Schettini,et al.  Fuzzy reasoning approach to similarity evaluation in image analysis , 1993, Int. J. Intell. Syst..

[13]  Jian-Kang Wu,et al.  Inference and retrieval of facial images , 1994, Multimedia Systems.

[14]  A. Tversky Features of Similarity , 1977 .

[15]  Hans Bandemer,et al.  Fuzzy Data Analysis , 1992 .

[16]  Stephen W. Smoliar,et al.  Content based video indexing and retrieval , 1994, IEEE MultiMedia.

[17]  Mohan S. Kankanhalli,et al.  Color matching for image retrieval , 1995, Pattern Recognit. Lett..

[18]  Babu M. Mehtre,et al.  STAR - A Multimedia Database System For Trademark Registration , 1994, ADB.

[19]  Ramesh C. Jain,et al.  A Visual Information Management System for the Interactive Retrieval of Faces , 1993, IEEE Trans. Knowl. Data Eng..

[20]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[21]  King-Sun Fu,et al.  Query-by-Pictorial-Example , 1980, IEEE Trans. Software Eng..

[22]  Alex Pentland,et al.  Photobook: tools for content-based manipulation of image databases , 1994, Other Conferences.

[23]  Shi-Kuo Chang,et al.  Image Information Systems: Where Do We Go From Here? , 1992, IEEE Trans. Knowl. Data Eng..

[24]  Jian Kang Wu LEP — A Neural Model learning Reliably , 1990 .

[25]  Padhraic Smyth,et al.  Image database exploration: progress and challenges , 1993 .

[26]  Deyi Li,et al.  A Fuzzy Prolog Database System , 1990 .

[27]  Shi-Kuo Chang,et al.  An Intelligent Image Database System , 1988, IEEE Trans. Software Eng..

[28]  Michael Stonebraker,et al.  The SEQUOIA 2000 Project , 1993, SSD.