BilVideo: Design and Implementation of a Video Database Management System

With the advances in information technology, the amount of multimedia data captured, produced, and stored is increasing rapidly. As a consequence, multimedia content is widely used for many applications in today’s world, and hence, a need for organizing this data, and accessing it from repositories with vast amount of information has been a driving stimulus both commercially and academically. In compliance with this inevitable trend, first image and especially later video database management systems have attracted a great deal of attention, since traditional database systems are designed to deal with alphanumeric information only, thereby not being suitable for multimedia data.In this paper, a prototype video database management system, which we call BilVideo, is introduced. The system architecture of BilVideo is original in that it provides full support for spatio-temporal queries that contain any combination of spatial, temporal, object-appearance, external-predicate, trajectory-projection, and similarity-based object-trajectory conditions by a rule-based system built on a knowledge-base, while utilizing an object-relational database to respond to semantic (keyword, event/activity, and category-based), color, shape, and texture queries. The parts of BilVideo (Fact-Extractor, Video-Annotator, its Web-based visual query interface, and its SQL-like textual query language) are presented, as well. Moreover, our query processing strategy is also briefly explained.

[1]  Mohand-Said Hacid,et al.  A database approach for modeling and querying video data , 1999, Proceedings 15th International Conference on Data Engineering (Cat. No.99CB36337).

[2]  Dragutin Petkovic,et al.  Query by Image and Video Content: The QBIC System , 1995, Computer.

[3]  T. Ozsu,et al.  Modeling of video spatial relationships in an object database management system , 1996, Proceedings of International Workshop on Multimedia Database Management Systems.

[4]  Anne H. H. Ngu,et al.  Modeling and Retrieval of Moving Objects , 2004, Multimedia Tools and Applications.

[5]  Rangasami L. Kashyap,et al.  A Spatio-Temporal Semantic Model for Multimedia Database Systems and Multimedia Information Systems , 2001, IEEE Trans. Knowl. Data Eng..

[6]  Arbee L. P. Chen,et al.  Content-Based Query Processing for Video Databases , 2000, IEEE Trans. Multim..

[7]  Özgür Ulusoy,et al.  A histogram-based approach for object-based query-by-shape-and-color in image and video databases , 2005, Image Vis. Comput..

[8]  Duane Szafron,et al.  Spatial Reasoning Rules in Multimedia Management Systems , 1996, MMM.

[9]  Alexander G. Hauptmann,et al.  Informedia: news-on-demand multimedia information acquisition and retrieval , 1997 .

[10]  M. Tamer Özsu,et al.  Modeling and querying multimedia data , 1998 .

[11]  Shih-Fu Chang,et al.  VideoQ: an automated content based video search system using visual cues , 1997, MULTIMEDIA '97.

[12]  King-Lup Liu,et al.  Similarity based Retrieval of Pictures Using Indices on Spatial Relationships , 1995, VLDB.

[13]  Duane Szafron,et al.  Modeling video temporal relationships in an object database management system , 1997, Electronic Imaging.

[14]  Duane Szafron,et al.  Multimedia Extensions To Database Query Languages , 1997 .

[15]  Sushil Jajodia,et al.  Multimedia database systems: issues and research directions , 1996 .

[16]  Özgür Ulusoy,et al.  A Semi-Automatic Semantic Annotation Tool for Video Databases , 2002 .

[17]  Umut Arslan A semantic data model and query language for video databases , 2002 .

[18]  Noboru Babaguchi,et al.  Event based indexing of broadcasted sports video by intermodal collaboration , 2002, IEEE Trans. Multim..

[19]  Özgür Ulusoy,et al.  BilVideo: A Video Database Management System , 2003, IEEE Multim..

[20]  Ugur Güdükbay,et al.  A Histogram-Based Approach for Object-Based Query-by-Shape-and-Color in Multimedia Databases , 2002 .

[21]  LI JOHNZ. STARS: A SPATIAL ATTRIBUTES RETRIEVAL SYSTEM FOR IMAGES AND VIDEOS , 1997 .

[22]  V. S. Subrahmanian,et al.  Querying Video Libraries* , 1996, J. Vis. Commun. Image Represent..

[23]  Yannis Manolopoulos,et al.  Overlapping linear quadtrees: a spatio-temporal access method , 1998, GIS '98.

[24]  Ediz Saykol WEB-BASED USER INTERFACE FOR QUERY SPECIFICATION IN A VIDEO DATABASE SYSTEM , 2001 .

[25]  Takeo Kanade,et al.  Name-It: Naming and Detecting Faces in News Videos , 1999, IEEE Multim..

[26]  James F. Allen Maintaining knowledge about temporal intervals , 1983, CACM.

[27]  V. S. Subrahmanian,et al.  Foundations of multimedia database systems , 1996, JACM.

[28]  Rune Hjelsvold,et al.  Modelling and Querying Video Data , 1994, VLDB.

[29]  Katsumi Tanaka,et al.  OVID: Design and Implementation of a Video-Object Database System , 1993, IEEE Trans. Knowl. Data Eng..

[30]  K. Selçuk Candan,et al.  The Advanced Video Information System: data structures and query processing , 1996, Multimedia Systems.

[31]  Mario A. Nascimento,et al.  Towards historical R-trees , 1998, SAC '98.

[32]  Özgür Ulusoy,et al.  A Semi-Automatic Object Extraction Tool for Querying in Multimedia Databases , 2001, Multimedia Information Systems.

[33]  Özgür Ulusoy,et al.  A rule-based video database system architecture , 2002, Inf. Sci..

[34]  M. Tamer Özsu,et al.  An object-oriented SGML/HyTime compliant multimedia database management system , 1997, MULTIMEDIA '97.

[35]  John M. Gauch,et al.  The vision digital video library , 1997, Inf. Process. Manag..

[36]  Özgür Ulusoy,et al.  Rule-based spatiotemporal query processing for video databases , 2003, The VLDB Journal.

[37]  K. Wakimoto,et al.  Efficient and Effective Querying by Image Content , 1994 .

[38]  John M. Gauch,et al.  The VISION Digital Video Library Project , 1998 .

[39]  William A. Woods,et al.  Computational Linguistics Transition Network Grammars for Natural Language Analysis , 2022 .

[40]  Atsuo Yoshitaka,et al.  A Survey on Content-Based Retrieval for Multimedia Databases , 1999, IEEE Trans. Knowl. Data Eng..

[41]  Yannis Theodoridis,et al.  On the Generation of Spatiotemporal Datasets , 1999 .

[42]  Shih-Fu Chang,et al.  VisualSEEk: a fully automated content-based image query system , 1997, MULTIMEDIA '96.

[43]  Timos K. Sellis,et al.  Spatio-temporal indexing for large multimedia applications , 1996, Proceedings of the Third IEEE International Conference on Multimedia Computing and Systems.

[44]  Myron Flickner,et al.  Query by Image and Video Content , 1995 .

[45]  Clement T. Yu,et al.  Reasoning about Qualitative Spatial Relationships , 2000, Journal of Automated Reasoning.

[46]  Shih-Fu Chang,et al.  Overview of the MPEG-7 standard , 2001, IEEE Trans. Circuits Syst. Video Technol..

[47]  Özgür Ulusoy,et al.  An efficient query optimization strategy for spatio-temporal queries in video databases , 2004 .

[48]  Jan Rittinger,et al.  E-cient and Efiective Querying by Image Content , 2004 .

[49]  Timos K. Sellis,et al.  Spatio-temporal composition in multimedia applications , 1996, Proceedings International Workshop on Multimedia Software Development.

[50]  Sherry MarcusO Foundations of Multimedia Information Systems , 1998 .

[51]  Mohand-Said Hacid,et al.  A Database Approach for Modeling and Querying Video Data , 2000, IEEE Trans. Knowl. Data Eng..

[52]  Yan Liu,et al.  Semantic Extraction and Semantics-Based Annotation and Retrieval for Video Databases , 2004, Multimedia Tools and Applications.