Rule-based spatiotemporal query processing for video databases

Abstract.In our earlier work, we proposed an architecture for a Web-based video database management system (VDBMS) providing an integrated support for spatiotemporal and semantic queries. In this paper, we focus on the task of spatiotemporal query processing and also propose an SQL-like video query language that has the capability to handle a broad range of spatiotemporal queries. The language is rule-based in that it allows users to express spatial conditions in terms of Prolog-type predicates. Spatiotemporal query processing is carried out in three main stages: query recognition, query decomposition, and query execution.

[1]  James F. Allen.  Maintaining knowledge about temporal intervals , 1983, CACM.

[2]  V. S. Subrahmanian,et al.  Foundations of multimedia database systems , 1996, JACM.

[3]  MAX J. EGENHOFER,et al.  Point Set Topological Relations , 1991, Int. J. Geogr. Inf. Sci..

[4]  A. Prasad Sistla,et al.  Modeling and querying moving objects , 1997, Proceedings 13th International Conference on Data Engineering.

[5]  Kannan Ramchandran,et al.  Multimedia Analysis and Retrieval System (MARS) Project , 1996, Data Processing Clinic.

[6]  Stephen W. Smoliar,et al.  Content based video indexing and retrieval , 1994, IEEE MultiMedia.

[7]  Duane Szafron,et al.  Multimedia Extensions To Database Query Languages , 1997 .

[8]  Sushil Jajodia,et al.  Multimedia database systems: issues and research directions , 1996 .

[9]  Anne H. H. Ngu,et al.  Modeling and Retrieval of Moving Objects , 2004, Multimedia Tools and Applications.

[10]  Özgür Ulusoy,et al.  A Semi-Automatic Semantic Annotation Tool for Video Databases , 2002 .

[11]  Rune Hjelsvold,et al.  Modelling and Querying Video Data , 1994, VLDB.

[12]  Ricky K. Taira,et al.  KMeD: a Knowledge-based Multimedia Medical Distributed Database System , 1995, Inf. Syst..

[13]  V. S. Subrahmanian,et al.  Querying Video Libraries* , 1996, J. Vis. Commun. Image Represent..

[14]  Ahmed K. Elmagarmid,et al.  VideoText database systems , 1997, Proceedings of IEEE International Conference on Multimedia Computing and Systems.

[15]  Shi-Kuo Chang,et al.  Iconic Indexing by 2-D Strings , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  M. Tamer Özsu,et al.  An object-oriented SGML/HyTime compliant multimedia database management system , 1997, MULTIMEDIA '97.

[17]  Euripides G. M. Petrakis,et al.  Methodology for the representation, indexing and retrieval of images by content , 1993, Image Vis. Comput..

[18]  Özgür Ulusoy,et al.  A rule-based video database system architecture , 2002, Inf. Sci..

[19]  Özgür Ulusoy,et al.  An efficient query optimization strategy for spatio-temporal queries in video databases , 2004 .

[20]  V. S. Subrahmanian,et al.  Towards a Theory of Multimedia Database Systems , 1996, Multimedia Database System: Issues and Research Direction.

[21]  Dragutin Petkovic,et al.  Query by Image and Video Content: The QBIC System , 1995, Computer.

[22]  LI JOHNZ..  STARS: A SPATIAL ATTRIBUTES RETRIEVAL SYSTEM FOR IMAGES AND VIDEOS , 1997 .

[23]  Arbee L. P. Chen,et al.  Content-Based Query Processing for Video Databases , 2000, IEEE Trans. Multim..

[24]  V. S. Subrahmanian,et al.  Multimedia Database Systems , 1993, Artificial Intelligence.

[25]  Timos K. Sellis,et al.  Topological relations in the world of minimum bounding rectangles: a study with R-trees , 1995, SIGMOD '95.

[26]  K. Selçuk Candan,et al.  The Advanced Video Information System: data structures and query processing , 1996, Multimedia Systems.

[27]  Yueting Zhuang,et al.  Applying Semantic Association To Support Content-Based Video Retrieval , 1998 .

[28]  Özgür Ulusoy,et al.  BilVideo: A Video Database Management System , 2003, IEEE Multim..

[29]  Arbee L. P. Chen,et al.  Semantic video model for content-based retrieval , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[30]  Ugur Güdükbay,et al.  A Histogram-Based Approach for Object-Based Query-by-Shape-and-Color in Multimedia Databases , 2002 .

[31]  E. Schmidt,et al.  Lex—a lexical analyzer generator , 1990 .

[32]  Vincent Oria,et al.  MOQL: A Multimedia Object Query Language , 2000 .

[33]  Murray Hill,et al.  Yacc: Yet Another Compiler-Compiler , 1978 .

[34]  Duane Szafron,et al.  Modeling of moving objects in a video database , 1997, Proceedings of IEEE International Conference on Multimedia Computing and Systems.

[35]  Katsumi Tanaka,et al.  OVID: Design and Implementation of a Video-Object Database System , 1993, IEEE Trans. Knowl. Data Eng..

[36]  Özgür Ulusoy,et al.  An efficient query optimization strategy for spatio-temporal queries in video databases , 2004, J. Syst. Softw..

[37]  Shih-Fu Chang,et al.  VideoQ: an automated content based video search system using visual cues , 1997, MULTIMEDIA '97.

[38]  Arbee L. P. Chen,et al.  A content-based query language for video databases , 1996, Proceedings of the Third IEEE International Conference on Multimedia Computing and Systems.

[39]  Markus Schneider,et al.  A foundation for representing and querying moving objects , 2000, TODS.

[40]  Sherry MarcusO.  Foundations of Multimedia Information Systems , 1998 .

[41]  M. Tamer Özsu,et al.  Modeling and querying multimedia data , 1998 .

[42]  Ediz Saykol.  WEB-BASED USER INTERFACE FOR QUERY SPECIFICATION IN A VIDEO DATABASE SYSTEM , 2001 .