Modeling Video Data for Content Based Queries: Extending the DISIMA Image Data Model

We present an efficient video data model that extends the DISIMA image data model by adding the video components and setting up links between image and video data. Many video data models have been proposed, most of which describe video data independently of image data and therefore fail to consider the relationship between videos and images. Our proposed model expresses the semantics of video data content by means of salient objects and relationships among them. Connections between video data and DISIMA images are made through key frames, which are extracted from each shot. Based on these connections, techniques used to query image data may be used to query video data. In addition, a set of new predicates has been defined to describe the spatio-temporal characteristics of salient objects in the video data. MOQL is used as a query language, with which we present example queries that can be posed on the proposed video data model..

[1]  Boon-Lock Yeo,et al.  Time-constrained clustering for segmentation of video into story units , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[2]  Lei Chen,et al.  Modeling of video objects in a video databases , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[3]  Vincent Oria,et al.  MOQL: A Multimedia Object Query Language , 2000 .

[4]  Arif Ghafoor,et al.  An approach for video meta-data modeling and query processing , 1999, MULTIMEDIA '99.

[5]  László Böszörményi,et al.  VIDEX: an integrated generic video indexing approach , 2000, ACM Multimedia.

[6]  A. Murat Tekalp,et al.  Content-based video abstraction , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[7]  James F. Allen.  Maintaining knowledge about temporal intervals , 1983, CACM.

[8]  Duane Szafron,et al.  Modeling of moving objects in a video database , 1997, Proceedings of IEEE International Conference on Multimedia Computing and Systems.

[9]  David K. Gifford,et al.  Composition and Search with a Video Algebra , 1995, IEEE Multim..

[10]  Glorianna Davenport,et al.  The Stratification System - A Design Emvironment for Random Access , 1992, NOSSDAV.

[11]  Alan Hanjalic,et al.  Automatically Segmenting Movies into Logical Story Units , 1999, VISUAL.

[12]  Thomas S. Huang,et al.  Exploring video structure beyond the shots , 1998, Proceedings. IEEE International Conference on Multimedia Computing and Systems (Cat. No.98TB100241).

[13]  A. Murat Tekalp,et al.  Temporal video segmentation using unsupervised clustering and semantic object tracking , 1998, J. Electronic Imaging.

[14]  Arif Ghafoor,et al.  Object-oriented conceptual modeling of video data , 1995, Proceedings of the Eleventh International Conference on Data Engineering.

[15]  M. Tamer Özsu,et al.  Querying Images in the DISIMA DBMS , 2001, Multimedia Information Systems.

[16]  Atreyi Kankanhalli,et al.  Automatic partitioning of full-motion video , 1993, Multimedia Systems.

[17]  R. G. G. Cattell,et al.  The Object Database Standard: ODMG-93 , 1993 .

[18]  Peter J. Rousseeuw,et al.  Robust Regression and Outlier Detection , 2005, Wiley Series in Probability and Statistics.

[19]  David Jordan,et al.  The Object Database Standard: ODMG 2.0 , 1997 .

[20]  Glorianna Davenport,et al.  The Stratification System A Design Environment for Random Access Video , 2005 .

[21]  F. Dirfaux.  Key frame selection to represent a video , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[22]  Rune Hjelsvold,et al.  Modelling and Querying Video Data , 1994, VLDB.

[23]  Stephen W. Smoliar,et al.  Video parsing, retrieval and browsing: an integrated and content-based solution , 1997, MULTIMEDIA '95.

[24]  Anne H. H. Ngu,et al.  Modelling Moving Objects in Multimedia Databases , 1997, DASFAA.

[25]  Rangasami L. Kashyap,et al.  A Spatio-Temporal Semantic Model for Multimedia Database Systems and Multimedia Information Systems , 2001, IEEE Trans. Knowl. Data Eng..

[26]  Markus Schneider,et al.  Developments in spatio-temporal query languages , 1999, Proceedings. Tenth International Workshop on Database and Expert Systems Applications. DEXA 99.

[27]  Ahmed K. Elmagarmid,et al.  VideoText database systems , 1997, Proceedings of IEEE International Conference on Multimedia Computing and Systems.

[28]  Alberto Del Bimbo,et al.  Symbolic Description and Visual Querying of Image Sequences Using Spatio-Temporal Logic , 1995, IEEE Trans. Knowl. Data Eng..

[29]  Katsumi Tanaka,et al.  OVID: Design and Implementation of a Video-Object Database System , 1993, IEEE Trans. Knowl. Data Eng..