An approach for video meta-data modeling and query processing

Multimedia databases have been the subject of extensive research for the last several years. In particular, semantic modeling of video data spurred tremendous interest and produced various formalisms for content-based retrieval of video data. In this paper, we propose the use of Hierarchical Petri-nets (HPN's) for multi-level representation of video data with each level consisting of an augmented Petrinet structure. We show how such representation is able to capture video data semantics, from very low level semantics such as scene change and object movements to higher level semantics involving high-level textual description of events. A Petri-net based method for query processing of multi-object spatio-temporal video-data queries is presented.

[1]  David K. Gifford,et al.  Composition and Search with a Video Algebra , 1995, IEEE Multim..

[2]  Shih-Fu Chang,et al.  A fully automated content-based video search engine supporting spatiotemporal queries , 1998, IEEE Trans. Circuits Syst. Video Technol..

[3]  James F. Allen Maintaining knowledge about temporal intervals , 1983, CACM.

[4]  Alberto Del Bimbo,et al.  Symbolic Description and Visual Querying of Image Sequences Using Spatio-Temporal Logic , 1995, IEEE Trans. Knowl. Data Eng..

[5]  Arif Ghafoor,et al.  Interval-Based Conceptual Models for Time-Dependent Multimedia Data , 1993, IEEE Trans. Knowl. Data Eng..

[6]  Forouzan Golshani,et al.  Retrieval and delivery of information in multimedia database systems , 1994, Inf. Softw. Technol..

[7]  Arif Ghafoor,et al.  Synchronization and Storage Models for Multimedia Objects , 1990, IEEE J. Sel. Areas Commun..

[8]  Arif Ghafoor,et al.  Trail-based approach for video data indexing and retrieval , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[9]  Arif Ghafoor,et al.  An object-oriented model for spatio-temporal synchronization of multimedia information , 1994, 1994 Proceedings of IEEE International Conference on Multimedia Computing and Systems.

[10]  Wolfgang Reisig Petri Nets: An Introduction , 1985, EATCS Monographs on Theoretical Computer Science.

[11]  Arif Ghafoor,et al.  Object-oriented conceptual modeling of video data , 1995, Proceedings of the Eleventh International Conference on Data Engineering.

[12]  James L. Peterson,et al.  Petri Nets , 1977, CSUR.

[13]  Mohammad Nabil Modelling and retrieving multimedia data using spatial and temporal information , 1998 .

[14]  Katsumi Tanaka,et al.  OVID: Design and Implementation of a Video-Object Database System , 1993, IEEE Trans. Knowl. Data Eng..

[15]  Richard A. Harshman,et al.  Indexing by Latent Semantic Analysis , 1990, J. Am. Soc. Inf. Sci..