A topological-directional model for the spatio-temporal composition of video objects

A key characteristic of video data is their associated spatial and temporal semantics. It is therefore important that a video model, does not only model the characteristics of objects but also their relationships in time and space. In view of this, the purpose of our work is to design a model for the specification of the spatio-temporal relationships among objects in video sequences. The model does not only describe the spatial relationships among objects for each frame in a given video scene, but also the temporal relations of the spatial relationships for each frame in terms of the relations between two temporal intervals. Subsequently it models the temporal composition of an object, which reflects the evolution of object spatial relationships over the subsequent frames in the video segment, as well as in the whole video sequence. In addition to the spatio-temporal relationships our model also provides an effective and expressive way for the complete and precise representation of distances among objects in digital video. This model is a basis for the annotation of raw video.

[1]  James F. Allen.  Maintaining knowledge about temporal intervals , 1983, CACM.

[2]  Arif Ghafoor,et al.  Synchronization and Storage Models for Multimedia Objects , 1990, IEEE J. Sel. Areas Commun..

[3]  Erland Jungert.  The Observer's Point of View: An Extension of Symbolic Projections , 1992, Spatio-Temporal Reasoning.

[4]  Arif Ghafoor,et al.  Interval-Based Conceptual Models for Time-Dependent Multimedia Data , 1993, IEEE Trans. Knowl. Data Eng..

[5]  Alberto Del Bimbo,et al.  A Three-Dimensional Iconic Environment for Image Database Querying , 1993, IEEE Trans. Software Eng..

[6]  Andrew Laursen,et al.  Oracle media server: providing consumer based interactive access to multimedia data , 1994, SIGMOD '94.

[7]  Arie Segev,et al.  A consensus glossary of temporal database concepts , 1994, SIGMOD 1994.

[8]  Michalis Vazirgiannis,et al.  Integrated multimedia object and application modelling based on events and scenarios , 1995, Proceedings. International Workshop on Multi-Media Database Management Systems.

[9]  Alberto Del Bimbo,et al.  Symbolic Description and Visual Querying of Image Sequences Using Spatio-Temporal Logic , 1995, IEEE Trans. Knowl. Data Eng..

[10]  Rangachar Kasturi,et al.  Machine vision , 1995 .

[11]  Arif Ghafoor,et al.  Object-oriented conceptual modeling of video data , 1995, Proceedings of the Eleventh International Conference on Data Engineering.

[12]  TheodoridisYannis,et al.  Topological relations in the world of minimum bounding rectangles , 1995 .

[13]  Shahram Ghandeharizadeh,et al.  Stream-based Versus Structured Video Objects: Issues, Solutions, and Challenges , 1996, Multimedia Database System: Issues and Research Direction.

[14]  Thomas D. C. Little,et al.  A Survey of Technologies for Parsing and Indexing Digital Video1 , 1996, J. Vis. Commun. Image Represent..

[15]  Timos K. Sellis,et al.  Spatio-temporal composition in multimedia applications , 1996, Proceedings International Workshop on Multimedia Software Development.

[16]  Elisa Bertino,et al.  Temporal Synchronization Models for Multimedia Data , 1998, IEEE Trans. Knowl. Data Eng..