AUGMENTED TRANSITION NETWORKS AS SEMANTIC MODELS FOR MULTIbAEDIA PRESENTATIONS, MULTIMEDIA DATABASE SEAR.CHING, AND MULTIMEDIA BROWSING

As more information sources become available in multimedia systems, the development of abstract semantic models for video, audio, text, and image data becomes very important. An abstract semantic model has two requirements. First, it should be rich enolugh to provide a friendly interface of multimedia presentation synchronization schedules to tlie users. Second, it should be a good programming data structure for implementation t o control multimedia playback. An abstract semantic model based on an augmented transition network (ATN) is presented. Tlle inputs for ATNs are modeled by multimedia input strings. Multimedia input strings provide an efficient means for iconic indexing of the temporal/spatial relations of media streams and semantic objects. An ATN and its subnetworks are used to represent the appearing sequence of media streams and semantic objects. The arc libel is a substring of a multimedia input string. In this design, a presentation is driven by a ~nultimedia input string. Each subnetwork has its own multimedia input string. Database queries relative to text, image, and video can be answered via substring matching at subnetworks. Subnetworks also can ble some existing multimedia presentations to be embedded in other presentations to make module design possible in a multimedia authoring environment. The conditions are checked to see whether certain criteria are satisfied. If they are, a set of corresponding actions are activated. Multimedia browsing allows users the flexibility to select any part of the presentation they prefer t o see. This means that an ATN and its suklnetworks can be included in a multimedia database system which is controlled by a database management system (DBMS). User interactions and loops are also provided in an ATN. Therefore, ATNs provide three major capabilities: multimedia presentations, temporal/spatial multimedia database searching, and multimedia browsing.

[1]  Katsumi Tanaka,et al.  OVID: Design and Implementation of a Video-Object Database System , 1993, IEEE Trans. Knowl. Data Eng..

[2]  Rangasami L. Kashyap,et al.  Temporal And Spatial Semantic Models For Multimedia Presentations , 1997 .

[3]  Carl K. Chang,et al.  Temporal Relations and Synchronization Agents , 1996, IEEE Multim..

[4]  Tom Minka,et al.  Interactive learning with a "Society of Models" , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  Dragutin Petkovic,et al.  Query by Image and Video Content: The QBIC System , 1995, Computer.

[6]  Gerold Blakowski,et al.  Tools for Specifying and Executing Synchronized Multimedia Presentations , 1991, NOSSDAV.

[7]  Ian E. Smith,et al.  Authoring and Navigating Video in Space and Time , 1997, IEEE Multim..

[8]  Remi Depommier,et al.  Content-based browsing of video sequences , 1994, MULTIMEDIA '94.

[9]  Shu-Ching Chen,et al.  A Distributed Computing Environment for Dynamic Traffic Operations , 1999 .

[10]  Rangasami L. Kashyap,et al.  Empirical studies of multimedia semantic models for multimedia presentations , 1998, Computers and Their Applications.

[11]  Jiawei Han,et al.  Data-Driven Discovery of Quantitative Rules in Relational Databases , 1993, IEEE Trans. Knowl. Data Eng..

[12]  Arif Ghafoor,et al.  Semantic modeling and management of multimedia data , 1996 .

[13]  B. S. Manjunath,et al.  Texture features and learning similarity , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  Michael Mills,et al.  A magnifier tool for video data , 1992, CHI.

[15]  Simone Santini,et al.  In search of information in visual media , 1997, CACM.

[16]  T.S. Huang,et al.  A relevance feedback architecture for content-based multimedia information retrieval systems , 1997, 1997 Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries.

[17]  Jian-Kang Wu.  Content-Based Indexing of Multimedia Databases , 1997, IEEE Trans. Knowl. Data Eng..

[18]  James L. Peterson,et al.  Petri Nets , 1977, CSUR.

[19]  R. Bayer,et al.  Organization and maintenance of large ordered indices , 1970, SIGFIDET '70.

[20]  Minerva M. Yeung,et al.  Efficient matching and clustering of video shots , 1995, Proceedings., International Conference on Image Processing.

[21]  Wolfgang Klas,et al.  /spl delta/-sets for optimized reactive adaptive playout management in distributed multimedia database systems , 1996, Proceedings of the Twelfth International Conference on Data Engineering.

[22]  Arif Ghafoor,et al.  Synchronization and Storage Models for Multimedia Objects , 1990, IEEE J. Sel. Areas Commun..

[23]  Douglas Comer,et al.  Ubiquitous B-Tree , 1979, CSUR.

[24]  Arif Ghafoor,et al.  Object-oriented conceptual modeling of video data , 1995, Proceedings of the Eleventh International Conference on Data Engineering.

[25]  Ronald J. Brachman,et al.  The Process of Knowledge Discovery in Databases , 1996, Advances in Knowledge Discovery and Data Mining.

[26]  Alberto Del Bimbo,et al.  Symbolic Description and Visual Querying of Image Sequences Using Spatio-Temporal Logic , 1995, IEEE Trans. Knowl. Data Eng..

[27]  Arif Ghafoor,et al.  Interval-Based Conceptual Models for Time-Dependent Multimedia Data , 1993, IEEE Trans. Knowl. Data Eng..

[28]  Ahmed Karmouch,et al.  A Temporal Model for Interactive Multimedia Scenarios , 1995, IEEE Multim..

[29]  Philip S. Yu,et al.  Data Mining: An Overview from a Database Perspective , 1996, IEEE Trans. Knowl. Data Eng..

[30]  James F. Allen.  Maintaining knowledge about temporal intervals , 1983, CACM.

[31]  Ahmed Karmouch,et al.  A multimedia news delivery system over an ATM network , 1995, Proceedings of the International Conference on Multimedia Computing and Systems.

[32]  Rosalind W. Picard,et al.  Interactive Learning Using a "Society of Models" , 2017, CVPR 1996.

[33]  S C Kleene,et al.  Representation of Events in Nerve Nets and Finite Automata , 1951 .

[34]  Ramakrishnan Srikant,et al.  The Quest Data Mining System , 1996, KDD.

[35]  C. V. Ramamoorthy,et al.  Knowledge and Data Engineering , 1989, IEEE Trans. Knowl. Data Eng..

[36]  William A. Woods,et al.  Computational Linguistics Transition Network Grammars for Natural Language Analysis , 2022 .

[37]  Shi-Kuo Chang,et al.  An Intelligent Image Database System , 1988, IEEE Trans. Software Eng..

[38]  Thomas S. Huang,et al.  Content-based image retrieval with relevance feedback in MARS , 1997, Proceedings of International Conference on Image Processing.

[39]  Stephen W. Smoliar,et al.  Content based video indexing and retrieval , 1994, IEEE MultiMedia.