Formal Specification and Prototyping of Multimedia Applications

Multimedia systems incorporating hyperlinks and user interaction can be prototyped using TAOML, an extension of HTML. TAOML is used to define a Teleaction Object (TAO) which is a multimedia object with associated hypergraph structure and knowledge structure The hypergraph structure supports the effective presentation and efficient communication of multimedia information. In this paper, a formal specification methodology for TAOs using Symbol Relation (SR) grammars is described. An attributed SR grammar is then introduced in order to associate knowledge with the TAO. The limitations to achieve an efficient parser are given. The grammatical formalism allows for validation and verification of the system specification. This methodology provides a principled approach to specify, verify, validate and prototype multimedia applications.

[1]  David Lorge Parnas,et al.  An Invitation to Formal Methods , 1996, Computer.

[2]  Shi-Kuo Chang,et al.  Toward a Theory of Active Index , 1995, J. Vis. Lang. Comput..

[3]  William I. Grosky,et al.  The Handbook of Multimedia Information Management , 1997 .

[4]  Stephen T. C. Wong,et al.  Networked Multimedia for Medical Imaging , 1997, IEEE Multim..

[5]  Louis Weitzman,et al.  Automatic presentation of multimedia documents using relational grammars , 1994, MULTIMEDIA '94.

[6]  Jonathan C. L. Liu,et al.  Controlling the Process with Distributed Multimedia , 1995, IEEE Multim..

[7]  Kent Wittenburg.  Earley-style parsing for relational grammars , 1992, Proceedings IEEE Workshop on Visual Languages.

[8]  Alan Liu,et al.  Knowledge-Based Software Architectures: Acquisition, Specification, and Verification , 1999, IEEE Trans. Knowl. Data Eng..

[9]  Vincenzo Loia,et al.  Active distributed framework for adaptive hypermedia , 1997, Int. J. Hum. Comput. Stud..

[10]  Shi-Kuo Chang.  Extending Visual Languages for Multimedia , 1996, IEEE Multim..

[11]  Franz-Josef Brandenburg,et al.  On Polynomial Time Graph Grammars , 1988, STACS.

[12]  Eric J. Golin,et al.  The specification of visual language syntax , 1990, J. Vis. Lang. Comput..

[13]  Louis Weitzman,et al.  Relational Grammars: Theory and Practice in a Visual Language Interface for Process Modeling , 1996 .

[14]  Wendy Hall,et al.  Multimedia Pedagogues: Interactive Systems for teaching and Learning , 1995, Computer.

[15]  Genny Tortora,et al.  Automatic Generation of Visual Programming Environments , 1995, Computer.

[16]  Arif Ghafoor,et al.  Interval-Based Conceptual Models for Time-Dependent Multimedia Data , 1993, IEEE Trans. Knowl. Data Eng..

[17]  Giorgio Satta,et al.  Symbol-Relation Grammars: A Formalism for Graphical Languages , 1996, Inf. Comput..

[18]  Bing Yu,et al.  Icon Purity - toward a Formal Theory of Icons , 1987, Int. J. Pattern Recognit. Artif. Intell..

[19]  Alfred V. Aho,et al.  Compilers: Principles, Techniques, and Tools , 1986, Addison-Wesley series in computer science / World student series edition.

[20]  Genny Tortora,et al.  A predictive parser for visual languages specified by relation grammars , 1994, Proceedings of 1994 IEEE Symposium on Visual Languages.

[21]  T. Kaneshige.  Waiting for the Telecommunications Act to deliver , 1996 .

[22]  Piero Mussio,et al.  Specification of visual languages as means for interaction , 1998 .

[23]  Kim Marriott,et al.  Towards a hierarchy of visual languages , 1996, Proceedings 1996 IEEE Symposium on Visual Languages.