Embedded video in hypermedia documents: supporting integration and adaptive control

As the availability of digital video becomes commonplace, a shift in application focus will occur from merely accessing video as an independent data stream to embedding video with other multimedia data types into coordinated hypermedia presentations. The migration to embedded video will present new demands on application and support environments: processing of any one piece of video data will depend on how that data relates to other data streams active within the same presentation. This article describes presentation, synchronization, and interaction control issues for manipulating embedded video. First we describe the requirements for embedded video, contrasted against other forms of video use. Next we consider mechanisms for describing and implementing the behavior of embedded-video segments relative to other data items in a document; these relationships form the basis of implementing cooperative control among the events in a presentation. Finally we consider extending the possibilities for tailoring embedded video to the characteristics of the local runtime environment; this forms the basis for adaptive, application-level quality-of-service control of a presentation. In all cases, we describe a mechanism to externalize the behavior of hypermedia presentations containing resource-intensive data requirements so that effective control can be implemented by low-level system facilities based on application-specific requirements. We present our results in terms of the CMIFed authoring/presentation system.

[1]  Robert T. Braden,et al.  Background File Transfer Program (BFTP) , 1988, RFC.

[2]  Eve M. Schooler,et al.  A Distributed Architecture for Multimedia Conference Control , 1991 .

[3]  Jon Postel,et al.  Media Type Registration Procedure , 1994, RFC.

[4]  Harrick M. Vin,et al.  Software architecture of DiCE: a distributed collaboration environment , 1992, CCRV.

[5]  David L. Mills Network Time Protocol (version 2) specification and implementation , 1989, RFC.

[6]  Steven K. Feiner,et al.  Automating the generation of coordinated multimedia explanations , 1991, Computer.

[7]  Robert W. Root,et al.  Design of a multi-media vehicle for social browsing , 1988, CSCW '88.

[8]  Eve M. Schooler,et al.  Schooler Case Study : Multimedia Conference Control in a Packet − switched Teleconferencing System , 1993 .

[9]  Dick C. A. Bulterman,et al.  CMIFed: a presentation environment for portable hypermedia documents , 1993, MULTIMEDIA '93.

[10]  Mayer D. Schwartz,et al.  The Dexter Hypertext Reference Model , 1994, CACM.

[11]  Dick C. A. Bulterman,et al.  The Amsterdam hypermedia model: adding time and context to the Dexter model , 1994, CACM.

[12]  F. Gong,et al.  Multipoint audio and video control for packet-based multimedia conferencing , 1994, MULTIMEDIA '94.

[13]  Keith A. Lantz,et al.  Collaboration awareness in support of collaboration transparency: requirements for the next generation of shared window systems , 1990, CHI '90.

[14]  Craig Partridge,et al.  A Proposed Flow Specification , 1992, RFC.

[15]  Dick C. A. Bulterman,et al.  Multimedia Authoring Tools: State of the Art and Research Challenges , 1995, Computer Science Today.

[16]  David Clark,et al.  Supporting Real-Time Applications in an Integrated Services Packet Network: Architecture and Mechanism , 1992, SIGCOMM.

[17]  Andrew S. Tanenbaum,et al.  A Critique of the Remote Procedure Call Paradigm , 1988 .

[18]  Steven R. Newcomb,et al.  The “HyTime ”: hypermedia/time-based document structuring language , 1991, CACM.

[19]  Sudhir R. Ahuja,et al.  The rapport multimedia conferencing system , 1988 .

[20]  Thomas Rist,et al.  From Presentation Tasks to Pictures: Towards a Computational Approach to Graphics Design , 1992, ECAI.

[21]  Stavros Christodoulakis,et al.  Principles of delay-sensitive multimedia data storage retrieval , 1992, TOIS.

[22]  William E. Hefley,et al.  Intelligent Multimedia Presentation Systems: Research and Principles , 1991, AAAI Workshop on Intelligent Multimedia Interfaces.

[23]  Stephen E. Deering,et al.  Host extensions for IP multicasting , 1986, RFC.

[24]  Philip S. Yu Mon-Song Chen, Dilip D. Kandlur: Design and Analysis of a Grouped Sweeping Scheme for Multimedia Storage Management , 1992, NOSSDAV.

[25]  D.R. Cheriton,et al.  VMTP as the transport layer for high-performance distributed systems , 1989, IEEE Communications Magazine.

[26]  Don Brutzman,et al.  MBONE, the Multicast BackbONE , 1994 .

[27]  Jon Postel,et al.  User Datagram Protocol , 1980, RFC.

[28]  Dick C. A. Bulterman,et al.  A Structure for Transportable, Dynamic Multimedia Documents , 1991, USENIX Summer.

[29]  Gunnar Liestøl,et al.  Aesthetic and rhetorical aspects of linking video in hypermedia , 1994, ECHT '94.

[30]  P. Venkat Rangan,et al.  Multimedia conferencing in the Etherphone environment , 1991, Computer.

[31]  Hans Eriksson,et al.  MBONE: the multicast backbone , 1994, CACM.

[32]  Guido van Rossum An Introduction to Python for UNIX/C Programmers , 1993 .

[33]  Robert T. Braden,et al.  Requirements for Internet Hosts - Communication Layers , 1989, RFC.

[34]  C. Patridge,et al.  Flow synchronization protocol , 1992, [Conference Record] GLOBECOM '92 - Communications for Global Users: IEEE.

[35]  J.J. Garcia-Luna-Aceves,et al.  An open-systems model for computer-supported collaboration , 1988, [1988] Proceedings. 2nd IEEE Conference on Computer Workstations.

[36]  Michael R. Macedonia,et al.  MBone provides audio and video across the Internet , 1994, Computer.

[37]  Donald F. Towsley,et al.  Providing VCR capabilities in large-scale video servers , 1994, MULTIMEDIA '94.

[38]  Ralf Steinmetz Analyzing The Multimedia Operating System , 1995, IEEE Multim..

[39]  Thomas Kirste,et al.  Time-varying sensitive regions in dynamic multimedia objects: a pragmatic approach to content-based retrieval from video , 1994, Inf. Softw. Technol..

[40]  Wolfgang Effelsberg,et al.  MHEG Explained , 1995, IEEE Multim..

[41]  David R. Cheriton VMTP: Versatile Message Transaction Protocol: Protocol specification , 1988, RFC.

[42]  Dick C. A. Bulterman,et al.  Links in hypermedia: the requirement for context , 1993, Hypertext.

[43]  Thomas D. C. Little,et al.  A digital on-demand video service supporting content-based queries , 1993, MULTIMEDIA '93.

[44]  Eve M. Schooler,et al.  An architecture for multimedia connection management , 1992, CCRV.

[45]  Harrick M. Vin,et al.  A statistical admission control algorithm for multimedia servers , 1994, MULTIMEDIA '94.

[46]  T. J. Baumgartner,et al.  A Software Architecture for Workstations Supporting Multimedia Conferencing in Packet Switching Networks , 1990, IEEE J. Sel. Areas Commun..

[47]  Eve M. Schooler,et al.  The impact of scaling on a multimedia connection architecture , 1992, Multimedia Systems.

[48]  Robert Fish,et al.  Touring Machine: A Software Platform for Distributed Multimedia Applications , 1992, ULPAA.

[49]  Karen Seo,et al.  N-Way Conferencing with Packet Video , 1990 .

[50]  Stephen E. Deering,et al.  First IETF internet audiocast , 1992, CCRV.

[51]  V. Jacobson,et al.  Congestion avoidance and control , 1988, CCRV.

[52]  André Schiper,et al.  Lightweight causal and atomic group multicast , 1991, TOCS.

[53]  Cosmos Andrea Nicolaou,et al.  An Architecture for Real-Time Multimedia Communication Systems , 1990, IEEE J. Sel. Areas Commun..

[54]  Gene Miller,et al.  News on-demand for multimedia networks , 1993, MULTIMEDIA '93.