Representation-based user interfaces for the audiovisual library of the year 2000

The audiovisual library of the future will be based on computerized access to digitized documents. In this communication, we address the user interface issues which will arise from this new situation. One cannot simply transfer a user interface designed for the piece by piece production of some audiovisual presentation and make it a tool for accessing full-length movies in an electronic library. One cannot take a digital sound editing tool and propose it as a means to listen to a musical recording. In our opinion, when computers are used as mediations to existing contents, document representation-based user interfaces are needed. With such user interfaces, a structured visual representation of the document contents is presented to the user, who can then manipulate it to control perception and analysis of these contents. In order to build such manipulable visual representations of audiovisual documents, one needs to automatically extract structural information from the documents contents. In this communication, we describe possible visual interfaces for various temporal media, and we propose methods for the economically feasible large scale processing of documents. The work presented is sponsored by the Bibliotheque Nationale de France: it is part of the program aiming at developing for image and sound documents an experimental counterpart to the digitized text reading workstation of this library.

[1]  Yoshinobu Tonomura,et al.  Video tomography: an efficient method for camerawork extraction and motion analysis , 1994, MULTIMEDIA '94.

[2]  Yoshinobu Tonomura,et al.  Video handling based on structured information for hypermedia systems , 1991 .

[3]  Régine André-Obrecht,et al.  A new statistical approach for the automatic segmentation of continuous speech signals , 1988, IEEE Trans. Acoust. Speech Signal Process..

[4]  Hideo Hashimoto,et al.  Video indexing using motion vectors , 1992, Other Conferences.

[5]  Takafumi Miyatake,et al.  IMPACT: an interactive natural-motion-picture dedicated multimedia authoring system , 1991, CHI.

[6]  Eric Harslem,et al.  Designing the STAR User Interface , 1987, ECICS.

[7]  Philippe Aigrain,et al.  The automatic real-time analysis of film editing and transition effects and its applications , 1994, Comput. Graph..

[8]  Mark S. Ackerman,et al.  A construction set for multimedia applications , 1989, IEEE Software.

[9]  Wendy E. Mackay,et al.  Virtual video editing in interactive multimedia applications , 1989, CACM.

[10]  Steven M. Drucker,et al.  Intermedia: the concept and the construction of a seamless information environment , 1988, Computer.

[11]  Stephen Graham,et al.  Browsing within time-driven multimedia documents , 1988, COCS '88.

[12]  Alan P. Parkes,et al.  Manipulable inter-medium encodings for information retrieval , 1991, RIAO.

[13]  Philippe Joly,et al.  Efficient automatic analysis of camera work and microsegmentation of video using spatiotemporal images , 1996, Signal Process. Image Commun..

[14]  Yihong Gong,et al.  Automatic parsing of news video , 1994, 1994 Proceedings of IEEE International Conference on Multimedia Computing and Systems.

[15]  R. Jackendoff,et al.  A Generative Theory of Tonal Music , 1985 .

[16]  E MackayWendy,et al.  Virtual video editing in interactive multimedia applications , 1989 .

[17]  S. Handel,et al.  Listening: An Introduction to the Perception of Auditory Events , 1993 .