A model and environment for improving multimedia scholarly reading practices

The evolution of multimedia document production and diffusion technologies has lead to a significant spread of knowledge in form of pictures and recordings. However, scholarly reading tasks are still principally performed on textual contents. We argue that this is due to a lack of critical and structured tools: (1) to handle the wide spectrum of interpretive operations involved by the polymorphous scholarly reading process; (2) to perform these operations on a heterogeneous multimedia corpus. This firstly calls for identifying fundamental document requirements for such reading practices. Then, we present a flexible model and a software environment which enable the reader to structure, annotate, link, fragment, compare, freely organise and spatially lay out documents, and to prepare the writing of their critical comment. We eventually discuss experiments with humanities scholars, and explore new academic reading practices which take advantage of document engineering principles such as multimedia document structuring, publication or sharing.

[1]  Lloyd Rutledge,et al.  Do you have the time? Composition and linking in time-based hypermedia , 1999, Hypertext.

[2]  Jonathan Goldman,et al.  Charting the Score in a Multimedia Context: The Case of Paradigmatic Analysis , 2008 .

[3]  Frank M. Shipman,et al.  Spatial hypertext: designing for change , 1995, CACM.

[4]  Pierre Morizet-Mahoudeaux,et al.  Modèle et outils documentaires multimédias pour la mise en tableau de partitions. Segmenter et restructurer, le cas de l'analyse paradigmatique , 2008, Document Numérique.

[5]  Pierre Morizet-Mahoudeaux,et al.  Indexing and Mining Audiovisual Data , 2003, Active Mining.

[6]  Jean-Marie Pinon,et al.  Online ancient documents: Armarius , 2008, DocEng '08.

[7]  Mina Akaishi,et al.  Interaction design for scholarly writing: Hypertext representations as a means for creative knowledge work , 2005, New Rev. Hypermedia Multim..

[8]  Stefano Levialdi,et al.  MADCOW: a multimedia digital annotation system , 2004, AVI.

[9]  Fabio Ciravegna,et al.  Requirements for multimedia document enrichment , 2006, WWW '06.

[10]  Dominique Fober,et al.  Annotation de partitions musicales dynamiques , 2007 .

[11]  Sylvain Auroux,et al.  La révolution technologique de la grammatisation. Introduction à l'histoire des sciences du langage, , 1994 .

[12]  Nicole Vincent,et al.  Document image analysis for active reading , 2007, SADPI.

[13]  Vannevar Bush,et al.  As we may think , 1945, INTR.

[14]  Dick C. A. Bulterman Using SMIL to encode interactive, peer-level multimedia annotations , 2003, DocEng '03.

[15]  Michael Kipp,et al.  ANVIL - a generic annotation tool for multimodal dialogue , 2001, INTERSPEECH.

[16]  George Buchanan,et al.  Spatial Hypertext as a Reader Tool in Digital Libraries , 2002, Visual Interfaces to Digital Libraries.

[17]  Debby Hindus,et al.  Capturing, structuring, and representing ubiquitous audio , 1993, TOIS.

[18]  Yannick Prié,et al.  Advene: active reading through hypervideo , 2005, HYPERTEXT '05.

[19]  Cécile Roisin,et al.  An export architecture for a multimedia authoring environment , 2008, DocEng '08.

[20]  Yasuhiro Yamamoto,et al.  What is the space for?: the role of space in authoring hypertext representations , 2005, HYPERTEXT '05.

[21]  J. Goody The Domestication of the Savage Mind , 1982 .

[22]  David Orchard,et al.  XML Linking Language (XLink) , 2001 .

[23]  Bruce Ingraham Scholarly Rhetoric in Digital Media (or: Now that we have the technology, what do we do with it?) , 2000 .