M4Note: a multimodal tool for multimedia annotations

This work discusses an approach to the problem of annotating multimedia content. Our approach provides annotation as metadata for indexing, retrieval and semantic processing as well as content enrichment. We use an underlying model for structured multimedia descriptions and annotations, allowing the establishment of spatial, temporal and linking relationships. We discuss aspects related with documents and annotations used to guide the design of an application that allows annotations to be made with pen-based interaction with tablet PCs. As a result, a video stream can be annotated at the same time that it is captured. Moreover, the annotation can be edited, extended or played back synchronously afterwards.

[1]  Gregory D. Abowd,et al.  The Family Video Archive: an annotation and browsing environment for home movies , 2003, MIR '03.

[2]  Ravin Balakrishnan,et al.  Fluid interaction techniques for the control and annotation of digital video , 2003, UIST '03.

[3]  Maria da Graça Campos Pimentel,et al.  Automatically sharing web experiences through a hyperdocument recommender system , 2003, HYPERTEXT '03.

[4]  David Bargeron,et al.  Reflowing digital ink annotations , 2003, CHI '03.

[5]  Dit-Yan Yeung,et al.  A simple yet robust structural approach for recognizing on-line handwritten alphanumeric characters , 1998 .

[6]  Beat Signer,et al.  Digital annotation of printed documents , 2003, CIKM '03.

[7]  Gregory D. Abowd,et al.  Charting past, present, and future research in ubiquitous computing , 2000, TCHI.

[8]  Lloyd Rutledge,et al.  Media semantics: who needs it and why? , 2002, MULTIMEDIA '02.

[9]  Maria da Graça Campos Pimentel,et al.  Structuring interactive TV documents , 2003, DocEng '03.

[10]  Dick C. A. Bulterman Using SMIL to encode interactive, peer-level multimedia annotations , 2003, DocEng '03.

[11]  Bill N. Schilit,et al.  XLibris: the active reading machine , 1998, CHI Conference Summary.

[12]  Catherine C. Marshall,et al.  Toward an ecology of hypertext annotation , 1998, HYPERTEXT '98.

[13]  Steven J. DeRose,et al.  Xml linking language (xlink), version 1. 0 , 2000, WWW 2000.

[14]  Hari Sundaram,et al.  Vidya: an experiential annotation system , 2003, ETP '03.

[15]  James H. Aylor,et al.  Computer for the 21st Century , 1999, Computer.