Putting the gloss on paper: A framework for cross-media annotation

We present a general framework for cross-media annotation that can be used to support the many different forms and uses of annotation. Specifically, we discuss the need for digital annotation of printed materials and describe how various technologies for digitally augmented paper can be used in support of work practices. The state of the art in terms of both commercial and research solutions is described in some detail, with an analysis of the extent to which they can support both the writing and reading activities associated with annotation. Our framework is based on an extension of the information server that was developed within the Paper++ project to support enhanced reading. It is capable of handling both formal and informal annotation across printed and digital media, exploiting a range of technologies for information capture and display. A prototype demonstrator application for mammography is presented to illustrate both the functionality of the framework and the status of existing technologies.

[1]  Scott E. Hudson,et al.  PaperLink: a technique for hyperlinking from real paper to electronic content , 1997, CHI.

[2]  William Newman,et al.  A desk supporting computer-based interaction with paper documents , 1992, CHI.

[3]  Mayer D. Schwartz,et al.  The Dexter Hypertext Reference Model , 1994, CACM.

[4]  Beat Signer,et al.  Java Framework for Database-Centric Web Engineering , 2001, WWW 2001.

[5]  Jun-Hong Cui,et al.  Websigns: Hyperlinking Physical Locations to the Web , 2001, Computer.

[6]  Catherine C. Marshall,et al.  Annotation: from paper books to the digital library , 1997, DL '97.

[7]  Jun Rekimoto,et al.  CyberCode: designing augmented reality environments with visual tags , 2000, DARE '00.

[8]  Dan Brickley,et al.  Resource Description Framework (RDF) Model and Syntax Specification , 2002 .

[9]  Dzmitry Aliakseyeu,et al.  Physical Paper as the User Interface for an Architectural Design Tool , 2001, INTERACT.

[10]  François Guimbretière,et al.  Paper augmented digital documents , 2003, UIST '03.

[11]  Catherine C. Marshall,et al.  Toward an ecology of hypertext annotation , 1998, HYPERTEXT '98.

[12]  Moira C. Norrie,et al.  An Extended Entity-Relationship Approach to Data Management in Object-Oriented Systems , 1993, ER.

[13]  Carole A. Goble,et al.  Towards Annotation Using DAML+OIL , 2001, Semannot@K-CAP 2001.

[14]  James A. Hendler,et al.  The Semantic Web" in Scientific American , 2001 .

[15]  Beat Signer,et al.  Switching over to paper: a new Web channel , 2003, Proceedings of the Fourth International Conference on Web Information Systems Engineering, 2003. WISE 2003..

[16]  Michael Gertz,et al.  Annotating scientific images: a concept-based approach , 2002, Proceedings 14th International Conference on Scientific and Statistical Database Management.

[17]  Moira C. Norrie,et al.  OMS Java: Lessons Learned from Building a Multi-Tier Object Management Framework , 1999, OOPSLA 1999.

[18]  Roy Want,et al.  Ubiquitous Electronic Tagging , 2000, IEEE Distributed Syst. Online.

[19]  David L. Hecht,et al.  Printed Embedded Data Graphical User Interfaces , 2001, Computer.

[20]  Pierre David Wellner,et al.  Interacting with paper on the DigitalDesk , 1993, CACM.

[21]  Keith Andrews.  Browsing, Building, and Beholding Cyberspace: New Approaches to the Navigation, Construction, and Visualisation of Hypermedia on the Internet , 1996 .

[22]  Michael Gertz,et al.  Integrating Scientific Data through External, Concept-Based Annotations , 2002, EEXTT.

[23]  Marja-Riitta Koivunen,et al.  Annotea: an open RDF infrastructure for shared Web annotations , 2001, WWW '01.

[24]  Alex Voss,et al.  'Repairing' the Machine: A Case Study of the Evaluation of Computer-Aided Detection Tools in Breast Screening , 2003, ECSCW.

[25]  Yoichi Sato,et al.  Integrating paper and digital information on EnhancedDesk: a method for realtime finger tracking on an augmented desk system , 2001, TCHI.

[26]  Kenton O'Hara,et al.  A comparison of reading paper and on-line documents , 1997, CHI.

[27]  Andreas Geyer-Schulz,et al.  Virtual Notes:Annotations on the WWW for Learning Environments , 1999 .

[28]  Hugh C. Davis,et al.  FOHM: a fundamental open hypertext model for investigating interoperability between hypertext domains , 2000, HYPERTEXT '00.

[29]  Christine Reid,et al.  The Myth of the Paperless Office , 2003, J. Documentation.

[30]  Ian Horrocks,et al.  OIL in a Nutshell , 2000, EKAW.

[31]  Steven J. DeRose,et al.  XML linking , 1999, CSUR.

[32]  Kaj Grønbæk,et al.  Designing Dexter-based cooperative hypermedia systems , 1993, HYPERTEXT '93.

[33]  Rob Procter,et al.  Performance Management in Breast Screening: A Case Study of Professional Vision , 2002, Cognition, Technology & Work.