Interactions across the Paper-Digital Divide

Paper has been repeatedly recognised as an important medium for exchanging, editing and managing documents throughout the document life-cycle. Despite their static nature, paper documents still represent one of the preferred way of handling information in different situations, such as on the move or in collaboration. In order to overcome the limitations of paper and exploit the advantages of digital interfaces, new technologies for interactive paper have been introduced in recent years. Technologies such as the Anoto Digital Pen and Paper enable users to access digital information through interactions with printed copies. Links to digital content and services are defined on paper and activated when users interact with the paper sheet by means of a digital pen. Various research projects have investigated how to best enable interactions with digital services through interactive paper interfaces. The developed prototypes showed the potential of the available technologies for bridging the paper-digital divide and how paper and digital documents can be effectively interwoven. However, most of the existing approaches concentrate on enriching paper-digital interactions only, very often forgetting to take into account the process of producing interactive paper documents and the effective management of information across the two interfaces. The current lack of support for generating rich interactive paper documents leads to a separation of paper-digital documents in two detached entities, that can hardly be mapped again as the paper and digital instances of the same document. To further enrich the information exchange across the paper-digital boundary and to support a better management of paper-digital documents, we introduce a set of general concepts and models for supporting a novel information-centric infrastructure for publishing interactive paper documents. Our approach supports the automatic and semi-automatic generation of paper-based links to digital information, by intercepting the publishing process of a digital document and applying document analysis techniques to the underlying document models. Furthermore,

[1]  David L. Hecht,et al.  Printed Embedded Data Graphical User Interfaces , 2001, Computer.

[2]  Beat Signer,et al.  PaperPoint: a paper-based presentation and interactive paper prototyping tool , 2007, Tangible and Embedded Interaction.

[3]  Jean-Luc Bloechle,et al.  XCDF: A Canonical and Structured Document Format , 2006, Document Analysis Systems.

[4]  David F. Brailsford,et al.  Towards structured, block-based PDF , 1995 .

[5]  Pierre David Wellner,et al.  Interacting with paper on the DigitalDesk , 1993, CACM.

[6]  Richard Furuta Concepts and models for structured documents , 1989 .

[7]  Dov Dori,et al.  The representation of document structure: a generic object-process analysis , 1995 .

[8]  Monica Frisoni PaperRef: a PDF-based Interactive Reference System , 2007 .

[9]  Edward Lank,et al.  PocketPad: Using Handhelds and Digital Pens to Manage Data in Mobile Contexts , 2007, First International Conference on the Digital Society (ICDS'07).

[10]  Beat Signer,et al.  iGesture: A Java framework for the development and deployment of stoke-based online Gesture recognition algorithms , 2011 .

[11]  Naohiro Furukawa,et al.  iJITinOffice: Desktop Environment Enabling Integration of Paper and Electronic Documents , 2006 .

[12]  Moira C. Norrie,et al.  An Extended Entity-Relationship Approach to Data Management in Object-Oriented Systems , 1993, ER.

[13]  Bruno Lowagie iText in Action: Creating and Manipulating PDF , 2006 .

[14]  Naohiro Furukawa,et al.  iJITinLab : Information Handling Environment Enabling Integration of Paper and Electronic Documents , 2006 .

[15]  Nadir Weibel,et al.  Putting Location-Based Services on the Map , 2006, W2GIS.

[16]  Moira C. Norrie,et al.  An Infrastructure for Reactive Information Environments , 2005, WISE.

[17]  Richard J. Anderson,et al.  PaperCP: Exploring the Integration of Physical and Digital Affordances for Active Learning , 2007, INTERACT.

[18]  François Guimbretière,et al.  Paper augmented digital documents , 2003, UIST '03.

[19]  Nadir Weibel,et al.  Paperproof: a paper-digital proof-editing system , 2008, CHI Extended Abstracts.

[20]  Hagen Klauk,et al.  Organic electronics : materials, manufacturing and applications , 2006 .

[21]  M.C. Norrie,et al.  A Framework for Developing Pervasive Cross-Media Applications based on Physical Hypermedia and Active Components , 2008, 2008 Third International Conference on Pervasive Computing and Applications.

[22]  Ana Arias Terry,et al.  Electronic ink technologies: showing the way to a brighter future , 2001 .

[23]  Volkmar Pipek,et al.  Premote: a user customizable remote control , 2008, CHI Extended Abstracts.

[24]  Claudia-Lavinia Ignat,et al.  Draw-together: graphical editor for collaborative drawing , 2006, CSCW '06.

[25]  Scott R. Klemmer,et al.  Iterative design and evaluation of an event architecture for pen-and-paper interfaces , 2008, UIST '08.

[26]  Dave Levin,et al.  ProofRite: A Paper-Augmented Word Processor , 2004 .

[27]  Vannevar Bush,et al.  As we may think , 1945, INTR.

[28]  Moira C. Norrie The Link between Paper and Information Systems , 2008, ICEIS.

[29]  Roman Schmidt,et al.  The P-Grid System-Overview , 2007 .

[30]  Warren Teitelman,et al.  A Tour Through Cedar , 1984, IEEE Transactions on Software Engineering.

[31]  Michael Grossniklaus,et al.  An Object-Oriented Version Model for Context-Aware Data Management , 2007, WISE.

[32]  M. Grossniklaus,et al.  Producing Interactive Paper Documents Based on Multi-Channel Content Publishing , 2007, Third International Conference on Automated Production of Cross Media Content for Multi-Channel Distribution (AXMEDIS'07).

[33]  Beat Signer,et al.  A Framework for Cross-Media Information Management , 2005, EuroIMSA.

[34]  Richard Furuta Important Papers in the History of Document Preparation Systems: Basic Sources , 1992, Electron. Publ..

[35]  Scott R. Klemmer,et al.  Two worlds apart: bridging the gap between physical and virtual media for distributed design collaboration , 2003, CHI '03.

[36]  David F. Brailsford,et al.  Enhancing composite digital documents using XML-based standoff markup , 2005, DocEng '05.

[37]  Catherine C. Marshall,et al.  Annotation: from paper books to the digital library , 1997, DL '97.

[38]  Nadir Weibel,et al.  Context-aware platform for mobile data management , 2007, Wirel. Networks.

[39]  Catherine C. Marshall,et al.  Toward an ecology of hypertext annotation , 1998, HYPERTEXT '98.

[40]  Hod Lipson,et al.  ModelCraft: capturing freehand annotations and edits on physical 3D models , 2006, UIST.

[41]  Beat Signer,et al.  Information server for highly-connected cross-media publishing , 2005, Inf. Syst..

[42]  David F. Brailsford,et al.  Extracting reusable document components for variable data printing , 2007, DocEng '07.

[43]  Chunyuan Liao,et al.  Pen-top feedback for paper-based interfaces , 2006, UIST.

[44]  Gerd Hoff,et al.  Finding scientific papers with homepagesearch and MOPS , 2001, SIGDOC '01.

[45]  Jamie McKenzie,et al.  Libraries of the Future , 1996 .

[46]  Laurent Denoue,et al.  Moving markup: repositioning freeform annotations , 2002, UIST '02.

[47]  Scott R. Klemmer,et al.  Iterative Design of a Paper + Digital Toolkit: Supporting Designing, Developing, and Debugging , 2007 .

[48]  Beat Signer,et al.  The Lost Cosmonaut: An Interactive Narrative Environment on the Basis of Digitally Enhanced Paper , 2005, International Conference on Virtual Storytelling.

[49]  Gérald Oster Réplication optimiste et cohérence des données dans les environnements collaboratifs répartis. (Optimistic replication and consitency maintenance in distributed collaborative environments) , 2005 .

[50]  Claudia-Lavinia Ignat,et al.  CoDoc: Multi-mode Collaboration over Documents , 2004, CAiSE.

[51]  Brian Keith Reid,et al.  Scribe: a document specification language and its compiler , 1981 .

[52]  Scott R. Klemmer,et al.  Interactive Gigapixel Prints : Large , Paper-Based Interfaces for Visual Context and Collaboration , 2006 .

[53]  Alan C. Shaw,et al.  The structure of abstract document objects , 1984, COCS '84.

[54]  Nadir Weibel,et al.  A model for mapping between printed and digital document instances , 2007, DocEng '07.

[55]  Ron Sacks-Davis,et al.  Database Systems for Structured Documents , 1995, IEICE Trans. Inf. Syst..

[56]  Christine Reid,et al.  The Myth of the Paperless Office , 2003, J. Documentation.

[57]  Kathy Ryall,et al.  DiamondTouch SDK:Support for Multi-User, Multi-Touch Applications , 2002 .

[58]  Beat Signer,et al.  Digital annotation of printed documents , 2003, CIKM '03.

[59]  Nadir Weibel,et al.  Print-n-link: weaving the paper web , 2006, DocEng '06.

[60]  Carl Gutwin,et al.  VoodooSketch: extending interactive surfaces with adaptable interface palettes , 2008, Tangible and Embedded Interaction.

[61]  Darren Leigh,et al.  DiamondTouch: a multi-user touch technology , 2001, UIST '01.

[62]  Beat Signer,et al.  PowerPoint Multimedia Presentations in Computer Science Education: What Do Users Need? , 2008, USAB.

[63]  K. Lauche SHARED DESIGN SPACE , 2002 .

[64]  Jian Fan,et al.  Layout and Content Extraction for PDF Documents , 2004, Document Analysis Systems.

[65]  David G. Stork,et al.  Is paperless really more? , 2000, CACM.

[66]  David F. Brailsford,et al.  Encapsulating and manipulating component object graphics (COGs) using SVG , 2005, DocEng '05.

[67]  Naohiro Furukawa,et al.  Data model and architecture of a paper-digital document management system , 2007, DocEng '07.

[68]  Moira C. Norrie,et al.  Information concepts for content management , 2002, Proceedings of the Third International Conference on Web Information Systems Engineering (Workshops), 2002..

[69]  Beat Signer,et al.  Interactive Paper as a Mobile Client for a Multi-channel Web Information System , 2007, World Wide Web.

[70]  Beat Signer,et al.  iGesture: A General Gesture Recognition Framework , 2007, Ninth International Conference on Document Analysis and Recognition (ICDAR 2007).

[71]  Les Carr,et al.  Dynamic Link Inclusion in Online PDF Journals , 1998, EP.

[72]  David F. Brailsford,et al.  Creating reusable well-structured PDF as a sequence of component object graphic (COG) elements , 2003, DocEng '03.

[73]  Claudia-Lavinia Ignat,et al.  Maintaining consistency in collaboration over hierarchical documents , 2006 .

[74]  James D. Hollan,et al.  Papiercraft: A gesture-based command system for interactive paper , 2008, TCHI.

[75]  Karl Aberer,et al.  P-Grid: a self-organizing structured P2P system , 2003, SGMD.

[76]  Beat Signer,et al.  Experimental platform for mobile information systems , 2005, MobiCom '05.

[77]  Charles C. Mann,et al.  Electronic Paper Turns the Page. , 2001 .

[78]  Beat Signer,et al.  Fundamental concepts for interactive paper and cross-media information spaces , 2017 .

[79]  John E. Warnock,et al.  A device independent graphics imaging model for use with raster devices , 1982, SIGGRAPH.

[80]  M. Bång,et al.  Paper – Based Medical Ubiquitous Computing , 2003 .

[81]  Matthew R. B. Hardy The Mars project: PDF in XML , 2007, DocEng '07.

[82]  Philip R. Cohen,et al.  Tangible multimodal interfaces for safety-critical applications , 2004, CACM.

[83]  Max Mühlhäuser,et al.  Digital paper bookmarks: collaborative structuring, indexing and tagging of paper documents , 2008, CHI Extended Abstracts.

[84]  Jean-Luc Meunier,et al.  Structuring documents according to their table of contents , 2005, DocEng '05.

[85]  Mark W. Newman,et al.  A Tangible Evolution: System Architecture and Participatory Design , 2000 .

[86]  Nadir Weibel,et al.  Interactive Paper as a Reading Medium in Digital Libraries , 2008, ECDL.

[87]  Arno J. H. M. Peels,et al.  Document architecture and text formatting , 1985, TOIS.

[88]  Warren Teitelman,et al.  The cedar programming environment: a midterm report and examination , 1984 .

[89]  Beat Signer,et al.  As We May Link: A General Metamodel for Hypermedia Systems , 2007, ER.

[90]  Itiro Siio,et al.  Real-world interaction using the FieldMouse , 1999, UIST '99.

[91]  C. F. Goldfarb,et al.  A generalized approach to document markup , 1981, SIGPLAN SIGOA Symposium on Text Manipulation.

[92]  Vincent Quint,et al.  Interactively Editing Structured Documents , 1989, Electron. Publ..