Pen-based acquisition of real world annotations for semantic desktops

We explain our strategy towards a Semantic Desktop and our research and prototype. In this paper we complement these with the paradigm of paper-- scribbling, annotating, revising--, an information interface for knowledge work, which has been well-tried and elaborated over the centuries. Everybody is highly trained for it. The combination can instantly improve the conditions of knowledge work. By removing one more felt barrier, it has the potential to enhance a phenomenon called flow, providing users with efficiency and satisfaction at work. The implementation is built around a pen transmitting its movements and a state-of-the-art handwriting recognition.

[1]  Kenton P. O'Hara,et al.  Understanding the materiality of writing from multiple sources , 2002, Int. J. Hum. Comput. Stud..

[2]  Wendy E. Mackay,et al.  Augmented reality: linking real and virtual worlds: a new paradigm for interacting with computers , 1998, AVI '98.

[3]  Kimiyoshi Machii,et al.  InteractiveDESK: a computer-augmented desk which responds to operations on real objects , 1995, CHI 95 Conference Companion.

[4]  R. H. R. Harper.  Information that Counts: A Sociological View of Information Navigation , 2003, Designing Information Spaces.

[5]  Abigail Sellen,et al.  A comparison of input devices in element pointing and dragging tasks , 1991, CHI.

[6]  Kenton O'Hara,et al.  A diary study of work-related reading: design implications for digital reading devices , 1998, CHI.

[7]  E. L. Waterworth,et al.  Affective Creative Spaces : the interactive tent and the illusion of being , 2001 .

[8]  M. Lamming,et al.  The Design of a Human Memory Prosthesis , 1994 .

[9]  Abigail Sellen,et al.  The myth of the paperless office , 2001 .

[10]  Kenton O'Hara,et al.  Understanding the materiality of writing from multiple sources , 2002, Int. J. Hum. Comput. Stud..

[11]  M. Csíkszentmihályi,et al.  Optimal experience: Psychological studies of flow in consciousness. , 1988 .

[12]  Yoichi Sato,et al.  Integrating paper and digital information on EnhancedDesk: a method for realtime finger tracking on an augmented desk system , 2001, TCHI.

[13]  Wendy E. Mackay,et al.  Ariel: augmenting paper engineering drawings , 1995, CHI 95 Conference Companion.

[14]  Thomas Metzinger,et al.  Motor ontology: the representational reality of goals, actions and selves , 2003 .

[15]  Pierre David Wellner,et al.  Interacting with paper on the DigitalDesk , 1993, CACM.

[16]  Hiroshi Ishii,et al.  The metaDESK: models and prototypes for tangible user interfaces , 1997, UIST '97.

[17]  Abigail Sellen,et al.  Paper as an analytic resource for the design of new technologies , 1997, CHI.

[18]  Abigail Sellen,et al.  Memory Problems at Work: Their Range, Frequency and Severity , 1992 .

[19]  S. Mackenzie,et al.  A comparison of input device in elemental pointing and dragging task , 1991, CHI 1991.

[20]  Kenton O'Hara,et al.  A comparison of reading paper and on-line documents , 1997, CHI.