Virtual Notepad: handwriting in immersive VR

We present Virtual Notepad, a collection of interface tools that allows the user to take notes, annotate documents and input text using a pen, while still immersed in virtual environments (VEs). Using a spatially-tracked, pressure-sensitive graphics tablet, pen and handwriting recognition software, Virtual Notepad explores handwriting as a new modality for interaction in immersive VEs. This paper reports details of the Virtual Notepad interface and interaction techniques, discusses implementation and design issues, reports the results of initial evaluation and overviews possible applications of virtual handwriting.

[1]  Dimitre Novatchev,et al.  Chunking and Phrasing and the Design of Human-Computer Dialogues - Response , 1986, IFIP Congress.

[2]  J. David Bolter,et al.  Virtual Annotation: Verbal Communication in Virtual Reality , 1993 .

[3]  Pierre David Wellner,et al.  Interacting with paper on the DigitalDesk , 1993, CACM.

[4]  Ken Hinckley,et al.  Passive real-world interface props for neurosurgical visualization , 1994, International Conference on Human Factors in Computing Systems.

[5]  Thomas P. Moran,et al.  Tivoli: an electronic whiteboard for informal workgroup meetings , 1993, INTERCHI.

[6]  Thomas C. Meyer,et al.  Integrating perceptual and symbolic information in VR , 1995, IEEE Computer Graphics and Applications.

[7]  Rory Stuart,et al.  Design of Virtual Environments , 2001 .

[8]  Jakob Nielsen,et al.  The Anti-Mac interface , 1996, CACM.

[9]  Henry Sowizral,et al.  VRMosaic: Web access from within a virtual environment , 1996, IEEE Computer Graphics and Applications.

[10]  William Ribarsky,et al.  The virtual annotation system , 1996, Proceedings of the IEEE 1996 Virtual Reality Annual International Symposium.

[11]  M Billinghurst,et al.  New interface metaphors for complex information space visualization: an ECG monitor object prototype. , 1997, Studies in health technology and informatics.

[12]  Frederick P. Brooks,et al.  Moving objects in space: exploiting proprioception in virtual-environment interaction , 1997, SIGGRAPH.

[13]  S. Weghorst,et al.  Virtual reality and tactile augmentation in the treatment of spider phobia: a case report. , 1997, Behaviour research and therapy.

[14]  Mark Billinghurst,et al.  3D palette: a virtual reality content creation tool , 1997, VRST '97.

[15]  Michael Gervautz,et al.  The Personal Interaction Panel – a Two‐Handed Interface for Augmented Reality , 1997, Comput. Graph. Forum.

[16]  Bill N. Schilit,et al.  Dynomite: a dynamically organized ink and audio notebook , 1998 .