Interactive textbook and interactive Venn diagram: natural and intuitive interfaces on augmented desk system

This paper describes two interface prototypes which we have developed on our augmented desk interface system, EnhancedDesk. The first application is Interactive Textbook, which is aimed at providing an effective learning environment. When a student opens a page which describes experiments or simulations, Interactive Textbook automatically retrieves digital contents from its database and projects them onto the desk. Interactive Textbook also allows the student hands-on ability to interact with the digital contents. The second application is the Interactive Venn Diagram, which is aimed at supporting effective information retrieval. Instead of keywords, the system uses real objects such as books or CDs as keys for retrieval. The system projects a circle around each book; data corresponding the book are then retrieved and projected inside the circle. By moving two or more circles so that the circles intersect each other, the user can compose a Venn diagram interactively on the desk. We also describe the new technologies introduced in EnhancedDesk which enable us to implement these applications.

[1]  Jun Rekimoto,et al.  Matrix: a realtime object identification and registration method for augmented reality , 1998, Proceedings. 3rd Asia Pacific Computer Human Interaction (Cat. No.98EX110).

[2]  Pierre David Wellner,et al.  Interacting with paper on the DigitalDesk , 1993, CACM.

[3]  Joseph A. Paradiso,et al.  PingPongPlus: design of an athletic-tangible interface for computer-supported cooperative play , 1999, CHI '99.

[4]  Anselm Spoerri,et al.  InfoCrystal: A visual tool for information retrieval , 1993, Proceedings Visualization '93.

[5]  J. Underkoff.  Urp : A Luminous-Tangible Workbench for Urban Planning and Design , 1999, CHI 1999.

[6]  Myron W. Krueger,et al.  Artificial reality II , 1991 .

[7]  Alan Dix.  The human interface , 1994 .

[8]  Hideki Koike,et al.  EnhancedDesk: integrating paper documents and digital documents , 1998, Proceedings. 3rd Asia Pacific Computer Human Interaction (Cat. No.98EX110).

[9]  Jun Rekimoto,et al.  HoloWall: interactive digital surfaces , 1998, SIGGRAPH '98.

[10]  Hiroshi Ishii,et al.  Illuminating light: an optical design tool with a luminous-tangible interface , 1998, CHI.

[11]  Matthew Turk,et al.  Moving from GUIs to PUIs , 1998 .

[12]  Hiroshi Ishii,et al.  Bricks: laying the foundations for graspable user interfaces , 1995, CHI '95.

[13]  Wendy E. Mackay,et al.  Augmenting reality: adding computational dimensions to paper , 1993, CACM.

[14]  Kimiyoshi Machii,et al.  Retrieving electronic documents with real-world objects on InteractiveDESK , 1995, UIST '95.

[15]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[16]  Jun Rekimoto,et al.  Augmented surfaces: a spatially continuous work space for hybrid computing environments , 1999, CHI '99.

[17]  Paul A. Beardsley,et al.  Computer Vision for Interactive Computer Graphics , 1998, IEEE Computer Graphics and Applications.

[18]  Anselm Spoerri.  Visual tools for information retrieval , 1993, Proceedings 1993 IEEE Symposium on Visual Languages.

[19]  Scott E. Hudson,et al.  PaperLink: a technique for hyperlinking from real paper to electronic content , 1997, CHI.

[20]  Peter Robinson,et al.  Animated Paper Documents , 1997, HCI.