Boom chameleon: simultaneous capture of 3D viewpoint, voice and gesture annotations on a spatially-aware display

We introduce the Boom Chameleon, a novel input/output device consisting primarily of a flat panel display mounted on a mechanical boom that is tracked in 3D space. The display acts as a physical window into 3D virtual environments in which a direct one-to-one spatial mapping between real and virtual space is preserved. The Boom Chameleon is augmented with a touch screen overlaid on the display and a microphone/speaker combination. We present a 3D-annotation application that exploits these unique characteristics in order to simultaneously capture viewpoint, voice and gesture information. We discuss design issues and present results of an informal user study on the device and annotation application. Our results show that our Boom Chameleon system has the potential to be an effective, easy to learn and operate 3D design review system.

[1]  Richard A. Bolt,et al.  “Put-that-there”: Voice and gesture at the graphics interface , 1980, SIGGRAPH '80.

[2]  Robert E. Kraut,et al.  Expressive richness: a comparison of speech and text as media for revision , 1991, CHI.

[3]  William Buxton,et al.  A marking based interface for collaborative writing , 1993, UIST '93.

[4]  George W. Fitzmaurice,et al.  Situated information spaces and spatially aware palmtop computers , 1993, CACM.

[5]  Shumin Zhai,et al.  Virtual reality for palmtop computers , 1993, TOIS.

[6]  John F. Hughes,et al.  An annotation system for 3D fluid flow visualization , 1994, Proceedings Visualization '94.

[7]  K. Weber,et al.  Marquee: a tool for real-time video logging , 1994, CHI '94.

[8]  S. Whittaker,et al.  Filochat: handwritten notes provide access to recorded conversations , 1994, CHI Conference Companion.

[9]  Owen Daly-Jones,et al.  Voicefax: a shared workspace for voicemail partners , 1995, CHI '95.

[10]  Thomas P. Moran,et al.  Tivoli: an electronic whiteboard for informal workgroup meetings , 1993, INTERCHI.

[11]  Randy Pausch,et al.  Virtual reality on a WIM: interactive worlds in miniature , 1995, CHI '95.

[12]  Katashi Nagao,et al.  The world through the computer: computer augmented interaction with real world environments , 1995, UIST '95.

[13]  Stephen R. Levine,et al.  The Freestyle system: a design perspective , 1995 .

[14]  Scott L. Minneman,et al.  Evolutionary engagement in an ongoing collaborative work process: a case study , 1996, CSCW '96.

[15]  William Ribarsky,et al.  The virtual annotation system , 1996, Proceedings of the IEEE 1996 Virtual Reality Annual International Symposium.

[16]  Bill N. Schilit,et al.  Dynomite: a dynamically organized ink and audio notebook , 1997, CHI.

[17]  Catherine C. Marshall,et al.  Annotation: from paper books to the digital library , 1997, DL '97.

[18]  Hiroshi Ishii,et al.  Design of spatially aware graspable displays , 1997, CHI Extended Abstracts.

[19]  Kenton O'Hara,et al.  A comparison of reading paper and on-line documents , 1997, CHI.

[20]  Joseph J. LaViola,et al.  Collaborative Conceptual Modeling Using the SKETCH Framework , 1998 .

[21]  Ivan Poupyrev,et al.  Virtual Notepad: handwriting in immersive VR , 1998, Proceedings. IEEE 1998 Virtual Reality Annual International Symposium (Cat. No.98CB36180).

[22]  Bill N. Schilit,et al.  Dynomite: a dynamically organized ink and audio notebook , 1998 .

[23]  Dieter Schmalstieg,et al.  Using transparent props for interaction with the virtual table , 1999, SI3D.

[24]  Sharon L. Oviatt,et al.  Multimodal Interaction for 2D and 3D Environments , 1999, IEEE Computer Graphics and Applications.

[25]  Julia Hirschberg,et al.  Jotmail: a voicemail interface that enables you to see what was said , 2000, CHI.

[26]  R. Lienhart.  A system for effortless content annotation to unfold the semantics in videos , 2000, 2000 Proceedings Workshop on Content-based Access of Image and Video Libraries.

[27]  George W. Fitzmaurice,et al.  User Interfaces for Volumetric Displays , 2001, Computer.

[28]  George Drettakis,et al.  Drawing for Illustration and Annotation in 3D , 2001, Comput. Graph. Forum.

[29]  Ellen Yi-Luen Do,et al.  Annotating and sketching on 3D web models , 2002, IUI '02.