An interactive support tool to convey the intended message in asynchronous presentations

In this paper we introduce an interactive wall-mounted display tool that supports conveying the intended message or ideas in asynchronous presentations. The tool allows to easily record presentations while capturing the richness of the presenter's individual presentation skills and style. The tool records the presentation and organizes it into three information layers (i.e. gesture, sound and visuals), which are first used to segment the presentation into meaningful parts, and later to control the playback of audiovisual presentations. Once recorded, the presentation can be played back, explored and commented using a flexible and intuitive interaction based on hand movements and body position (i.e. proximity). We focus our work on a case study where designers present their mood boards (i.e. collages) to their clients. Evaluations with professional designers show that they are able to use the tool with no prior training, see a practical use of the proposed tool in their design studios, and see gesture trails as a creative tool for expression and aesthetics.

[1]  John C. Tang,et al.  VideoWhiteboard: video shadows to support remote collaboration , 1991, CHI.

[2]  Stephanie D. Teasley,et al.  Perspectives on socially shared cognition , 1991 .

[3]  Dzmitry Aliakseyeu,et al.  Funky wall: presenting mood boards using gesture, speech and visuals , 2008, AVI '08.

[4]  Michael J. Black,et al.  Analysis of gesture and action in technical talks for video indexing , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  David S. Kirk,et al.  Comparing remote gesture technologies for supporting collaborative physical tasks , 2006, CHI.

[6]  Judith S. Olson,et al.  Analysis of gestures in face-to-face design teams provides guidance for how to use groupware in design , 1995, Symposium on Designing Interactive Systems.

[7]  Joel Lanir,et al.  Presentation tools for high-resolution and multiple displays , 2008, HCC '08.

[8]  Adel Elsayed.  Machine-Mediated Communication: The Technology , 2006, Sixth IEEE International Conference on Advanced Learning Technologies (ICALT'06).

[9]  Julia Hirschberg,et al.  Automatic classification of intonational phrase boundaries , 1992 .

[10]  Barry Arons,et al.  The audio notebook: paper and pen interaction with structured speech , 2001, CHI.

[11]  Daniel Vogel,et al.  Interactive public ambient displays: transitioning from implicit to explicit, public to personal, interaction with multiple users , 2004, UIST '04.

[12]  Michel Beaudouin-Lafon,et al.  Charade: remote control of objects using free-hand gestures , 1993, CACM.

[13]  A. A. Lucero Vera,et al.  Co-designing interactive spaces for and with designers : supporting mood-board making , 2009 .

[14]  Michael Boyle,et al.  Understanding and Mitigating Display and Presence Disparity in Mixed Presence Groupware , 2005, J. Res. Pract. Inf. Technol..

[15]  Herbert H. Clark,et al.  Grounding in communication , 1991, Perspectives on socially shared cognition.

[16]  Lynn Wilcox,et al.  NoteLook: taking notes in meetings with digital video and ink , 1999, MULTIMEDIA '99.

[17]  Alison Kidd,et al.  The marks are on the knowledge worker , 1994, CHI '94.

[18]  Norbert A. Streitz,et al.  Hello.Wall - Beyond Ambient Displays , 2003 .

[19]  François Bérard,et al.  Bare-hand human-computer interaction , 2001, PUI '01.

[20]  Stephen R. Levine,et al.  The Freestyle system: a design perspective , 1995 .

[21]  D. McNeill.  Gesture and Thought , 2005 .

[22]  Thomas P. Moran,et al.  Tivoli: an electronic whiteboard for informal workgroup meetings , 1993, INTERCHI.

[23]  A. Elsayed.  Machine-Mediated Communication: The Technology , 2006 .

[24]  Roger Hartley,et al.  The anatomy of an active multimodal presentation in educational contexts , 2005, Fifth IEEE International Conference on Advanced Learning Technologies (ICALT'05).

[25]  Michael G. Lamming.  Towards a Human Memory Prosthesis , 1991, Operating Systems of the 90s and Beyond.

[26]  Gregory D. Abowd,et al.  Towards a Smarter Meeting Record—Capture and Access of Meetings Revisited , 2005, Multimedia Tools and Applications.