HoloBox: Augmented Visualization and Presentation with Spatially Integrated Presenter

While visualization alone can play a meaningful role, visualized images today often fail to invoke active engagement from the audience. In numerous cases, a human presenter’s interactive involvement can drastically enhance the engagement with visualization. In this paper, we propose and further develop a novel concept called augmented presentation, in which a human presenter occupies the same physical space as the visualization, thereby presenting and interacting with the visualized information seamlessly. We focus mainly on investigating the potential of the presenter by referring to the interaction framework for visualization and the proposed presenter’s roles. Depending on the type of interaction and level of engagement, the presenter’s role may vary from a narrator to an augmenter who may be regarded as part of the visualization. Further developing the idea of augmented presentation, we designed and implemented a presentation system named HoloBox. Then, we conducted two user studies to investigate the possibilities of HoloBox as a new presentation channel. The results suggest that our new form of augmented presentation has the potential to enhance the quality of presentations and enrich the audience experience with regard to visualization. In terms of the presenter, five out of six participants chose HoloBox as their preferred presentation method despite the extra effort required to make a presentation. We believe that our augmented presentation can support new forms of visualization and information delivery.

[1]  Bernd Fröhlich,et al.  Immersive Projection Technology and Virtual Environments 2001 , 2001, Eurographics.

[2]  M. Sheelagh T. Carpendale,et al.  Empirical Studies in Information Visualization: Seven Scenarios , 2012, IEEE Transactions on Visualization and Computer Graphics.

[3]  Alex Olwal,et al.  ASTOR: an autostereoscopic optical see-through augmented reality system , 2005, Fourth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR'05).

[4]  J. Geng Three-dimensional display technologies. , 2013, Advances in optics and photonics.

[5]  Alfred Bork,et al.  Multimedia in Learning , 2001 .

[6]  John C. Tang,et al.  A comparison of face-to-face and distributed presentations , 1995, CHI '95.

[7]  Martin Fischer,et al.  Designing and Evaluating Visualization Techniques for Construction Planning , 2000 .

[8]  Stephen DiVerdi,et al.  Depth-Fused 3D Imagery on an Immaterial Display , 2009, IEEE Transactions on Visualization and Computer Graphics.

[9]  Darren Edge,et al.  HyperSlides: dynamic presentation prototyping , 2013, CHI.

[10]  Ben Shneiderman,et al.  The eyes have it: a task by data type taxonomy for information visualizations , 1996, Proceedings 1996 IEEE Symposium on Visual Languages.

[11]  Anton Nijholt,et al.  Presenting in Virtual Worlds: Towards an Architecture for a 3D Presenter Explaining 2D-Presented Information , 2005, INTETAIN.

[12]  Elaine Toms,et al.  The development and evaluation of a survey to measure user engagement , 2010, J. Assoc. Inf. Sci. Technol..

[13]  John T. Stasko,et al.  Toward a Deeper Understanding of the Role of Interaction in Information Visualization , 2007, IEEE Transactions on Visualization and Computer Graphics.

[14]  Jean-Claude Martin,et al.  The effects of speech-gesture cooperation in animated agents' behavior in multimedia presentations , 2007, Interact. Comput..

[15]  Kevin J. MacKenzie,et al.  Vergence and accommodation to multiple-image-plane stereoscopic displays: 'Real world' responses with practical image-plane separations? , 2011, Electronic Imaging.

[16]  R. Mayer,et al.  Effects of Observing the Instructor Draw Diagrams on Learning from Multimedia Messages. , 2016 .

[17]  S. Ainsworth The Cambridge Handbook of Multimedia Learning: The Multiple Representation Principle in Multimedia Learning , 2014 .

[18]  Gareth J. F. Jones,et al.  Speaker impact on audience comprehension for academic presentations , 2016, ICMI.

[19]  R. Mayer,et al.  Cognitive Principles of Multimedia Learning: The Role of Modality and Contiguity , 1999 .

[20]  Norman I. Badler,et al.  Design of a Virtual Human Presenter , 2000, IEEE Computer Graphics and Applications.

[21]  David Kim,et al.  HoloDesk: direct 3d interactions with a situated see-through display , 2012, CHI.

[22]  Matthew O. Ward,et al.  Interactive Data Visualization - Foundations, Techniques, and Applications , 2010 .

[23]  Björn B. de Koning,et al.  Facilitating Understanding of Movements in Dynamic Visualizations: an Embodied Perspective , 2011 .

[24]  R. Craig,et al.  PowerPoint Presentation Technology and the Dynamics of Teaching , 2006 .

[25]  Andrey Krekhov,et al.  Gestures From the Point of View of an Audience: Towards Anticipatable Interaction of Presenters With 3D Content. , 2017, CHI.

[26]  Alex Endert,et al.  Beyond Usability and Performance: A Review of User Experience-focused Evaluations in Visualization , 2016, BELIV '16.

[27]  John C. Hart,et al.  The CAVE: audio visual experience automatic virtual environment , 1992, CACM.

[28]  Stephen Gale,et al.  Human Aspects of Interactive Multimedia Communication , 1990, Interact. Comput..

[29]  John Sweller,et al.  Evolutionary bases of human cognitive architecture: implications for computing education , 2008, ICER '08.

[30]  Oliver Gingrich,et al.  KIMA: a holographic telepresence environment based on cymatic principles , 2013, SIGGRAPH Art Gallery.

[31]  Timo Ropinski,et al.  Interaction techniques as a communication channel when presenting 3D visualizations , 2014, 2014 IEEE VIS International Workshop on 3DVis (3DVis).

[32]  Jungjin Lee,et al.  SPAROGRAM: The spatial augmented reality holographic display for 3D visualization and exhibition , 2014, 2014 IEEE VIS International Workshop on 3DVis (3DVis).

[33]  Mark Billinghurst,et al.  Evaluating visual search performance with a multi layer display , 2008, OZCHI '08.

[34]  Richard Mayer,et al.  Multimedia Learning , 2001, Visible Learning Guide to Student Achievement.

[35]  Thomas B. Moeslund,et al.  A Procedure for Developing Intuitive and Ergonomic Gesture Interfaces for HCI , 2003, Gesture Workshop.

[36]  Martin Hachet,et al.  Toucheo: multitouch and stereo combined in a seamless workspace , 2011, UIST.

[37]  Jane Webster,et al.  Audience engagement in multimedia presentations , 1997, DATB.

[38]  Geng Sun,et al.  Evaluating methods for controlling depth perception in stereoscopic cinematography , 2009, Electronic Imaging.

[39]  Martin S. Banks,et al.  A stereo display prototype with multiple focal distances , 2004, SIGGRAPH 2004.

[40]  Michitaka Hirose,et al.  Invisible Interface for the Immersive Virtual World , 2001, EGVE/IPT.

[41]  Jungjin Lee,et al.  HoloStation: augmented visualization and presentation , 2016, SIGGRAPH Asia Symposium on Visualization.

[42]  Mitsuru Ishizuka,et al.  Eye movements as indices for the utility of life-like interface agents: A pilot study , 2007, Interact. Comput..

[43]  Ben Shneiderman,et al.  Readings in information visualization - using vision to think , 1999 .

[44]  Nick Campbell,et al.  Presentation quality assessment using acoustic information and hand movements , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[45]  Guijin Wang,et al.  A hand gesture based interactive presentation system utilizing heterogeneous cameras , 2012 .

[46]  Adam Fourney,et al.  in the Wild : Understanding the Effects and Implications of Gesture-Based Interaction for Dynamic Presentations , 2011 .

[47]  Pierre Dragicevic,et al.  Opportunities and Challenges for Data Physicalization , 2015, CHI.

[48]  Joel Lanir,et al.  Observing presenters' use of visual aids to inform the design of classroom presentation software , 2008, CHI.

[49]  Khalid Aziz The key to perfect presentations , 1998 .

[50]  Stephen DiVerdi,et al.  Mid-air display experiments to create novel user interfaces , 2009, Multimedia Tools and Applications.