HoloStation: augmented visualization and presentation

As much as stories need to be told, images need to be presented. Although visualizations are meant to be self-explanatory, often enhancing their expressive power by incorporating a certain degree of interactivity, visualized images today often fail to encourage the active engagement of the user/audience. In many cases, interactive interventions by a human presenter have the potential to drastically improve the engagement with visualization. Rather than just showing the content, the presenter then enhances information delivery, e.g., by providing the context of the visualization. In this paper, we propose a novel concept called augmented presentation in which the human presenter occupies the same physical space as the visualized information, thereby presenting and interacting with the visualized images seamlessly. Depending on the level of engagement the presenter's role may vary: from a simple storyteller to an augmented presenter who may be regarded as a part of the visualized entity. To further the development of the new idea of augmented presentation, we have designed, implemented, and user-tested a visualization system named HoloStation. The presenter is placed between two projection screens: the front one is half-mirrored and the rear one is a conventional wall screen. The 3D stereoscopic images are rendered to appear in-between, thereby creating a coherent 3D visualization space filled with digital information and the human presenter. We have conducted a controlled experiment to investigate the subjective level of immersion and engagement of the audience with HoloStation compared to the traditional presentation. Our results suggest that our new form of augmented presentation has a potential not only to enhance the quality of information presentation but also to enrich the user experience on visualizations.

[1]  Kwan-Liu Ma,et al.  Scientific Storytelling Using Visualization , 2012, IEEE Computer Graphics and Applications.

[2]  David Kim,et al.  HoloDesk: direct 3d interactions with a situated see-through display , 2012, CHI.

[3]  Du-Sik Park,et al.  3D user interface combining gaze and hand gestures for large-scale display , 2010, CHI EA '10.

[4]  Riccardo Mazza,et al.  Introduction to Information Visualization , 2009 .

[5]  B. Simon,et al.  Use of classroom presenter in engineering courses , 2005, Proceedings Frontiers in Education 35th Annual Conference.

[6]  Norman I. Badler,et al.  Design of a Virtual Human Presenter , 2000, IEEE Computer Graphics and Applications.

[7]  Anton Nijholt,et al.  Presenting in Virtual Worlds: Towards an Architecture for a 3D Presenter Explaining 2D-Presented Information , 2005, INTETAIN.

[8]  Matthew O. Ward,et al.  Interactive Data Visualization - Foundations, Techniques, and Applications , 2010 .

[9]  Hossein Nouri,et al.  The Effect of Powerpoint Presentations on Student Learning and Attitudes , 2005 .

[10]  Martin Hachet,et al.  Toucheo: multitouch and stereo combined in a seamless workspace , 2011, UIST.

[11]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Martin Fischer,et al.  Designing and Evaluating Visualization Techniques for Construction Planning , 2000 .

[13]  Murphy Stein ARCADE: a system for augmenting gesture-based computer graphic presentations , 2012, SIGGRAPH '12.

[14]  Bongshin Lee,et al.  SketchStory: Telling More Engaging Stories with Data through Freeform Sketching , 2013, IEEE Transactions on Visualization and Computer Graphics.

[15]  Stephen DiVerdi,et al.  Depth-Fused 3D Imagery on an Immaterial Display , 2009, IEEE Transactions on Visualization and Computer Graphics.

[16]  Martin S. Banks,et al.  A stereo display prototype with multiple focal distances , 2004, ACM Trans. Graph..

[17]  Jock D. Mackinlay,et al.  Storytelling: The Next Step for Visualization , 2013, Computer.

[18]  Alex Olwal,et al.  ASTOR: an autostereoscopic optical see-through augmented reality system , 2005, Fourth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR'05).

[19]  J. Geng Three-dimensional display technologies. , 2013, Advances in optics and photonics.

[20]  Michel Beaudouin-Lafon,et al.  Charade: remote control of objects using free-hand gestures , 1993, CACM.

[21]  John T. Stasko,et al.  Toward a Deeper Understanding of the Role of Interaction in Information Visualization , 2007, IEEE Transactions on Visualization and Computer Graphics.

[22]  Abdulmotaleb El-Saddik,et al.  See in 3D: state of the art of 3D display technologies , 2015, Multimedia Tools and Applications.

[23]  Stephen DiVerdi,et al.  Mid-air display experiments to create novel user interfaces , 2009, Multimedia Tools and Applications.

[24]  Jungjin Lee,et al.  SPAROGRAM: The spatial augmented reality holographic display for 3D visualization and exhibition , 2014, 2014 IEEE VIS International Workshop on 3DVis (3DVis).

[25]  Oliver Bimber,et al.  The virtual showcase , 2005, SIGGRAPH Courses.

[26]  Kevin J. MacKenzie,et al.  Vergence and accommodation to multiple-image-plane stereoscopic displays: "real world" responses with practical image-plane separations? , 2012, J. Electronic Imaging.

[27]  Adam Fourney,et al.  in the Wild : Understanding the Effects and Implications of Gesture-Based Interaction for Dynamic Presentations , 2011 .

[28]  Oliver Gingrich,et al.  KIMA: a holographic telepresence environment based on cymatic principles , 2013, SIGGRAPH Art Gallery.

[29]  Anton Nijholt,et al.  Presenting in Virtual Worlds: An Architecture for a 3D Anthropomorphic Presenter , 2006, IEEE Intelligent Systems.

[30]  Geng Sun,et al.  Evaluating methods for controlling depth perception in stereoscopic cinematography , 2009, Electronic Imaging.

[31]  Michitaka Hirose,et al.  Invisible Interface for the Immersive Virtual World , 2001, EGVE/IPT.