Omnidirectional Video in Museums - Authentic, Immersive and Entertaining

Omnidirectional video (ODV) provides possibilities for capture and presentation of cultural content for museums and other exhibitions. 360° video capture can record authentic environments and activities, and enables immersive viewing of such material. We present the potential of ODV by reporting the learnings from long-term user experience data collection with two ODV-based museum installations; a head mounted display (HMD) based rally simulator, and a road grader simulator utilizing three projectors and haptic feedback. The results show the value of immersion, provide insights into the possibilities and challenges of interactivity, and show, how haptic feedback can improve the overall experience. The results also provide support to the use of physical elements in museum installations. In addition, we managed to avoid cyber sickness, a common problem with immersive VR content, in the installations. Overall, the respondents strongly support the conception that these kinds of installations would make museums more desirable places to visit.

[1]  Jun Rekimoto,et al.  First Person Omnidirectional Video: System Design and Implications for Immersive Experience , 2015, TVX.

[2]  Charles B. Owen,et al.  Review on cybersickness in applications and visual displays , 2016, Virtual Reality.

[3]  Tuuli Keskinen.  Evaluating the User Experience of Interactive Systems in Challenging Circumstances , 2015 .

[4]  Karol Kwiatek.  How to preserve inspirational environments that once surrounded a poet? Immersive 360° video and the cultural memory of Charles Causley's poetry , 2012, 2012 18th International Conference on Virtual Systems and Multimedia.

[5]  Erik Duval,et al.  Quantifying the interaction stages of a public display campaign in the wild , 2014, NordiCHI.

[6]  Markku Turunen,et al.  SUXES - user experience evaluation method for spoken and multimodal interaction , 2009, INTERSPEECH.

[7]  Michael Beigl,et al.  pARnorama: 360 degree interactive video for augmented reality prototyping , 2013, UbiComp.

[8]  Jun Rekimoto,et al.  JackIn Head: Immersive Visual Telepresence System with Omnidirectional Wearable Camera , 2017, IEEE Trans. Vis. Comput. Graph..

[9]  Javier Ruiz Hidalgo,et al.  Gesture Interaction with Rich TV Content in the Social Setting , 2013, CHI 2013.

[10]  Wolfgang Heiden,et al.  Atmosphaeres - 360° Video Environments for Stress and Pain Management , 2014, SGDA.

[11]  Naokazu Yokoya,et al.  Fly-through Heijo palace site: augmented telepresence using aerial omnidirectional videos , 2011, SIGGRAPH '11.

[12]  Colin Ware,et al.  Exploration and virtual camera control in virtual three dimensional environments , 1990, I3D '90.

[13]  Markku Turunen,et al.  User Experience and Immersion of Interactive Omnidirectional Videos in CAVE Systems and Head-Mounted Displays , 2017, INTERACT.

[14]  Teresa Chambel,et al.  Get around 360° hypervideo , 2010, MindTrek.

[15]  Naokazu Yokoya,et al.  Telepresence by Real-Time View-Dependent Image Generation from Omnidirectional Video Streams , 1998, Comput. Vis. Image Underst..

[16]  Teresa Chambel,et al.  Windy sight surfers: sensing and awareness of 360° immersive videos on the move , 2013, EuroITV.

[17]  Lizzy Bleumers,et al.  Seeing the bigger picture: a user perspective on 360° TV , 2012, EuroITV.

[18]  Kris Luyten,et al.  Multi-viewer gesture-based interaction for omni-directional video , 2014, CHI.

[19]  Markku Turunen,et al.  Multimodal Media Center Interface Based on Speech, Gestures and Haptic Feedback , 2009, INTERACT.

[20]  Jun Rekimoto,et al.  JackIn Head: Immersive Visual Telepresence System with Omnidirectional Wearable Camera , 2015, IEEE Transactions on Visualization and Computer Graphics.

[21]  Paul A. Cairns,et al.  Investigating computer game immersion and the component real world dissociation , 2009, CHI Extended Abstracts.

[22]  Yasushi Yagi,et al.  Omnidirectional Sensing and Its Applications , 1999 .

[23]  Ismo Rakkolainen,et al.  Interaction with WebVR 360° video player: Comparing three interaction paradigms , 2017, 2017 IEEE Virtual Reality (VR).

[24]  Jochen Huber,et al.  Towards effective interaction with omnidirectional videos using immersive virtual reality headsets , 2015, AH.

[25]  Teresa Chambel,et al.  Get Around 360º Hypervideo Its Design and Evaluation , 2012, Int. J. Ambient Comput. Intell..

[26]  Martin Woolner,et al.  Transporting the Viewer Into a 360° heritage story: Panoramic interactive narrative presented on a wrap-around screen , 2010, 2010 16th International Conference on Virtual Systems and Multimedia.

[27]  Lemonia Argyriou,et al.  Engaging Immersive Video Consumers: Challenges Regarding 360-Degree Gamified Video Applications , 2016, 2016 15th International Conference on Ubiquitous Computing and Communications and 2016 International Symposium on Cyberspace and Security (IUCC-CSS).

[28]  Jörg Müller,et al.  The Audience Funnel: Observations of Gesture Based Interaction With Multiple Large Displays in a City Center , 2011, Int. J. Hum. Comput. Interact..

[29]  Louise Barkhuus,et al.  Panoramic video: design challenges and implications for content interaction , 2013, EuroITV.

[30]  Mel Slater,et al.  A note on presence terminology , 2003 .

[31]  Philippe Bekaert,et al.  The pleasure of being (there?): an explorative study into the effects of presence and identification on the enjoyment of an interactive theatrical performance using omnidirectional video , 2014, AI & SOCIETY.

[32]  Ulrich Neumann,et al.  Immersive panoramic video , 2000, ACM Multimedia.

[33]  Wenceslao Peñate,et al.  The effects of a treatment based on the use of virtual reality exposure and cognitive-behavioral therapy applied to patients with agoraphobia , 2008 .

[34]  Terrance E. Boult,et al.  Remote Reality via omni-directional imaging , 1998, SIGGRAPH '98.

[35]  Markku Turunen,et al.  Guidelines for Designing Interactive Omnidirectional Video Applications , 2017, INTERACT.

[36]  Hrvoje Benko,et al.  Multi-point interactions with immersive omnidirectional visualizations in a dome , 2010, ITS '10.

[37]  Takeo Kanade,et al.  Omnidirectional Video Capturing, Multiple People Tracking and Identification for Meeting Monitoring , 2005 .