Virtual Transcendence Experiences: Exploring Technical and Design Challenges in Multi-Sensory Environments

In this paper1, we introduce the concept of Virtual Transcendence Experience (VTE) as a response to the interactions of several users sharing several immersive experiences through different media channels. For that, we review the current body of knowledge that has led to the development of a VTE system. This is followed by a discussion of current technical and design challenges that could support the implementation of this concept. This discussion has informed the VTE framework (VTEf), which integrates different layers of experiences, including the role of each user and the technical challenges involved. We conclude this paper with suggestions for two scenarios and recommendations for the implementation of a system that could support VTEs.

[1]  Steve Benford,et al.  #Scanners: Exploring the Control of Adaptive Films using Brain-Computer Interaction , 2016, CHI.

[2]  Thorsten O. Zander,et al.  Enhancing Human-Computer Interaction with Input from Active and Passive Brain-Computer Interfaces , 2010, Brain-Computer Interfaces.

[3]  Hiroshi Ishii.  Tangible bits: designing the seamless interface between people, bits, and atoms , 2003, IUI '03.

[4]  Jun Rekimoto,et al.  First Person Omnidirectional Video: System Design and Implications for Immersive Experience , 2015, TVX.

[5]  Glyn Lawson,et al.  Multimodal "Sensory Illusions" for Improving Spatial Awareness in Virtual Environments , 2016, ECCE.

[6]  Xin Liu,et al.  Shooting a moving target: Motion-prediction-based transmission for 360-degree videos , 2016, 2016 IEEE International Conference on Big Data (Big Data).

[7]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[8]  Naeem Ramzan,et al.  Perceptual video quality evaluation by means of physiological signals , 2017, 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX).

[9]  Hiroshi Ishii,et al.  Radical atoms: beyond tangible bits, toward transformable materials , 2012, INTR.

[10]  Falko Kuester,et al.  Towards keyboard independent touch typing in VR , 2005, VRST '05.

[11]  Gwendal Simon,et al.  Viewport-adaptive navigable 360-degree video delivery , 2016, 2017 IEEE International Conference on Communications (ICC).

[12]  Christian Timmerer,et al.  Towards subjective quality of experience assessment for omnidirectional video streaming , 2017, 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX).

[13]  Cyril Concolato,et al.  Tiled-based adaptive streaming using MPEG-DASH , 2016, MMSys.

[14]  Sujit Dey,et al.  A Novel Hyper-Cast Approach to Enable Cloud-Based Virtual Classroom Applications , 2016, 2016 IEEE International Symposium on Multimedia (ISM).

[15]  Julie M. Drexler,et al.  Cybersickness is Not Simulator Sickness , 1997 .

[16]  Harald Reiterer,et al.  Blended Interaction: understanding natural human–computer interaction in post-WIMP interactive spaces , 2014, Personal and Ubiquitous Computing.

[17]  Aljoscha Smolic,et al.  Viewport-aware adaptive 360° video streaming using tiles for virtual reality , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[18]  Kenton O'Hara,et al.  Gamification. using game-design elements in non-gaming contexts , 2011, CHI Extended Abstracts.

[19]  Thomas Gruber,et al.  Experiences in Virtual Reality: a Window to Autobiographical Memory , 2019 .

[20]  Christian Timmerer,et al.  Towards Bandwidth Efficient Adaptive Streaming of Omnidirectional Video over HTTP: Design, Implementation, and Evaluation , 2017, MMSys.

[21]  Hiroshi Ishii,et al.  Physical telepresence: shape capture and display for embodied, computer-mediated remote collaboration , 2014, UIST.

[22]  Christian Timmerer,et al.  An evaluation of Heart Rate and ElectroDermal Activity as an objective QoE evaluation method for immersive virtual reality environments , 2016, 2016 Eighth International Conference on Quality of Multimedia Experience (QoMEX).

[23]  Isabelle Hupont,et al.  How do new visual immersive systems influence gaming QoE? A use case of serious gaming with Oculus Rift , 2015, 2015 Seventh International Workshop on Quality of Multimedia Experience (QoMEX).

[24]  Rajiv V. Dubey,et al.  Point & Teleport Locomotion Technique for Virtual Reality , 2016, CHI PLAY.

[25]  Patrick Seeling,et al.  Visual Interface Evaluation for Wearables Datasets: Predicting the Subjective Augmented Vision Image QoE and QoS , 2017, Future Internet.

[26]  David Rokeby.  Very Nervous System , 2013 .

[27]  Alistair G. Sutcliffe,et al.  Evaluating the usability of virtual reality user interfaces , 2000, Behav. Inf. Technol..

[28]  Sujit Dey,et al.  Modeling and Characterizing User Experience in a Cloud Server Based Mobile Gaming Approach , 2009, GLOBECOM 2009 - 2009 IEEE Global Telecommunications Conference.