Collaborative immersive authoring tool for real-time creation of multisensory VR experiences

With the appearance of innovative virtual reality (VR) technologies, the need to create immersive content arose. Although there are already some non-immersive solutions to address immersive audio-visual content, there are no solutions that allow the creation of immersive multisensory content. This work proposes a novel architecture for a collaborative immersive tool that allows the creation of multisensory VR experiences in real-time, thus promoting the expeditious development, adoption, and use of immersive systems and enabling the building of custom-solutions that can be used in an intuitive manner to support organizations’ business initiatives. To validate the presented proposal, two approaches for the authoring tools (Desktop interface and Immersive interface) were subjected to a set of tests and evaluations consisting of a usability study that demonstrated not only the participants’ acceptance of the authoring tool but also the importance of using immersive interfaces for the creation of such VR experiences.

[1]  Arindam Dey,et al.  An initial exploration of a multi-sensory design space: Tactile support for walking in immersive virtual environments , 2016, 2016 IEEE Symposium on 3D User Interfaces (3DUI).

[2]  Brodie Stanfield,et al.  Integrating Big Data analytics, virtual reality, and ARAIG to support resilience assessment and development in tactical training , 2017, 2017 IEEE 5th International Conference on Serious Games and Applications for Health (SeGAH).

[3]  Nigel Newbutt,et al.  The acceptance, challenges, and future applications of wearable technology and virtual reality to support people with autism spectrum disorders , 2017 .

[4]  Neff Walker,et al.  Evaluating the importance of multi-sensory input on memory and the sense of presence in virtual environments , 1999, Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).

[5]  R. Satava,et al.  Virtual Reality Training Improves Operating Room Performance: Results of a Randomized, Double-Blinded Study , 2002, Annals of surgery.

[6]  Tilo Hartmann,et al.  Influence of individual factors on presence , 2008, Comput. Hum. Behav..

[7]  Patrice Bouvier,et al.  The Five Pillars of Presence: Guidelines to Reach Presence , 2008 .

[8]  Günter Niemeyer,et al.  Catching a real ball in virtual reality , 2017, 2017 IEEE Virtual Reality (VR).

[9]  Michelle E. Portman,et al.  To go where no man has gone before: Virtual reality in architecture, landscape architecture and environmental planning , 2015, Comput. Environ. Urban Syst..

[10]  Syed Haque,et al.  A meta-analysis of the training effectiveness of virtual reality surgical simulators , 2006, IEEE Transactions on Information Technology in Biomedicine.

[11]  James R. Lewis,et al.  IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use , 1995, Int. J. Hum. Comput. Interact..

[12]  Maximino Bessa,et al.  Information system for the management and visualization of multisensorial contents , 2015, 2015 10th Iberian Conference on Information Systems and Technologies (CISTI).

[13]  MengChu Zhou,et al.  Modular Design of Urban Traffic-Light Control Systems Based on Synchronized Timed Petri Nets , 2014, IEEE Transactions on Intelligent Transportation Systems.

[14]  Ipke Wachsmuth,et al.  The Visual, the Auditory and the Haptic - A User Study on Combining Modalities in Virtual Worlds , 2013, HCI.

[15]  Peter Arnold.  You Better Eat to Survive! Exploring Edible Interactions in a Virtual Reality Game , 2017, CHI Extended Abstracts.

[16]  José Martins,et al.  Immersive Edition of Multisensory 360 Videos , 2018, WorldCIST.

[17]  Matt C. Howard.  A meta-analysis and systematic literature review of virtual reality rehabilitation programs , 2017, Comput. Hum. Behav..

[18]  Sarah Jones,et al.  The Sensorama Revisited: Evaluating the Application of Multi-sensory Input on the Sense of Presence in 360-Degree Immersive Film in Virtual Reality , 2018 .

[19]  Mel Slater,et al.  Depth of Presence in Virtual Environments , 1994, Presence: Teleoperators & Virtual Environments.

[20]  G. Ahlberg,et al.  Does training in a virtual reality simulator improve surgical performance? , 2001, Surgical Endoscopy And Other Interventional Techniques.

[21]  Maffei Luigi,et al.  On the Validity of Immersive Virtual Reality as Tool for Multisensory Evaluation of Urban Spaces , 2015 .

[22]  Michael E. McCauley,et al.  Cybersickness: Perception of Self-Motion in Virtual Environments , 1992, Presence: Teleoperators & Virtual Environments.

[23]  Murat Akcay,et al.  Advantages and challenges associated with augmented reality for education : A systematic review of the literature , 2017 .

[24]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[25]  T. Hennig-Thurau,et al.  Value Creation in the Video Game Industry: Industry Economics, Consumer Benefits, and Research Opportunities , 2013 .

[26]  Mel Slater,et al.  A Framework for Immersive Virtual Environments (FIVE): Speculations on the Role of Presence in Virtual Environments , 1997, Presence: Teleoperators & Virtual Environments.

[27]  Wijnand A. IJsselsteijn,et al.  Presence: concept, determinants, and measurement , 2000, Electronic Imaging.

[28]  Michitaka Fujiwara,et al.  Construct validity of the LapVR virtual-reality surgical simulator , 2011, Surgical Endoscopy.

[29]  Per Runeson,et al.  Software product line testing - A systematic mapping study , 2011, Inf. Softw. Technol..

[30]  Panagiotis Petridis,et al.  Learning cultural heritage by serious games , 2014 .

[31]  M.S.J. Hashmi,et al.  Virtual reality applications in manufacturing process simulation , 2004 .

[32]  Michele Dassisti,et al.  Experiencing the Sights, Smells, Sounds, and Climate of Southern Italy in VR , 2017, IEEE Computer Graphics and Applications.

[33]  mprzybylovautilisateurs.  Adobe Creative Cloud , 2020 .

[34]  Shu-Sheng Liaw,et al.  Investigating learners' attitudes toward virtual reality learning environments: Based on a constructivist approach , 2010, Comput. Educ..

[35]  Jiejie Zhu,et al.  Virtual Reality and Mixed Reality for Virtual Learning Environments , 2006, Edutainment.

[36]  Lin Wang,et al.  A surgical training system for four medical punctures based on virtual reality and haptic feedback , 2017, 2017 IEEE Symposium on 3D User Interfaces (3DUI).

[37]  Robert W. Lindeman,et al.  Performance effects of multi-sensory displays in virtual teleoperation environments , 2013, SUI '13.

[38]  David Passig,et al.  Improving children's cognitive modifiability by dynamic assessment in 3D Immersive Virtual Reality environments , 2015, Comput. Educ..

[39]  Karon E. MacLean,et al.  Haptic experience design: What hapticians do and where they need help , 2017, Int. J. Hum. Comput. Stud..

[40]  SwindellsColin,et al.  Haptic experience design , 2017 .

[41]  Philippe Coiffet,et al.  Virtual Reality Technology , 2003, Presence: Teleoperators & Virtual Environments.

[42]  Robert W. Lindeman,et al.  DIY World Builder: An immersive level-editing system , 2013, 2013 IEEE Symposium on 3D User Interfaces (3DUI).

[43]  George Q. Huang,et al.  IoT-based real-time production logistics synchronization system under smart cloud manufacturing , 2016 .