Initial User-Centered Design of a Virtual Reality Heritage System: Applications for Digital Tourism

Reality capture allows for the reconstruction, with a high accuracy, of the physical reality of cultural heritage sites. Obtained 3D models are often used for various applications such as promotional content creation, virtual tours, and immersive experiences. In this paper, we study new ways to interact with these high-quality 3D reconstructions in a real-world scenario. We propose a user-centric product design to create a virtual reality (VR) application specifically intended for multi-modal purposes. It is applied to the castle of Jehay (Belgium), which is under renovation, to permit multi-user digital immersive experiences. The article proposes a high-level view of multi-disciplinary processes, from a needs analysis to the 3D reality capture workflow and the creation of a VR environment incorporated into an immersive application. We provide several relevant VR parameters for the scene optimization, the locomotion system, and the multi-user environment definition that were tested in a heritage tourism context.

[1]  Miguel Cipolla-Ficarra,et al.  Multimedia, User-Centered Design and Tourism: Simplicity, Originality and Universality , 2008, New Directions in Intelligent Interactive Multimedia.

[2]  Thomas P. Kersten,et al.  Virtual Reality for Cultural Heritage Monuments - from 3D Data Recording to Immersive Visualisation , 2018, EuroMed.

[3]  F. Okumus,et al.  Exploring the role of next-generation virtual technologies in destination marketing , 2018, Journal of Destination Marketing & Management.

[4]  A. B. W. P. B. Fredericque,et al.  D City Geographic Information System – A Major Step Towards Sustainable Infrastructure , .

[5]  Roberto Scopigno,et al.  Developing and Maintaining a Web 3D Viewer for the CH Community: an Evaluation of the 3DHOP Framework , 2018, GCH.

[6]  Dieter Schmalstieg,et al.  Human upper-body inverse kinematics for increased embodiment in consumer-grade virtual reality , 2018, VRST.

[7]  Patricia S. Denbrook,et al.  Virtual Locomotion: Walking in Place through Virtual Environments , 1999, Presence.

[8]  Florent Poux,et al.  The Smart Point Cloud: Structuring 3D intelligent point data , 2019 .

[9]  Paul Williams,et al.  Virtual reality and tourism: fact or fantasy? , 1995 .

[10]  Dai-In Danny Han,et al.  Virtual and Augmented Reality Technologies to Enhance the Visitor Experience in Cultural Tourism , 2018, Augmented Reality and Virtual Reality.

[11]  James T. Kajiya,et al.  The rendering equation , 1986, SIGGRAPH.

[12]  F. Poux,et al.  Model for Semantically Rich Point Cloud Data , 2017 .

[13]  Maarten Vergauwen,et al.  Point Cloud vs. Mesh Features for Building Interior Classification , 2020, Remote. Sens..

[14]  Cettina Santagati,et al.  Cultural Heritage Documentation, Analysis and Management Using Building Information Modelling: State of the Art and Perspectives , 2018 .

[15]  M. Westoby,et al.  ‘Structure-from-Motion’ photogrammetry: A low-cost, effective tool for geoscience applications , 2012 .

[16]  J J Koenderink,et al.  Affine structure from motion. , 1991, Journal of the Optical Society of America. A, Optics and image science.

[17]  Daniel A. Guttentag Virtual reality: Applications and implications for tourism , 2010 .

[18]  Klaus Schilling,et al.  Evaluation of a Backpack-Mounted 3D Mobile Scanning System , 2015, Remote. Sens..

[19]  Fabio Remondino,et al.  State of the art in high density image matching , 2014 .

[20]  Maria Roussou,et al.  Learning by doing and learning through play: an exploration of interactivity in virtual environments for children , 2004, CIE.

[21]  Mathieu Treffer Un système d'information géographique 3D pour le château de Jehay : Définition des besoins et modélisation conceptuelle sur base de CityGML , 2017 .

[22]  Andreas Lanitis,et al.  Presenting Cypriot Cultural Heritage in Virtual Reality: A User Evaluation , 2014, EuroMed.

[23]  Eelke Folmer,et al.  VR-STEP: Walking-in-Place using Inertial Sensing for Hands Free Navigation in Mobile VR Environments , 2016, CHI.

[24]  M. James,et al.  Ultra‐rapid topographic surveying for complex environments: the hand‐held mobile laser scanner (HMLS) , 2014 .

[25]  Mario Santana Quintero,et al.  Information Management Systems for Cultural Heritage and Conservation of World Heritage Sites. The Silk Roads Case Study , 2011 .

[26]  Roland Billen,et al.  POINT CLOUD CLASSIFICATION OF TESSERAE FROM TERRESTRIAL LASER DATA COMBINED WITH DENSE IMAGE MATCHING FOR ARCHAEOLOGICAL INFORMATION EXTRACTION , 2017, ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[27]  Jason Gregory,et al.  Game Engine Architecture , 2009 .

[28]  Michael Wimmer,et al.  Real-Time Continuous Level of Detail Rendering of Point Clouds , 2019, 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[29]  Lu Zhang,et al.  Effects of virtual reality on theme park visitors' experience and behaviors: A presence perspective , 2019, Tourism Management.

[30]  Bruno Dutailly,et al.  Accéder en 3D aux données de terrain pluridisciplinaires - un outil pour l’étude des grottes ornées. , 2019 .

[31]  A. T. Mozas-Calvache,et al.  Method for photogrammetric surveying of archaeological sites with light aerial platforms , 2012 .

[32]  Martin Weinmann,et al.  Reconstruction and Analysis of 3D Scenes , 2016, Springer International Publishing.

[33]  George Drettakis,et al.  Perceptual audio rendering of complex virtual environments , 2004, ACM Trans. Graph..

[34]  Andreas Aristidou,et al.  Extending FABRIK with model constraints , 2016, Comput. Animat. Virtual Worlds.

[35]  Diego González-Aguilera,et al.  Terrestrial laser scanning intensity data applied to damage detection for historical buildings , 2010 .

[36]  Edwin H. Blake,et al.  Exact From-Region Visibility Culling , 2002, Rendering Techniques.

[37]  Roland Billen,et al.  Voxel-based 3D Point Cloud Semantic Segmentation: Unsupervised Geometric and Relationship Featuring vs Deep Learning Methods , 2019, ISPRS Int. J. Geo Inf..

[38]  M. Garland,et al.  Quadric-Based Polygonal Surface Simplification , 1999 .

[39]  George Pavlidis,et al.  Multi-image 3D reconstruction data evaluation , 2014 .

[40]  Susan Gasson,et al.  HUMAN-CENTERED VS. USER-CENTERED APPROACHES TO INFORMATION SYSTEM DESIGN , 2003 .

[41]  H. R. Gimblett,et al.  RBSim: geographic simulation of wilderness recreation behavior. , 2001 .

[42]  Natalia Cortón Noya,et al.  Combining photogrammetry and photographic enhancement techniques for the recording of megalithic art in north-west Iberia , 2015, Digit. Appl. Archaeol. Cult. Heritage.

[43]  Markku Reunanen,et al.  A Holistic User-Centered Approach to Immersive Digital Cultural Heritage Installations , 2015, ACM Journal on Computing and Cultural Heritage.

[44]  Helena Rua,et al.  Living the past: 3D models, virtual reality and game engines as tools for supporting archaeology and the reconstruction of cultural heritage – the case-study of the Roman villa of Casal de Freiria , 2011 .

[45]  J. Pérez,et al.  EXPERIENCES ABOUT FUSIONING 3D DIGITALIZATION TECHNIQUES FOR CULTURAL HERITAGE DOCUMENTATION , 1980 .

[46]  Joseph J. LaViola,et al.  A discussion of cybersickness in virtual environments , 2000, SGCH.

[47]  T SilvaClaudio,et al.  A Survey of Surface Reconstruction from Point Clouds , 2017 .

[48]  N. Yastikli Documentation of cultural heritage using digital photogrammetry and laser scanning , 2007 .

[49]  Helmut Mayera,et al.  COMPARISON OF PHOTOGRAMMETRIC AND COMPUTER VISION TECHNIQUES-3 D RECONSTRUCTION AND VISUALIZATION OF WARTBURG CASTLE , 2003 .

[50]  Branko Glisic,et al.  Virtual tours and informational modeling for conservation of cultural heritage sites , 2017 .

[51]  Mario Santana Quintero,et al.  Conservation of Architectural Heritage: The Role of Digital Documentation Tools: The Need for Appropriate Teaching Material , 2007 .

[52]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[53]  Juha Hyyppä,et al.  Interactive dense point clouds in a game engine , 2020 .

[54]  Neff Walker,et al.  Evaluating the importance of multi-sensory input on memory and the sense of presence in virtual environments , 1999, Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).

[55]  Petros Patias,et al.  Digital Heritage. Progress in Cultural Heritage: Documentation, Preservation, and Protection , 2016, Lecture Notes in Computer Science.

[56]  Dan Wang,et al.  Virtual Reality and Attitudes Toward Tourism Destinations , 2017, ENTER.

[57]  K. Moffett,et al.  Remote Sens , 2015 .

[58]  N. Haala The Landscape of Dense Image Matching Algorithms , 2013 .

[59]  Marko Koch,et al.  Combining 3D Laser-Scanning and Close-Range Photogrammetry - An Approach to Exploit the Strength of Both Methods , 2009 .

[60]  Joel Ryan Photogrammetry for 3D Content Development in Serious Games and Simulations , 2019 .

[61]  Pierre Alliez,et al.  A Survey of Surface Reconstruction from Point Clouds , 2017, Comput. Graph. Forum.

[62]  Matthew Ellis,et al.  Immersive Displays for Education Using CaveUT , 2005 .

[63]  F. Poux,et al.  CLASSIFICATION AND INTEGRATION OF MASSIVE 3D POINTS CLOUDS IN A VIRTUAL REALITY (VR) ENVIRONMENT , 2019, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[64]  Eugenio Pellicer,et al.  An online platform to unify and synchronise heritage architecture information , 2020 .

[65]  Catherine Wilkinson,et al.  Childhood, mobile technologies and everyday experiences: changing technologies = changing childhoods? , 2016 .

[66]  T KajiyaJames The rendering equation , 1986 .

[67]  Roger Cheong,et al.  The virtual threat to travel and tourism , 1995 .

[68]  Fabio Bruno,et al.  User-centered design of a virtual reality exhibit for archaeological museums , 2017, International Journal on Interactive Design and Manufacturing (IJIDeM).

[69]  Roland Billen,et al.  SMART POINT CLOUD: DEFINITION AND REMAINING CHALLENGES , 2016 .

[70]  Sabine Musil,et al.  Can Tourism be Replaced by Virtual Reality Technology? , 1994, ENTER.

[71]  Tassos A. Mikropoulos,et al.  Presence: a unique characteristic in educational virtual environments , 2006, Virtual Reality.

[72]  Roland Billen,et al.  SEMANTIC ENRICHMENT OF POINT CLOUD BY AUTOMATIC EXTRACTION AND ENHANCEMENT OF 360° PANORAMAS , 2019 .

[73]  Roland Billen,et al.  3D Point Cloud Semantic Modelling: Integrated Framework for Indoor Spaces and Furniture , 2018, Remote. Sens..

[74]  Xiangyu Wang,et al.  A State-of-the-Art Review on the Integration of Building Information Modeling (BIM) and Geographic Information System (GIS) , 2017, ISPRS Int. J. Geo Inf..

[75]  R. Fabio From point cloud to surface the modeling and visualization problem , 2003 .

[76]  Fabio Remondino,et al.  Heritage Recording and 3D Modeling with Photogrammetry and 3D Scanning , 2011, Remote. Sens..

[77]  J. Hobson,et al.  VIRTUAL REALITY: THE FUTURE OF LEISURE AND TOURISM? , 1997 .

[78]  Timothy Jung,et al.  Effects of Virtual Reality and Augmented Reality on Visitor Experiences in Museum , 2016, ENTER.

[79]  R. Billen,et al.  3D Point Clouds in Archaeology: Advances in Acquisition, Processing and Knowledge Integration Applied to Quasi-Planar Objects , 2017 .

[80]  Michael E. McCauley,et al.  Cybersickness: Perception of Self-Motion in Virtual Environments , 1992, Presence: Teleoperators & Virtual Environments.

[81]  Senthil Mani,et al.  User-Centered Design and Business Process Modeling: Cross Road in Rapid Prototyping Tools , 2007, INTERACT.

[82]  Nicky L Webster,et al.  High poly to low poly workflows for real-time rendering , 2017, Journal of visual communication in medicine.

[83]  Nazlena Mohamad Ali,et al.  A Conceptual Framework for Designing Virtual Heritage Environment for Cultural Learning , 2018, ACM Journal on Computing and Cultural Heritage.

[84]  Roberto Pierdicca,et al.  A Survey of Augmented, Virtual, and Mixed Reality for Cultural Heritage , 2018, ACM Journal on Computing and Cultural Heritage.

[85]  R. Law,et al.  Progress in information technology and tourism management: 20 years on and 10 years after the Internet - the state of eTourism research. , 2008 .

[86]  Andreas Aristidou,et al.  FABRIK: A fast, iterative solver for the Inverse Kinematics problem , 2011, Graph. Model..

[87]  Roland Billen,et al.  Laser Scanning , 2019 .

[88]  Iis P. Tussyadiah,et al.  Virtual reality, presence, and attitude change: Empirical evidence from tourism , 2018, Tourism Management.

[89]  Pierre Grussenmeyer,et al.  METHODOLOGICAL DEVELOPMENTS IN 3D SCANNING AND MODELLING OF ARCHAEOLOGICAL FRENCH HERITAGE SITE : THE BRONZE AGE PAINTED CAVE OF "LES FRAUX", DORDOGNE (FRANCE) , 2013 .

[90]  Diego González-Aguilera,et al.  GRAPHOS – open‐source software for photogrammetric applications , 2018 .

[91]  A. P. Williams,et al.  Virtual reality: A new horizon for the tourism industry , 1995 .

[92]  Mary Deaton,et al.  The elements of user experience: user-centered design for the Web , 2003, INTR.