Virtual Valcamonica: Collaborative Exploration of Prehistoric Petroglyphs and Their Surrounding Environment in Multi-User Virtual Reality

In this article, we present a novel, multi-user, virtual reality environment for the interactive, collaborative 3D analysis of large 3D scans and the technical advancements that were necessary to build it: a multi-view rendering system for large 3D point clouds, a suitable display infrastructure, and a suite of collaborative 3D interaction techniques. The cultural heritage site of Valcamonica in Italy with its large collection of prehistoric rock-art served as an exemplary use case for evaluation. The results show that our output-sensitive level-of-detail rendering system is capable of visualizing a 3D dataset with an aggregate size of more than 14 billion points at interactive frame rates. The system design in this exemplar application results from close exchange with a small group of potential users: archaeologists with expertise in rockart. The system allows them to explore the prehistoric art and its spatial context with highly realistic appearance. A set of dedicated interaction techniques was developed to facilitate collaborative visual analysis. A multi-display workspace supports the immediate comparison of geographically distributed artifacts. An expert review of the final demonstrator confirmed the potential for added value in rock-art research and the usability of our collaborative interaction techniques.

[1]  Paola Di Giuseppantonio Di Franco,et al.  3D Printing and Immersive Visualization for Improved Perception of Ancient Artifacts , 2015, PRESENCE: Teleoperators and Virtual Environments.

[2]  Matthias Zwicker,et al.  High-quality surface splatting on today's GPUs , 2005, Proceedings Eurographics/IEEE VGTC Symposium Point-Based Graphics, 2005..

[3]  L. Diamond,et al.  Evolution and style in Camunian rock art : an inquiry into the formation of European civilization , 1976 .

[4]  Christian Nitschke.  3D Reconstruction , 2007 .

[5]  Bernd Fröhlich,et al.  Immersive Group-to-Group Telepresence , 2013, IEEE Transactions on Visualization and Computer Graphics.

[6]  Jamie Quartermaine,et al.  The Tel Akko Total Archaeology Project (Akko, Israel): Assessing the suitability of multi-scale 3D field recording in archaeology , 2013 .

[7]  Thenkurussi Kesavadas,et al.  The Virtual Site Museum: A Multi-Purpose, Authoritative, and Functional Virtual Heritage Resource , 2006, PRESENCE: Teleoperators and Virtual Environments.

[8]  M. Sheelagh T. Carpendale,et al.  Territoriality in collaborative tabletop workspaces , 2004, CSCW.

[9]  Henry Chapman,et al.  More Than Just a Sum of the Points: Re-Thinking the Value of Laser Scanning Data , 2013, Visual Heritage in the Digital Age.

[10]  Isaac Cho,et al.  Multi-Scale 7DOF View Adjustment , 2018, IEEE Transactions on Visualization and Computer Graphics.

[11]  Jens Keil,et al.  Immersive experience of current and ancient reconstructed cultural attractions , 2013, 2013 Digital Heritage International Congress (DigitalHeritage).

[12]  Laurent Grisoni,et al.  The effect of DOF separation in 3D manipulation tasks with multi-touch displays , 2010, VRST '10.

[13]  Bernd Fröhlich,et al.  Finger and hand detection for multi-touch interfaces based on maximally stable extremal regions , 2012, ITS '12.

[14]  Bernd Fröhlich,et al.  C1x6: a stereoscopic six-user display for co-located collaboration in shared virtual environments , 2011, SA '11.

[15]  Rhadamés Carmona,et al.  Error-controlled real-time cut updates for multi-resolution volume rendering , 2011, Comput. Graph..

[16]  Carl Gutwin,et al.  A Descriptive Framework of Workspace Awareness for Real-Time Groupware , 2002, Computer Supported Cooperative Work (CSCW).

[17]  Ismael H. F. dos Santos,et al.  Dynamic Adjustment of Stereo Parameters for Virtual Reality Tools , 2011, 2011 XIII Symposium on Virtual Reality.

[18]  Michael M. Kazhdan,et al.  Screened poisson surface reconstruction , 2013, TOGS.

[19]  Kai Lawonn,et al.  Visualization and Extraction of Carvings for Heritage Conservation , 2017, IEEE Transactions on Visualization and Computer Graphics.

[20]  M. Sheelagh T. Carpendale,et al.  Sticky tools: full 6DOF force-based interaction for multi-touch tables , 2009, ITS '09.

[21]  Carl Gutwin,et al.  Empirical development of a heuristic evaluation methodology for shared workspace groupware , 2002, CSCW '02.

[22]  Uzy Smilansky,et al.  On the application of 3-D scanning technology for the documentation and typology of lithic artifacts , 2008 .

[23]  Hongbo Fu,et al.  Two‐Finger Gestures for 6DOF Manipulation of 3D Objects , 2012, Comput. Graph. Forum.

[24]  George Pavlidis,et al.  Methods for 3D digitization of Cultural Heritage , 2007 .

[25]  Valérie Gouranton,et al.  An Immersive Virtual Sailing on the 18th-Century Ship Le Boullongne , 2015, PRESENCE: Teleoperators and Virtual Environments.

[26]  Arlen F. Chase,et al.  Airborne LiDAR, archaeology, and the ancient Maya landscape at Caracol, Belize , 2011 .

[27]  Alexander Kulik,et al.  User Interfaces for Cooperation , 2016 .

[28]  Bernd Fröhlich,et al.  Efficient Hybrid Image Warping for High Frame-Rate Stereoscopic Rendering , 2017, IEEE Transactions on Visualization and Computer Graphics.

[29]  Robin Wolff,et al.  A Mixed Reality Telepresence System for Collaborative Space Operation , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[30]  B. Bederson,et al.  Designing storytelling technologies to encouraging collaboration between young children , 2000, CHI.

[31]  Matthew Johnson-Roberson,et al.  Mapping Submerged Archaeological Sites using Stereo‐Vision Photogrammetry , 2013 .

[32]  Marc Alexa,et al.  Point set surfaces , 2001, Proceedings Visualization, 2001. VIS '01..

[33]  Derek Bradley,et al.  Accurate multi-view reconstruction using robust binocular stereo and surface meshing , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[34]  Craig Alexander,et al.  Multi-scale 3D rock-art recording , 2015, Digit. Appl. Archaeol. Cult. Heritage.

[35]  Martin Hachet,et al.  Beyond the mouse: Understanding user gestures for manipulating 3D objects from touchscreen inputs , 2012, Comput. Graph..

[36]  Ferran Argelaguet,et al.  GiAnt: stereoscopic-compliant multi-scale navigation in VEs , 2016, VRST.

[37]  Yvonne Rogers,et al.  Collaborating around vertical and horizontal large interactive displays: which way is best? , 2004, Interact. Comput..

[38]  Claire Smith,et al.  Encyclopedia of Global Archaeology , 2014 .

[39]  Renato Pajarola,et al.  An efficient multi-resolution framework for high quality interactive rendering of massive point clouds using multi-way kd-trees , 2012, The Visual Computer.

[40]  Harold Thwaites,et al.  Digital Heritage: What Happens When We Digitize Everything? , 2013, Visual Heritage in the Digital Age.

[41]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[42]  F. J. Melero,et al.  A complete 3D information system for cultural heritage documentation , 2017 .

[43]  Eugene Ch'ng,et al.  Simulation and Visualisation of Agent Survival and Settlement Behaviours in the Hunter-Gatherer Colonisation of Mesolithic Landscapes , 2013, Visual Heritage in the Digital Age.

[44]  Roger H. White.  Resolving the Carving: The Application of Laser Scanning in Reconstructing a Viking Cross from Neston, Cheshire , 2013, Visual Heritage in the Digital Age.

[45]  Miriam Cabrelles,et al.  Latest developments in rock art recording: towards an integral documentation of Levantine rock art sites combining 2D and 3D recording techniques , 2013 .

[46]  Henry Fuchs,et al.  Encumbrance-free telepresence system with real-time 3D capture and display using commodity depth cameras , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[47]  Markus H. Gross,et al.  Efficient simplification of point-sampled surfaces , 2002, IEEE Visualization, 2002. VIS 2002..

[48]  Fabio Bruno,et al.  From 3D reconstruction to virtual reality: A complete methodology for digital archaeological exhibition , 2010 .

[49]  Horst Bischof,et al.  Interactive segmentation of rock-art in high-resolution 3D reconstructions , 2015, 2015 Digital Heritage.

[50]  Pushmeet Kohli,et al.  Fusion4D , 2016, ACM Trans. Graph..

[51]  Marc Herrlich,et al.  Integrated Rotation and Translation for 3D Manipulation on Multi-Touch Interactive Surfaces , 2011, Smart Graphics.

[52]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[53]  Markku Reunanen,et al.  A Holistic User-Centered Approach to Immersive Digital Cultural Heritage Installations , 2015, ACM Journal on Computing and Cultural Heritage.

[54]  Roberto Pierdicca,et al.  Virtual reconstruction of archaeological heritage using a combination of photogrammetric techniques: Huaca Arco Iris, Chan Chan, Peru , 2016, Digit. Appl. Archaeol. Cult. Heritage.

[55]  Matthias Zwicker,et al.  Surfels: surface elements as rendering primitives , 2000, SIGGRAPH.

[56]  M. Banusree.  MIXED REALITY , 2016 .

[57]  Jean-Baptiste de la Rivière,et al.  iliGHT 3D touch: a multiview multitouch surface for 3d content visualization and viewpoint sharing , 2010, ITS '10.

[58]  Igor Mordatch,et al.  Multiscale 3D navigation , 2009, I3D '09.

[59]  Renato Pajarola,et al.  High Quality Interactive Rendering of Massive Point Models Using Multi-way kd-Trees , 2010, 2010 18th Pacific Conference on Computer Graphics and Applications.

[60]  Bernd Fröhlich,et al.  Photoportals: shared references in space and time , 2014, CSCW.

[61]  Gabriele Guidi,et al.  3D Digitization of Cultural Heritage , 2020 .

[62]  Klaus H. Hinrichs,et al.  Triangle cursor: interactions with objects above the tabletop , 2011, ITS '11.