A hybrid augmented reality guide for underwater cultural heritage sites

Modern technologies allow us to experience cultural heritage sites in new and exciting ways. Recent improvements in mobile computing provide tools capable of running augmented reality in real-time performance. Augmented reality is the perfect medium for visualizing and interacting with cultural heritage sites including both buildings and artefacts. Currently, this is possible on land, but sites located in the sea under water are hard to access and present many challenges. In this paper, we present a novel augmented reality guide for divers to present ancient lost buildings at underwater archeological sites. The prototype system runs on a smartphone sealed in a waterproof case and uses a hybrid approach (markers and inertial sensors) to localize the diver on the site. Accuracy of the tracker is measured in a laboratory in a simulated underwater environment. The application was experimentally evaluated at an underwater archeological site in Italy in Baiae. A pilot study with ten expert divers was performed, and their feedback, obtained directly in water, showed that this new experience significantly enhances user experience in underwater archeological sites.

[1]  Rafael Muñoz-Salinas,et al.  Speeded up detection of squared fiducial markers , 2018, Image Vis. Comput..

[2]  John Quarles.  Shark punch: A virtual reality game for aquatic rehabilitation , 2015, VR.

[3]  Dimitrios Buhalis,et al.  Augmented Reality at Cultural Heritage sites , 2016, ENTER.

[4]  Jean-Thierry Lapresté,et al.  Dry camera calibration for underwater applications , 2003, Machine Vision and Applications.

[5]  Fabio Bruno,et al.  Detecting Square Markers in Underwater Environments , 2019, Remote. Sens..

[6]  Damianos Gavalas,et al.  Mobile Augmented Reality Guides in Cultural Heritage , 2016, MobiCASE.

[7]  Damianos Gavalas,et al.  Leveraging Mixed Reality Technologies to Enhance Museum Visitor Experiences , 2018, 2018 International Conference on Intelligent Systems (IS).

[8]  Fotis Liarokapis,et al.  Simulation of Underwater Excavation Using Dredging Procedures , 2018, IEEE Computer Graphics and Applications.

[9]  Yoichi Ochiai,et al.  Optimized HMD system for underwater VR experience , 2017, SIGGRAPH Posters.

[10]  Edwin Olson,et al.  AprilTag 2: Efficient and robust fiducial detection , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[11]  Dimitrios Skarlatos,et al.  UNDERSTANDING UNDERWATER PHOTOGRAMMETRY FOR MARITIME ARCHAEOLOGY THROUGH IMMERSIVE VIRTUAL REALITY , 2019, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[12]  Denik Hatsushika,et al.  Underwater VR Experience System for Scuba Training Using Underwater Wired HMD , 2018, OCEANS 2018 MTS/IEEE Charleston.

[13]  Fabio Bruno,et al.  Improving Marker-Based Tracking for Augmented Reality in Underwater Environments , 2018, Eurographics Workshop on Graphics and Cultural Heritage.

[14]  Dimitrios Skarlatos,et al.  3D MODELLING AND MAPPING FOR VIRTUAL EXPLORATION OF UNDERWATER ARCHAEOLOGY ASSETS , 2017 .

[15]  Jun Rekimoto,et al.  AquaCAVE: An Underwater Immersive Projection System for Enhancing the Swimming Experience , 2016, ICAT-EGVE.

[16]  Jonas Buchli,et al.  An open source, fiducial based, visual-inertial motion capture system , 2016, 2016 19th International Conference on Information Fusion (FUSION).

[17]  Junyeong Lee,et al.  AREEF Multi-player Underwater Augmented Reality experience , 2013, 2013 IEEE International Games Innovation Conference (IGIC).

[18]  Daniel A. Guttentag.  Virtual reality: Applications and implications for tourism , 2010 .

[19]  G. Klinker,et al.  An Underwater Augmented Reality system for commercial diving operations , 2009, OCEANS 2009.

[20]  Didier Stricker,et al.  Archeoguide: An Augmented Reality Guide for Archaeological Sites , 2002, IEEE Computer Graphics and Applications.

[21]  T. Jung,et al.  Cross-cultural differences in adopting mobile augmented reality at cultural heritage tourism sites , 2018 .

[22]  Kangsoo Kim,et al.  A tracking framework for augmented reality tours on cultural heritage sites , 2010, VRCAI '10.

[23]  Simon Richir,et al.  Proposition and Validation of a Questionnaire to Measure the User Experience in Immersive Virtual Environments , 2016, Int. J. Virtual Real..

[24]  Fabio Bruno,et al.  Virtual and Augmented Reality Tools to Improve the Exploitation of Underwater Archaeological Sites by Diver and Non-diver Tourists , 2016, EuroMed.

[25]  Joel J. P. C. Rodrigues,et al.  Underwater Wireless Communications in Freshwater at 2.4 GHz , 2013, IEEE Communications Letters.

[26]  Fabio Bruno,et al.  Development and integration of digital technologies addressed to raise awareness and access to European underwater cultural heritage. An overview of the H2020 i-MARECULTURE project , 2017, OCEANS 2017 - Aberdeen.

[27]  Joan Solà,et al.  Quaternion kinematics for the error-state Kalman filter , 2015, ArXiv.

[28]  Samir Otmane,et al.  Augmented reality for underwater activities with the use of the DOLPHYN , 2013, 2013 10th IEEE INTERNATIONAL CONFERENCE ON NETWORKING, SENSING AND CONTROL (ICNSC).

[29]  Sylaiou Styliani,et al.  Virtual museums, a survey and some issues for consideration , 2009 .

[30]  Dimitrios Skarlatos,et al.  A serious game for understanding ancient seafaring in the Mediterranean sea , 2017, 2017 9th International Conference on Virtual Worlds and Games for Serious Applications (VS-Games).

[31]  Silvia Silva da Costa Botelho,et al.  Underwater SLAM: Challenges, state of the art, algorithms and a new biologically-inspired approach , 2014, 5th IEEE RAS/EMBS International Conference on Biomedical Robotics and Biomechatronics.

[32]  Panos E. Kourouthanassis,et al.  Tourists responses to mobile augmented reality travel guides: The role of emotions on adoption behavior , 2015, Pervasive Mob. Comput..

[33]  A. Dunser,et al.  CityViewAR: A mobile outdoor AR application for city visualization , 2012, 2012 IEEE International Symposium on Mixed and Augmented Reality - Arts, Media, and Humanities (ISMAR-AMH).

[34]  Panagiotis D. Kaklis,et al.  Underwater Mixed Environments , 2013, Virtual Realities.

[35]  Katerina Mania,et al.  An Architecture for Mobile Outdoors Augmented Reality for Cultural Heritage , 2018, ISPRS Int. J. Geo Inf..