A Comparison of Immersive Realities and Interaction Methods: Cultural Learning in Virtual Heritage

In recent years, Augmented Reality (AR), Virtual Reality (VR), Augmented Virtuality (AV), and Mixed Reality (MxR) have become popular immersive reality technologies for cultural knowledge dissemination in Virtual Heritage (VH). These technologies have been utilized for enriching museums with a personalized visiting experience and digital content tailored to the historical and cultural context of the museums and heritage sites. Various interaction methods, such as sensor-based, device-based, tangible, collaborative, multimodal, and hybrid interaction methods, have also been employed by these immersive reality technologies to enable interaction with the virtual environments. However, the utilization of these technologies and interaction methods isn't often supported by a guideline that can assist Cultural Heritage Professionals (CHP) to predetermine their relevance to attain the intended objectives of the VH applications. In this regard, our paper attempts to compare the existing immersive reality technologies and interaction methods against their potential to enhance cultural learning in VH applications. To objectify the comparison, three factors have been borrowed from existing scholarly arguments in the Cultural Heritage (CH) domain. These factors are the technology's or the interaction method's potential and/or demonstrated capability to: (1) establish a contextual relationship between users, virtual content, and cultural context, (2) allow collaboration between users, and (3) enable engagement with the cultural context in the virtual environments and the virtual environment itself. Following the comparison, we have also proposed a specific integration of collaborative and multimodal interaction methods into a Mixed Reality (MxR) scenario that can be applied to VH applications that aim at enhancing cultural learning in situ.

[1]  Daniela D'Auria,et al.  A 3D Audio Augmented Reality System for a Cultural Heritage Management and Fruition , 2015 .

[2]  Martin White,et al.  The Application of Augmented Reality for Reanimating Cultural Heritage , 2014, HCI.

[3]  Maria Roussou,et al.  Reviving the past: cultural heritage meets virtual reality , 2001, VAST '01.

[4]  David K. McGookin,et al.  Investigating tangential access for location-based digital cultural heritage applications , 2019, Int. J. Hum. Comput. Stud..

[5]  Pedro Santos,et al.  Supporting outdoor mixed reality applications for architecture and cultural heritage , 2010, SpringSim.

[6]  Hafizur Rahaman,et al.  Digital heritage interpretation: a conceptual framework , 2018, Digit. Creativity.

[7]  Massimo Bergamasco,et al.  Beyond virtual museums: experiencing immersive virtual reality in real museums , 2010 .

[8]  David Lindlbauer,et al.  Remixed Reality: Manipulating Space and Time in Augmented Reality , 2018, CHI.

[9]  David M. Nichols,et al.  Acquiring Metadata to Support Biographies of Museum Artefacts , 2018, ICADL.

[10]  Timothy Jung,et al.  Value of Augmented Reality at Cultural Heritage Sites: A Stakeholder Approach , 2017 .

[11]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[12]  Marco Gaiani,et al.  Interacting with the Andrea Palladio Works: The History of Palladian Information System Interfaces , 2014, JOCCH.

[13]  Andrea Giachetti,et al.  Gestural Interaction and Navigation Techniques for Virtual Museum Experiences , 2016, AVI*CH.

[14]  Dieter Kranzlmuller,et al.  State of the art of virtual reality technology , 2016, 2016 IEEE Aerospace Conference.

[15]  Yao-Ting Sung,et al.  Apply an Augmented Reality in a Mobile Guidance to Increase Sense of Place for Heritage Places , 2015, J. Educ. Technol. Soc..

[16]  Beat Signer,et al.  Tangible Holograms: Towards Mobile Physical Augmentation of Virtual Objects , 2017, ArXiv.

[17]  Samir Otmane,et al.  Virtual and augmented reality for cultural computing and heritage: a case study of virtual exploration of underwater archaeological sites (preprint) , 2011, Virtual Reality.

[18]  Erik Champion,et al.  The Palenque project: evaluating interaction in an online virtual archaeology site , 2011, Virtual Reality.

[19]  Guida Casella,et al.  Augmented heritage: situating augmented reality mobile apps in cultural heritage communication , 2013, ISDOC.

[20]  Nikolaos Grammalidis,et al.  Mixed Reality, Gamified Presence, and Storytelling for Virtual Museums , 2019, Encyclopedia of Computer Graphics and Games.

[21]  Matthew Leach,et al.  Recreating Sheffield's Medieval Castle In Situ using Outdoor Augmented Reality , 2018, EuroVR.

[22]  Didier Stricker,et al.  Archeoguide: first results of an augmented reality, mobile computing system in cultural heritage sites , 2001, VAST '01.

[23]  Qinping Zhao,et al.  A survey on virtual reality , 2009, Science in China Series F: Information Sciences.

[24]  Erik Champion,et al.  Evaluating cultural learning in an online virtual environment , 2006 .

[25]  Markus Funk,et al.  HoloLens is more than air Tap: natural and intuitive interaction with holograms , 2017, IOT.

[26]  Mario Alaguero,et al.  A flexible platform for the creation of 3D semi-immersive environments to teach Cultural Heritage , 2015, Digit. Appl. Archaeol. Cult. Heritage.

[27]  Rob Saunders,et al.  Towards an Interaction Blueprint for Mixed Reality Experiences in GLAM Spaces: The Augmented Telegrapher at Porthcurno Museum , 2018 .

[28]  Ernesto Damiani,et al.  Augmented reality technologies, systems and applications , 2010, Multimedia Tools and Applications.

[29]  Normala Rahim,et al.  Analysis on user interaction in Virtual Heritage: Virtual Museum Environment , 2017 .

[30]  Maria Roussou,et al.  The EMOTIVE Project - Emotive Virtual Cultural Experiences through Personalized Storytelling , 2018, CIRA@EuroMed.

[31]  Gabriela Avram,et al.  Supporting Cultural Heritage Professionals Adopting and Shaping Interactive Technologies in Museums , 2017, Conference on Designing Interactive Systems.

[32]  Luigi Gallo,et al.  Evaluation of spatial interaction techniques for virtual heritage applications: A case study of an interactive holographic projection , 2018, Future Gener. Comput. Syst..

[33]  Fotis Liarokapis,et al.  Mobile augmented reality techniques for GeoVisualisation , 2005, Ninth International Conference on Information Visualisation (IV'05).

[34]  Erik Champion,et al.  Redefining Mixed Reality: User-Reality-Virtuality and Virtual Heritage Perspectives , 2019 .

[35]  Marco Gaiani,et al.  Virtualized Architectural Heritage: New Tools and Techniques , 2000, IEEE Multim..

[36]  Tomás Urbánek,et al.  Collaborative Immersive Virtual Environments for Education in Geography , 2018, ISPRS Int. J. Geo Inf..

[37]  Maria Roussou,et al.  A versatile large-scale multimodal VR system for cultural heritage visualization , 2006, VRST '06.

[38]  Kangsoo Kim,et al.  Augmented reality tour system for immersive experience of cultural heritage , 2009, VRCAI '09.

[39]  Blair MacIntyre,et al.  Exploring spatial narratives and mixed reality experiences in Oakland Cemetery , 2005, ACE '05.

[40]  Laura Malinverni,et al.  Towards the Design of a Virtual Heritage Experience based on the World-as-Support Interaction Paradigm , 2017, CHI Extended Abstracts.

[41]  Xavier Granier,et al.  The Revealing Flashlight: Interactive Spatial Augmented Reality for Detail Exploration of Cultural Heritage Artifacts , 2014, JOCCH.

[42]  Kangsoo Kim,et al.  Revisiting Trends in Augmented Reality Research: A Review of the 2nd Decade of ISMAR (2008–2017) , 2018, IEEE Transactions on Visualization and Computer Graphics.

[43]  M. Economou,et al.  Evaluating the impact of new technologies on cultural heritage visitors , 2007 .

[44]  Orit Shaer,et al.  Evaluating Learning with Tangible and Virtual Representations of Archaeological Artifacts , 2018, TEI.

[45]  Martin White,et al.  Virtual and Augmented Reality Applied to Educational and Cultural Heritage Domains , 2002 .

[46]  Wei Huang,et al.  A 3D GIS-based interactive registration mechanism for outdoor augmented reality system , 2016, Expert Syst. Appl..

[47]  Constantinos Papadopoulos,et al.  ‘Tangible pasts’: user-centred design of a mixed reality application for cultural heritage , 2011 .

[48]  George Papagiannakis,et al.  A Comparison of Gamified, Immersive VR Curation Methods for Enhanced Presence and Human-computer Interaction in Digital Humanities , 2015 .

[49]  A. Damala,et al.  Tailoring the Adaptive Augmented Reality (A2R) museum visit: Identifying Cultural Heritage professionals' motivations and needs , 2012, 2012 IEEE International Symposium on Mixed and Augmented Reality - Arts, Media, and Humanities (ISMAR-AMH).

[50]  George Papagiannakis,et al.  A survey of mobile and wireless technologies for augmented reality systems , 2008, Comput. Animat. Virtual Worlds.

[51]  Eva Pietroni,et al.  The Etruscanning project: Gesture-based interaction and user experience in the virtual reconstruction of the Regolini-Galassi tomb , 2013, 2013 Digital Heritage International Congress (DigitalHeritage).

[52]  Maria Economou,et al.  Worth a Thousand Words? The Usefulness of Immersive Virtual Reality for Learning in Cultural Heritage Settings , 2009 .

[53]  Nazlena Mohamad Ali,et al.  A Conceptual Framework for Designing Virtual Heritage Environment for Cultural Learning , 2018, ACM Journal on Computing and Cultural Heritage.

[54]  Roberto Pierdicca,et al.  A Survey of Augmented, Virtual, and Mixed Reality for Cultural Heritage , 2018, ACM Journal on Computing and Cultural Heritage.

[55]  Arindam Dey,et al.  The Effects of Sharing Awareness Cues in Collaborative Mixed Reality , 2019, Front. Robot. AI.

[56]  Nur Intan Adhani A Survey of Mobile Augmented Reality Applications , 2012 .

[57]  Erik Champion,et al.  Game–Style Interaction , 2010 .

[58]  Martin Hachet,et al.  A Survey of Interaction Techniques for Interactive 3D Environments , 2013, Eurographics.

[59]  E. Hornecker,et al.  The Loupe: tangible augmented reality for learning to look at Ancient Greek art , 2016 .

[60]  D. Pletinckx,et al.  An Augmented Reality Presentation System for Remote Cultural Heritage Sites , 2009 .

[61]  Robert W. Lindeman,et al.  Coordinated hybrid virtual environments: Seamless interaction contexts for effective virtual reality , 2015, Comput. Graph..