Discovering Leonardo with artificial intelligence and holograms: A user study

Abstract Cutting-edge visualization and interaction technologies are increasingly used in museum exhibitions, providing novel ways to engage visitors and enhance their cultural experience. Existing applications are commonly built upon a single technology, focusing on visualization, motion or verbal interaction (e.g., high-resolution projections, gesture interfaces, chatbots). This aspect limits their potential, since museums are highly heterogeneous in terms of visitors profiles and interests, requiring multi-channel, customizable interaction modalities. To this aim, this work describes and evaluates an artificial intelligence powered, interactive holographic stand aimed at describing Leonardo Da Vinci’s art. This system provides the users with accurate 3D representations of Leonardo’s machines, which can be interactively manipulated through a touchless user interface. It is also able to dialog with the users in natural language about Leonardo’s art, while keeping the context of conversation and interactions. Furthermore, the results of a large user study, carried out during art and tech exhibitions, are presented and discussed. The goal was to assess how users of different ages and interests perceive, understand and explore cultural objects when holograms and artificial intelligence are used as instruments of knowledge and analysis.

[1]  Krzysztof Walczak,et al.  Building Virtual and Augmented Reality museum exhibitions , 2004, Web3D '04.

[2]  Paolo Clini,et al.  HeritageGO (HeGO): A Social Media Based Project for Cultural Heritage Valorization , 2019, UMAP.

[3]  Norbert Reithinger,et al.  Towards chatbots in the museum , 2018, mobileCH@Mobile HCI.

[4]  Giuseppe De Pietro,et al.  An Interactive 3D Holographic Pyramid for Museum Exhibition , 2016, 2016 12th International Conference on Signal-Image Technology & Internet-Based Systems (SITIS).

[5]  Massimo Zancanaro,et al.  PEACH - Intelligent Interfaces for Museum Visits , 2007, Cognitive Technologies.

[6]  Gabriele Guidi,et al.  3D Visualization of Cultural Heritage Artefacts with Virtual Reality devices , 2015 .

[7]  Francesco Colace,et al.  An Approach for Recommending Contextualized Services in e-Tourism , 2019, Inf..

[8]  Francesca Fatta.  Communication, Technology, and Digital Culture for the Conservation and Enhancement of the Architectural Heritage , 2015 .

[9]  Allison Woodruff,et al.  Electronic Guidebooks and Visitor Attention , 2001, ICHIM.

[10]  Angeliki Tzouganatou,et al.  Can Heritage Bots Thrive? Toward Future Engagement in Cultural Heritage , 2018, Advances in Archaeological Practice.

[11]  Xavier Granier,et al.  The Revealing Flashlight: Interactive Spatial Augmented Reality for Detail Exploration of Cultural Heritage Artifacts , 2014, JOCCH.

[12]  Fusako Kusunoki,et al.  Musex: A system for supporting children's collaborative learning in a museum with PDAs , 2004 .

[13]  Roberto Pierdicca,et al.  A Survey of Augmented, Virtual, and Mixed Reality for Cultural Heritage , 2018, ACM Journal on Computing and Cultural Heritage.

[14]  Chairi Kiourt,et al.  Multi-agents based virtual environments for cultural heritage , 2017, 2017 XXVI International Conference on Information, Communication and Automation Technologies (ICAT).

[15]  M. Carrozzino,et al.  COMPARING INNOVATIVE XR SYSTEMS IN CULTURAL HERITAGE. A CASE STUDY , 2019, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[16]  Giuliano Gaia,et al.  Engaging Museum Visitors with AI: The Case of Chatbots , 2019, Museums and Digital Culture.

[17]  Charalambos Poullis,et al.  Towards a more effective way of presenting Virtual Reality museums exhibits , 2014, 2014 International Conference on Computer Vision Theory and Applications (VISAPP).

[18]  Cristian-Cezar Postelnicu,et al.  Towards Preserving Transylvanian Fortified Churches in Virtual Reality , 2018, VRTCH.

[19]  Sylaiou Styliani,et al.  Virtual museums, a survey and some issues for consideration , 2009 .

[20]  Bill N. Schilit,et al.  Context-aware computing applications , 1994, Workshop on Mobile Computing Systems and Applications.

[21]  Sorin Hermon,et al.  Can I touch this? Using Natural Interaction in a Museum Augmented Reality System , 2019, Digit. Appl. Archaeol. Cult. Heritage.

[22]  Mirjana Spasojevic,et al.  From Informing to Remembering: Ubiquitous Systems in Interactive Museums , 2002, IEEE Pervasive Comput..

[23]  Vincenzo Moscato,et al.  An Edge Intelligence Empowered Recommender System Enabling Cultural Heritage Applications , 2019, IEEE Transactions on Industrial Informatics.

[24]  Luigi Gallo,et al.  Evaluation of spatial interaction techniques for virtual heritage applications: A case study of an interactive holographic projection , 2018, Future Gener. Comput. Syst..

[25]  Francesco Colace,et al.  Chatbot: An Education Support System for Student , 2018, CSS.

[26]  Daniel Pletinckx,et al.  Virtual-Reality Heritage Presentation at Ename , 2000, IEEE Multim..

[27]  Antonella De Angeli,et al.  Explore! possibilities and challenges of mobile learning , 2008, CHI.

[28]  Sherry Hsi,et al.  RFID enhances visitors' museum experience at the Exploratorium , 2005, CACM.

[29]  Manuela Chessa,et al.  A virtual holographic display case for museum installations , 2015, 2015 7th International Conference on Intelligent Technologies for Interactive Entertainment (INTETAIN).

[30]  Michela Ott,et al.  Towards a new era for Cultural Heritage Education: Discussing the role of ICT , 2011, Comput. Hum. Behav..

[31]  Richard E. Berg.  Physics Demonstrations: A Sourcebook for Teachers of Physics , 2006 .

[32]  Massimo Bergamasco,et al.  Beyond virtual museums: experiencing immersive virtual reality in real museums , 2010 .

[33]  Charalampos Z. Patrikakis,et al.  Developing the Museum-Monumental Experience from Linear to Interactive Using Chatbots , 2019 .