A survey on developing personalized content services in museums

Abstract The personalized content services in museums are motivated by the need to enhance the visitors’ experience through recommendations which consider the context of their visit, and by the need of curators to measure objectively the exhibition’s impact. We survey the latest advancements in the fields of indoor localization, visitor profiling, content storage and presentation, as well as curator visualization tools, which are the main elements of such systems, and we highlight their strengths and weaknesses. We present an information architecture, which may offer useful insights to researchers and developers. Finally, we present the current challenges and the future trends.

[1]  Kyran Dale.  Data Visualization with Python and JavaScript: Scrape, Clean, Explore & Transform Your Data , 2016 .

[2]  Peter Samis.  Points of Departure: Curators and Educators Collaborate to Prototype a "Museum of the Future" , 2001, ICHIM.

[3]  Daniela Petrelli,et al.  User-Centred Design of Flexible Hypermedia for a Mobile Guide: Reflections on the HyperAudio Experience , 2005, User Modeling and User-Adapted Interaction.

[4]  Ingrid Zukerman,et al.  Personalised viewing-time prediction in museums , 2013, User Modeling and User-Adapted Interaction.

[5]  Zhaozheng Yin,et al.  Human Activity Recognition Using Wearable Sensors by Deep Convolutional Neural Networks , 2015, ACM Multimedia.

[6]  Lora Aroyo,et al.  Finding Your Way through the Rijksmuseum with an Adaptive Mobile Museum Guide , 2010, ESWC.

[7]  Sophie Ahrens,et al.  Recommender Systems , 2012 .

[8]  Antonis A. Argyros,et al.  Multicamera human detection and tracking supporting natural interaction with large-scale displays , 2012, Machine Vision and Applications.

[9]  Oliver Bimber,et al.  PhoneGuide: museum guidance supported by on-device object recognition on mobile phones , 2005, MUM '05.

[10]  Andreas Riener,et al.  Head-Pose-Based Attention Recognition on Large Public Displays , 2014, IEEE Computer Graphics and Applications.

[11]  Yao-Ting Sung,et al.  Designing an electronic guidebook for learning engagement in a museum of history , 2010, Comput. Hum. Behav..

[12]  Dan Boneh,et al.  Who killed my battery?: analyzing mobile browser energy consumption , 2012, WWW.

[13]  José Ignacio Rojas-Sola,et al.  Content management system incorporated in a virtual museum hosting , 2011 .

[14]  Tsvi Kuflik,et al.  Analysis and Prediction of Museum Visitors' Behavioral Pattern Types , 2012, Ubiquitous Display Environments.

[15]  Stuart E. Middleton,et al.  Vision-based production of personalized video , 2009, Signal Process. Image Commun..

[16]  Antonio Rizzo,et al.  Adapting the museum: a non-intrusive user modeling approach , 1999 .

[17]  Minhua Ma,et al.  Augmented Reality and Gamification in Heritage Museums , 2016, JCSG.

[18]  Effrosini Kokiopoulou,et al.  Mobile Museum Guide Based on Fast SIFT Recognition , 2008, Adaptive Multimedia Retrieval.

[19]  Nikolaos M. Avouris,et al.  Context-based design of mobile applications for museums: a survey of existing practices , 2005, Mobile HCI.

[20]  Antonio Moreno,et al.  Intelligent tourism recommender systems: A survey , 2014, Expert Syst. Appl..

[21]  Salvatore Cuomo,et al.  Classify Visitor Behaviours in a Cultural Heritage Exhibition , 2015, DATA.

[22]  Thomas Jackson,et al.  Social media analytics in museums: extracting expressions of inspiration , 2017 .

[23]  Anthony Rowe,et al.  Indoor pseudo-ranging of mobile devices using ultrasonic chirps , 2012, SenSys '12.

[24]  Elisa Bertino,et al.  A semantic approach to build personalized interfaces in the cultural heritage domain , 2006, AVI '06.

[25]  Nenad Stojanovic,et al.  Adaptive Augmented Reality for Cultural Heritage: ARtSENSE Project , 2012, EuroMed.

[26]  Lu Li,et al.  Visualizing the Emotional Journey of a Museum , 2016, EmoVis@IUI.

[27]  Yiqiang Chen,et al.  Multidimensional Vector Regression for Accurate and Low-Cost Location Estimation in Pervasive Computing , 2006, IEEE Transactions on Knowledge and Data Engineering.

[28]  Jae Kyeong Kim,et al.  A literature review and classification of recommender systems research , 2012, Expert Syst. Appl..

[29]  Sidney S. Fels,et al.  ZenTrader, an Emotion-Reactive Interface , 2011, ICEC.

[30]  Ingrid Zukerman,et al.  Using interest and transition models to predict visitor locations in museums , 2008, AI Commun..

[31]  Armin B. Cremers,et al.  SmartGuide - A Smartphone Museum Guide with Ultrasound Control , 2011, ANT/MobiWIS.

[32]  Liliana Ardissono,et al.  Collaboration Support for Activity Management in a Personal Cloud Environment , 2011, Int. J. Distributed Syst. Technol..

[33]  Sei Ikeda,et al.  Visual SLAM algorithms: a survey from 2010 to 2016 , 2017, IPSJ Transactions on Computer Vision and Applications.

[34]  W. A. Eardley,et al.  An Ontology Engineering Approach to User Profiling for Virtual Tours of Museums and Galleries , 2016 .

[35]  George Roussos,et al.  Mobile sensing, BYOD and Big Data Analytics: New technologies for audience research in museums , 2014 .

[36]  Scott Murray,et al.  Interactive Data Visualization for the Web , 2013 .

[37]  Prashant Krishnamurthy,et al.  Analysis of WLAN's received signal strength indication for indoor location fingerprinting , 2012, Pervasive Mob. Comput..

[38]  R. Kshetrimayum,et al.  An introduction to UWB communication systems , 2009, IEEE Potentials.

[39]  Demetrios Zeinalipour-Yazti,et al.  Indoor geolocation on multi-sensor smartphones , 2013, MobiSys '13.

[40]  M. Shamim Hossain,et al.  A Unified Video Recommendation by Cross-Network User Modeling , 2016, ACM Trans. Multim. Comput. Commun. Appl..

[41]  Takuji Narumi,et al.  Digital Display Case Using Non-contact Head Tracking , 2011, HCI.

[42]  Dong Yu,et al.  Deep Learning: Methods and Applications , 2014, Found. Trends Signal Process..

[43]  M. Shamim Hossain,et al.  Cross-Platform Multi-Modal Topic Modeling for Personalized Inter-Platform Recommendation , 2015, IEEE Transactions on Multimedia.

[44]  Babak Taheri,et al.  Keeping your audience: presenting a visitor engagement scale. , 2014 .

[45]  Gunnar Liestøl,et al.  STEM LEARNING BY MEANS OF MOBILE AUGMENTED REALITY. EXPLORING THE POTENTIAL OF AUGMENTING CLASSROOM LEARNING WITH SITUATED SIMULATIONS AND PRACTICAL ACTIVITIES ON LOCATION , 2015 .

[46]  Luca Greco,et al.  Sentiment Detection in Social Networks Using Semantic Analysis: A Tool for Sentiment Analysis and Its Application in Cultural Heritage Realm , 2015, Data Management in Pervasive Systems.

[47]  J. Bobadilla,et al.  Recommender systems survey , 2013, Knowl. Based Syst..

[48]  Antonio Krüger,et al.  The museum visit: generating seamless personalized presentations on multiple devices , 2004, IUI '04.

[49]  Tracy Jun-Feng Zhang,et al.  New service bonds and customer value in customer relationship management: the case of museum visitors. , 2013 .

[50]  Manuel Mucientes,et al.  Omnivision-based KLD-Monte Carlo Localization , 2010, Robotics Auton. Syst..

[51]  Konstantinos N. Plataniotis,et al.  Kernel-Based Positioning in Wireless Local Area Networks , 2007, IEEE Transactions on Mobile Computing.

[52]  Gernot Heiser,et al.  An Analysis of Power Consumption in a Smartphone , 2010, USENIX Annual Technical Conference.

[53]  Alfred Kobsa,et al.  The Adaptive Web, Methods and Strategies of Web Personalization , 2007, The Adaptive Web.

[54]  Roberto Brunelli,et al.  Detecting Focus of Attention , 2007, PEACH - Intelligent Interfaces for Museum Visits.

[55]  Marco Mason,et al.  The MIT Museum Glassware Prototype , 2016, ACM Journal on Computing and Cultural Heritage.

[56]  Ming-Chia Chen,et al.  Special interest tour preferences and voluntary simplicity lifestyle , 2008 .

[57]  Lori L. Scarlatos,et al.  TICLE: a tangible interface for collaborative learning environments , 1999, CHI Extended Abstracts.

[58]  Tsvi Kuflik,et al.  Early detection of museum visitors identities by using a museum triage , 2012, UMAP Workshops.

[59]  Ruck Thawonmas,et al.  A Movement Data Analysis and Synthesis Tool for Museum Visitors' Behaviors , 2009, PCM.

[60]  Tsvi Kuflik,et al.  Personalization in cultural heritage: the road travelled and the one ahead , 2011, User Modeling and User-Adapted Interaction.

[61]  Eero Hyvönen,et al.  SMARTMUSEUM: A mobile recommender system for the Web of Data , 2013, J. Web Semant..

[62]  Jane Hunter,et al.  Documenting and sharing comparative analyses of 3D digital museum artifacts through semantic web annotations , 2013, JOCCH.

[63]  Ranveer Chandra,et al.  Empowering developers to estimate app energy consumption , 2012, Mobicom '12.

[64]  Tsvi Kuflik,et al.  A visitor's guide in an active museum: Presentations, communications, and reflection , 2011, JOCCH.

[65]  W. Tschacher,et al.  The Physiology of Phenomenology: The Effects of Artworks , 2012 .

[66]  Josep Blat,et al.  An Analysis of Visitors' Behavior in the Louvre Museum: A Study Using Bluetooth Data , 2014, ArXiv.

[67]  Adam C. Winstanley,et al.  Indoor location based services challenges, requirements and usability of current solutions , 2017, Comput. Sci. Rev..

[68]  Ching-Sheng Wang,et al.  Intuitional 3D Museum Navigation System Using Kinect , 2013, ITCS.

[69]  Katerina Kabassi.  Personalisation Systems for Cultural Tourism , 2013 .

[70]  Yung-Hui Chen,et al.  A recommendation system based on mining human portfolio for museum navigation , 2016, Evolving Systems.

[71]  Luca Chittaro,et al.  A visual tool for tracing users' behavior in Virtual Environments , 2004, AVI.

[72]  Adrienne Fletcher,et al.  Current social media uses and evaluations in American museums , 2012 .

[73]  Maarten van Steen,et al.  Visualizing, clustering, and predicting the behavior of museum visitors , 2017, Pervasive Mob. Comput..

[74]  Chih-Ming Chen,et al.  Interactive augmented reality system for enhancing library instruction in elementary schools , 2013, Comput. Educ..

[75]  J. Falk,et al.  The Museum Experience , 1992 .

[76]  C. Shaw,et al.  Building Great Customer Experiences , 2002 .

[77]  Jie Liu,et al.  The Microsoft Indoor Localization Competition: Experiences and Lessons Learned , 2017, IEEE Signal Process. Mag..

[78]  Tsvi Kuflik,et al.  Analyzing Museum Visitors' Behavior Patterns , 2007, User Modeling.

[79]  Stephen Bitgood.  ENVIRONMENTAL PSYCHOLOGY IN MUSEUMS, ZOOS, AND OTHER EXHIBITION CENTERS , 2002 .

[80]  Po-Sen Huang,et al.  Multimedia augmented reality information system for museum guidance , 2013, Personal and Ubiquitous Computing.

[81]  Fernando Vilariño,et al.  Low Cost Eye Tracking: The Current Panorama , 2016, Comput. Intell. Neurosci..

[82]  Marek Hatala,et al.  Ontology-Based User Modeling in an Augmented Audio Reality System for Museums , 2005, User Modeling and User-Adapted Interaction.

[83]  Thomas Widlok,et al.  Potentials and Limitations of Mobile Eye Tracking in Visitor Studies , 2013 .

[84]  Giuseppe Conti,et al.  DentroTrento: a virtual walk across history , 2006, AVI '06.

[85]  Oliver Bimber,et al.  Enabling Mobile Phones To Support Large-Scale Museum Guidance , 2007, IEEE MultiMedia.

[86]  Lidia Fuentes,et al.  iMuseumA: An Agent-Based Context-Aware Intelligent Museum System , 2014, Sensors.

[87]  Mirjana Spasojevic,et al.  A Study of an Augmented Museum Experience , 2001 .

[88]  Marek Hatala,et al.  Situated play in a tangible interface and adaptive audio museum guide , 2007, Personal and Ubiquitous Computing.

[89]  Joonho Kwon,et al.  NeuroWander: a BCI game in the form of interactive fairy tale , 2010, UbiComp '10 Adjunct.

[90]  Chris Dede,et al.  Augmented Reality Teaching and Learning , 2014 .

[91]  Stefano Levialdi,et al.  "Art-sonomy": Social Bookmarking of Real Artworks via Mobile Applications with Visual Tags , 2009, HCI.

[92]  Marcus Specht,et al.  A Nomadic Information System for Adaptive Exhibition Guidance , 1999, Arch. Mus. Informatics.

[93]  Lora Aroyo,et al.  Semantics : Science , Services and Agents on the World Wide Web , 2008 .

[94]  Ingrid Zukerman,et al.  Realistic simulation of museum visitors' movements as a tool for assessing sensor-based user models , 2012, UMAP.

[95]  Tsvi Kuflik,et al.  Automatic Detection of Social Behavior of Museum Visitor Pairs , 2014, ACM Trans. Interact. Intell. Syst..

[96]  Fabio Paternò,et al.  UbiCicero: A location-aware, multi-device museum guide , 2009, Interact. Comput..

[97]  RAFFAELE BRUNO,et al.  Bluetooth: Architecture, Protocols and Scheduling Algorithms , 2004, Cluster Computing.

[98]  Oge Marques.  Visual Information Retrieval: The State of the Art , 2016, IT Professional.

[99]  Tsvi Kuflik,et al.  Adaptive, intelligent presentation of information for the museum visitor in PEACH , 2007, User Modeling and User-Adapted Interaction.

[100]  Hanna Balakhontseva,et al.  WEB-SERVER APPLICATION FOR FAST AND ROBUST RECOGNITION OF EXHIBITS IN THE MUSEUM , 2014 .

[101]  Dirk vom Lehn,et al.  Embodying Experience: A video-based examination of visitors' conduct and interaction in museums. , 2006 .

[102]  Leonard Wein,et al.  Visual recognition in museum guide apps: do visitors want it? , 2014, CHI.

[103]  George Roussos,et al.  Conducting Visitor Studies Using Smartphone-Based Location Sensing , 2015, ACM Journal on Computing and Cultural Heritage.

[104]  Dirk Heylen,et al.  Social Signal Processing: The Research Agenda , 2011, Visual Analysis of Humans.

[105]  Mohan M. Trivedi,et al.  Head Pose Estimation in Computer Vision: A Survey , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[106]  Tsvi Kuflik,et al.  Group Situational Awareness: Being Together , 2009, PMPC@UMAP.

[107]  Oliver Bimber,et al.  Mobile Phone-Enabled Museum Guidance with Adaptive Classification , 2008, IEEE Computer Graphics and Applications.

[108]  Michele Angelaccio,et al.  Smart and Mobile Access to Cultural Heritage Resources: A Case Study on Ancient Italian Renaissance Villas , 2012, 2012 IEEE 21st International Workshop on Enabling Technologies: Infrastructure for Collaborative Enterprises.

[109]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[110]  G. Chiappa,et al.  Emotions and visitors’ satisfaction at a museum , 2014 .

[111]  Ann McNamara,et al.  Enhancing art history education through mobile augmented reality , 2011, VRCAI.

[112]  Jennifer Healey.  Physiological Sensing of Emotion , 2015 .

[113]  Tsvi Kuflik,et al.  Visualizing museum visitors’ behavior: Where do they go and what do they do there? , 2017, Personal and Ubiquitous Computing.

[114]  Lora Aroyo,et al.  Enhancing Content-Based Recommendation with the Task Model of Classification , 2010, EKAW.

[115]  Tsvi Kuflik,et al.  Using Eye-Tracking for Enhancing the Museum Visit Experience , 2016, AVI.

[116]  Yang Wang,et al.  Personalization and privacy: a survey of privacy risks and remedies in personalization-based systems , 2012, User Modeling and User-Adapted Interaction.

[117]  Jorge García Duque,et al.  REENACT: A step forward in immersive learning about Human History by augmented reality, role playing and social networking , 2014, Expert Syst. Appl..

[118]  David A. Shamma,et al.  Buzz: telling compelling stories , 2006, MM '06.

[119]  Daniela D'Auria,et al.  E.Y.E. C. U.: an Emotional eYe trackEr for Cultural heritage sUpport , 2016 .

[120]  Paolo Montuschi,et al.  Experiencing Indoor Navigation on Mobile Devices , 2014, IT Professional.

[121]  G. Black.  The Engaging Museum: Developing Museums for Visitor Involvement , 2005 .