Impact of machine learning on improvement of user experience in museums

Utilizing new technologies is the key to improve user experience in museums. Natural and unobtrusive methods like those offered by machine learning approaches are more desired by users. So far, the research on machine learning applications in museums is mostly limited to art authentication, guiding and virtual reality. Yet, machine learning has powerful methods to extract information from any type of data and therefore there are other interesting applications which can have a significant effect on museum experience. The current work is an attempt to find an abstract and yet elaborate view into the existing machine learning applications in museums in general and automatic guide methods in particular. To do so, applications are grouped into different categories and for each category the usefulness of applying machine learning along with the existing methods, if any, are presented. Furthermore, a precise explanation on new directions accompanied by examples is provided. We expect this paper to be of interest to the machine learning researchers since it provides a guideline to proper directions of research in this realm.

[1]  Won S. Kim.  Computer vision assisted virtual reality calibration , 1999, IEEE Trans. Robotics Autom..

[2]  Alberto Del Bimbo,et al.  Real-time Wearable Computer Vision System for Improved Museum Experience , 2016, ACM Multimedia.

[3]  Lora Aroyo,et al.  Interactive User Modeling for Personalized Access to Museum Collections: The Rijksmuseum Case Study , 2007, User Modeling.

[4]  Joo-Hwee Lim,et al.  Scene Recognition with Camera Phones for Tourist Information Access , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[5]  Oliver Bimber,et al.  PhoneGuide: museum guidance supported by on-device object recognition on mobile phones , 2005, MUM '05.

[6]  Bo Ejstrud.  Visitor Numbers and Feasibility Studies. Predicting Visitor Numbers to Danish Open‐air Museums using GIS and Multivariate Statistics , 2006 .

[7]  Luc Van Gool,et al.  Interactive Museum Guide: Accurate Retrieval of Object Descriptions , 2006, Adaptive Multimedia Retrieval.

[8]  Effrosini Kokiopoulou,et al.  Mobile Museum Guide Based on Fast SIFT Recognition , 2008, Adaptive Multimedia Retrieval.

[9]  Alberto Del Bimbo,et al.  Personalized multimedia content delivery on an interactive table by passive observation of museum visitors , 2014, Multimedia Tools and Applications.

[10]  Deborah M. Gordon,et al.  Seeing the forest and the trees , 2012 .

[11]  Yael Edan,et al.  Vision-based hand-gesture applications , 2011, Commun. ACM.

[12]  Jie Liu,et al.  A realistic evaluation and comparison of indoor location technologies: experiences and lessons learned , 2015, IPSN.

[13]  Fahad Shahbaz Khan,et al.  Combining Holistic and Part-based Deep Representations for Computational Painting Categorization , 2016, ICMR.

[14]  Ramón Galán,et al.  An Emotional Model for a Guide Robot , 2010, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[15]  Alberto Del Bimbo,et al.  MNEMOSYNE: Enhancing the Museum Experience through Interactive Media and Visual Profiling , 2011, MM4CH.

[16]  Shannon M. Hughes,et al.  Detection of forgery in paintings using supervised learning , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[17]  Maria Luce Lupetti,et al.  Robots and Cultural Heritage: New Museum Experiences , 2015 .

[18]  Alberto Del Bimbo,et al.  Imaging Novecento. A Mobile App for Automatic Recognition of Artworks and Transfer of Artistic Styles , 2016, EuroMed.

[19]  Jia Li,et al.  Image processing for artist identification , 2008, IEEE Signal Processing Magazine.

[20]  Josep Blat,et al.  An Analysis of Visitors' Behavior in the Louvre Museum: A Study Using Bluetooth Data , 2014, ArXiv.

[21]  Richard Taylor,et al.  Authenticating Pollock paintings using fractal geometry , 2007, Pattern Recognit. Lett..

[22]  Morten Nielsen,et al.  Authentication of paintings using hidden markov modelling of contourlet coefficients , 2011 .

[23]  Wolfram Burgard,et al.  The Interactive Museum Tour-Guide Robot , 1998, AAAI/IAAI.

[24]  Leonard Wein,et al.  Visual recognition in museum guide apps: do visitors want it? , 2014, CHI.

[25]  J. M. Hughes,et al.  Quantification of artistic style through sparse coding analysis in the drawings of Pieter Bruegel the Elder , 2010, Proceedings of the National Academy of Sciences.

[26]  Marios Savvides,et al.  Simultaneous forgery identification and localization in paintings using advanced correlation filters , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[27]  Alberto Del Bimbo,et al.  Passive Profiling and Natural Interaction Metaphors for Personalized Multimedia Museum Experiences , 2013, ICIAP Workshops.

[28]  Wolfram Burgard,et al.  Probabilistic Algorithms and the Interactive Museum Tour-Guide Robot Minerva , 2000, Int. J. Robotics Res..

[29]  Oliver Bimber,et al.  Mobile Phone-Enabled Museum Guidance with Adaptive Classification , 2008, IEEE Computer Graphics and Applications.

[30]  Siwei Lyu,et al.  A digital technique for art authentication , 2004, Proc. Natl. Acad. Sci. USA.