Evaluating websites of museums: State of the art

Abstract ICTs and the web have changed the way the users interact with museum exhibits providing alternative interactions and many advantages. Indeed, studies have shown a tremendous increase of online museum visitors. However, for a website to attract more visitors to the museum, it should be evaluated as usable and functional. This paper makes a state of the art on the evaluation experiments of museums’ websites. More specifically, it focuses on the methods used and tries to categorize the experiments found in the literature with respect to the method used. It describes the tools that may be used for implementing an evaluation experiment. Emphasis is given on the evaluation of special aspects of the use of ICTs in museums such as the use of handheld devices as well as VR tours. The review concludes on the most common criteria used for the evaluation of museum websites by real or expert users.

[1]  Teresa Numerico,et al.  Personalization Issues for Science Museum Web Sites and E-Learning , 2005 .

[2]  Najmeh Vatankhah,et al.  Usability Measurement of Malaysian Online Tourism Websites , 2014 .

[3]  Fatimah Sidi,et al.  Usability Evaluation of Universities' Websites , 2014 .

[4]  Detmar W. Straub,et al.  Effective website design for experience-influenced environments: The case of high culture museums , 2014, Inf. Manag..

[5]  Justin L. Matthews,et al.  Framing the past: How virtual experience affects bodily description of artefacts , 2016 .

[6]  Fabio Paternò,et al.  UbiCicero: A location-aware, multi-device museum guide , 2009, Interact. Comput..

[7]  P. Marty Museum Websites and Museum Visitors: Before and After the Museum Visit , 2007 .

[8]  David T. Schaller,et al.  Exploring Motivational Factors and Visitor Satisfaction in On-line Museum Visits , 2004 .

[9]  Clayton Lewis,et al.  TASK-CENTERED USER INTERFACE DESIGN A Practical Introduction , 2006 .

[10]  Rob Law,et al.  Evaluation of Usability: A Study of Hotel Web Sites in Hong Kong , 2006 .

[11]  Mike Sharples,et al.  Meeting the Challenges in Evaluating Mobile Learning: A 3-Level Evaluation Framework , 2009, Int. J. Mob. Blended Learn..

[12]  Christopher Power,et al.  Measuring the Usability of a Smartphone Delivered Museum Guide , 2013 .

[13]  Damian Schofield,et al.  A virtual perspective: measuring engagement and perspective in virtual art galleries , 2016, Int. J. Arts Technol..

[14]  J. Chadwick A survey of characteristics and patterns of behavior in visitors to a museum web site , 1998 .

[15]  Margee Hume,et al.  Building the sustainable iMuseum: is the virtual museum leaving our museums virtually empty? , 2011 .

[16]  Gilles Falquet,et al.  Testing the Usability of Information Visualization Techniques in Interactive 3D Virtual Environments: a Toolkit , 2010 .

[17]  Jianhua Ma,et al.  iMuseum: A scalable context-aware intelligent museum system , 2008, Comput. Commun..

[18]  Douglas Tudhope,et al.  Usability Evaluation for Museum Web Sites , 2001 .

[19]  Helen Petrie,et al.  The Evaluation of Accessibility, Usability, and User Experience , 2009, The Universal Access Handbook.

[20]  Chyuan Perng,et al.  A strategic framework for website evaluation based on a review of the literature from 1995-2006 , 2010, Inf. Manag..

[21]  Layla Hasan,et al.  Heuristic Evaluation of Three Jordanian University Websites , 2013, Informatics Educ..

[22]  Sylaiou Styliani,et al.  Virtual museums, a survey and some issues for consideration , 2009 .

[23]  Alistair G. Sutcliffe,et al.  Heuristic evaluation of virtual reality applications , 2004, Interact. Comput..

[24]  Aleck C. H. Lin,et al.  Designing Websites for Learning and Enjoyment: A study of museum experiences , 2006 .

[25]  R. Reynolds,et al.  Web-based museum trails on PDAs for university-level design students: Design and evaluation , 2010, Comput. Educ..

[26]  Anastasios A. Economides,et al.  Art, science/technology and history museums on the web. , 2008 .

[27]  Irene Lopatovska,et al.  Museum website features, aesthetics, and visitors’ impressions: a case study of four museums , 2015 .

[28]  S. Debowski Knowledge Management , 2005 .

[29]  Mary C. Dyson,et al.  Informing the Design of Web Interfaces to Museum Collections , 2000 .

[30]  Maria Economou,et al.  Promising Beginning? Evaluating Museum Mobile Phone Apps , 2011 .

[31]  Tsvi Kuflik,et al.  Examining proactiveness and choice in a location-aware mobile museum guide , 2011, Interact. Comput..

[32]  Carmelo Ardito,et al.  Enjoying cultural heritage thanks to mobile technology , 2010, INTR.

[33]  J. Falk An Identity‐Centered Approach to Understanding Museum Learning , 2006 .

[34]  Robin D. Mason Evaluating technology - based learning , 1995, Innovative Adult Learning with Innovative Technologies.

[35]  B. Booth Understanding the information needs of visitors to museums , 1998 .

[36]  Frederick G. Conrad,et al.  A heuristic evaluation of a World Wide Web prototype , 1996, INTR.

[37]  Michail N. Giannakos,et al.  Does informal learning benefit from interactivity? The effect of trial and error on knowledge acquisition during a museum visit , 2013, Int. J. Mob. Learn. Organisation.

[38]  Emmanuel Maravelakis,et al.  Analysing User Needs for a Unified 3D Metadata Recording and Exploitation of Cultural Heritage Monuments System , 2013, ISVC.

[39]  J. Falk,et al.  Learning from Museums: Visitor Experiences and the Making of Meaning , 2000 .

[41]  Samantha Kelly Hastings,et al.  Informational Value of Museum Web Sites , 2002, First Monday.

[42]  Bo Zhang,et al.  Communicating Art, Virtually! Psychological Effects of Technological Affordances in a Virtual Museum , 2015, Int. J. Hum. Comput. Interact..

[43]  Peter Lonsdale,et al.  Myartspace: Design and evaluation of support for learning with multimedia phones between classrooms and museums , 2009, Comput. Educ..

[44]  Martin White,et al.  Usability Evaluation of a Virtual Museum Interface , 2006, Informatica.

[45]  Robert D. Macredie,et al.  The assessment of usability of electronic shopping: A heuristic evaluation , 2005, Int. J. Inf. Manag..

[46]  Alistair G. Sutcliffe,et al.  Evaluating the usability of virtual reality user interfaces , 2000, Behav. Inf. Technol..

[47]  P. Marty My lost museum: User expectations and motivations for creating personal digital collections on museum websites , 2011 .

[48]  David N. Chin Empirical Evaluation of User Models and User-Adapted Systems , 2001, User Modeling and User-Adapted Interaction.

[49]  Massimo Zancanaro,et al.  PEACH - Intelligent Interfaces for Museum Visits , 2007, Cognitive Technologies.

[50]  Mike Sharples,et al.  Challenges in Evaluating Mobile Learning , 2008 .

[51]  Franca Garzotto,et al.  A systematic method for hypermedia usability evaluation , 1997, New Rev. Hypermedia Multim..

[52]  Amy Grack Nelson,et al.  Data Collection Methods for Evaluating Museum Programs and Exhibitions , 2015 .

[53]  N. Tractinsky,et al.  What is beautiful is usable , 2000, Interact. Comput..

[54]  Shirley Gregor,et al.  Understanding web enjoyment experiences and informal learning: A study in a museum context , 2012, Decis. Support Syst..

[55]  S. Shyam Sundar,et al.  User Engagement with Interactive Media: A Communication Perspective , 2016, Why Engagement Matters.

[56]  Elena Navarro,et al.  Digital ants as the best cicerones for museum visitors , 2011, Appl. Soft Comput..

[57]  Katerina Mania,et al.  Usability Evaluation of Virtual Museums' Interfaces Visualization Technologies , 2014, HCI.

[58]  Anastasios A. Economides,et al.  Evaluation of art museums' web sites worldwide , 2008, Inf. Serv. Use.

[59]  Konstantinos Oikonomou,et al.  Efficient and realistic cultural heritage representation in large scale virtual environments , 2014, IISA 2014, The 5th International Conference on Information, Intelligence, Systems and Applications.

[60]  S. Sarraf A Survey of Museums on the Web: Who Uses Museum Websites? , 1999 .

[61]  Katerina Mania,et al.  Exploring the educational impact of diverse technologies in online virtual museums , 2017, Int. J. Arts Technol..

[62]  Jakob Nielsen,et al.  Heuristic evaluation of user interfaces , 1990, CHI '90.

[63]  Alexandre N. Tuch,et al.  The role of visual complexity and prototypicality regarding first impression of websites: Working towards understanding aesthetic judgments , 2012, Int. J. Hum. Comput. Stud..

[64]  Werner Schweibenz,et al.  Evaluating the usability of a museum web site , 2001 .