D9.1 –Evaluation Framework and Guidelines

This deliverable presents the framework for evaluating the EMOTIVE experiences and related guidelines for carrying this out at the different stages of the project. It includes both the formative and summative stages of evaluation work, as well as detailed plans for the evaluation of the alpha, beta, and final release EMOTIVE tools and experiences. It is divided in two main parts: a) the evaluation of EMOTIVE authoring; and b) the evaluation of EMOTIVE experiencing. The framework integrates qualitative and quantitative methods and empirical studies. The evaluation plans are a ‘living document’ in the sense that they are not set in stone but can be adjusted if the future evaluation work brings up the need for adjusting or extending the framework.

[1]  F. Kiesler.  Contemporary art applied to the store and its display , 1930 .

[2]  F. Tilden.  Interpreting our heritage : principles and practices for visitor services in parks, museums, and historic places , 1957 .

[3]  Dennis Tsichritzis,et al.  Virtual Museums and Virtual Realities , 1991, ICHIM.

[4]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[5]  PETER WALSH,et al.  The Web and the Unassailable Voice , 1997, Arch. Mus. Informatics.

[6]  R. Ballantyne,et al.  Heritage that hurts: interpretation in a post-modern world , 1998 .

[7]  Maria Roussou.  The Interplay between Form, Story, and History : The Use of Narrative in Cultural and Educational Virtual Reality , 2001, International Conference on Virtual Storytelling.

[8]  A. Pekarik.  FEELING OR LEARNING , 2002 .

[9]  Kristian T. Simsarian,et al.  Take it to the next stage: the roles of role playing in the design process , 2003, CHI Extended Abstracts.

[10]  R. Butler,et al.  The core of heritage tourism , 2003 .

[11]  Antti Oulasvirta,et al.  Understanding contexts by being there: case studies in bodystorming , 2003, Personal and Ubiquitous Computing.

[12]  H. Leahy.  Resonance and Wonder , 2006 .

[13]  M. Economou.  A world of interactive exhibits , 2007 .

[14]  W. Schweibenz.  Know Thy Visitors: Personas for Visitor-centered Museums , 2008 .

[15]  C. Boxtel,et al.  Bridges to the Past: Historical Distance and Multiperspectivity in English and Dutch Heritage Educational Resources , 2009 .

[16]  N. Bond,et al.  Museums as Restorative Environments , 2010 .

[17]  Nina Simon.  The Participatory Museum , 2010 .

[18]  Laia Pujol.  Realism in virtual reality applications for cultural heritage , 2011 .

[19]  Maria Economou,et al.  Promising Beginning? Evaluating Museum Mobile Phone Apps , 2011 .

[20]  Maria Roussou,et al.  Personalizing Interactive Digital Storytelling in Archaeological Museums: the CHESS Project , 2011 .

[21]  J. Falk,et al.  The Museum Experience Revisited , 2012 .

[22]  M. Savage,et al.  ‘Educative leisure’ and the art museum , 2012 .

[23]  Marco Di Ioia,et al.  The Virtual Museum of the Tiber Valley Project , 2012 .

[24]  Eva Pietroni,et al.  The Etruscanning project: Gesture-based interaction and user experience in the virtual reconstruction of the Regolini-Galassi tomb , 2013, 2013 Digital Heritage International Congress (DigitalHeritage).

[25]  Jaehyun Park,et al.  Modeling user experience: A case study on a mobile device , 2013 .

[26]  Maria Roussou,et al.  A life of their own: museum visitor personas penetrating the design lifecycle of a mobile experience , 2013, CHI Extended Abstracts.

[27]  A. Witcomb.  Understanding the role of affect in producing a critical pedagogy for history museums , 2013 .

[28]  Panagiotis Petridis,et al.  Learning cultural heritage by serious games , 2014 .

[29]  Maria Roussou,et al.  The CHESS Project: Adaptive Personalized Storytelling Experiences in Museums , 2014, UMAP Workshops.

[30]  George Roussos,et al.  Mobile sensing, BYOD and Big Data Analytics: New technologies for audience research in museums , 2014 .

[31]  A. Witcomb.  Toward a pedagogy of feeling: understanding how museums create a space for cross-cultural encounters , 2015 .

[32]  M. Economou.  Heritage in the Digital Age , 2015 .

[33]  Franklin Vagnone,et al.  Anarchist's Guide to Historic House Museums , 2015 .

[34]  S. Watson.  Emotions in the History Museum , 2015 .

[35]  D. Crouch.  Affect, Heritage, Feeling , 2015 .

[36]  E. Hornecker,et al.  The Loupe: tangible augmented reality for learning to look at Ancient Greek art , 2016 .

[37]  Eva Hornecker,et al.  Evaluating tangible and multisensory museum visiting experiences: lessons learned from the meSch project , 2016 .

[38]  Richard E. Sandell.  Museums, Moralities and Human Rights , 2016 .

[39]  Cintia Velázquez Marroni.  Museums and the past: constructing historical consciousness , 2016 .

[40]  A. Franklin,et al.  Engaging with the anti-museum? Visitors to the Museum of Old and New Art , 2017 .

[41]  G. Savenije,et al.  Historical empathy in a museum: uniting contextualisation and emotional engagement , 2017 .

[42]  J. Falk,et al.  The Role of Emotion in Informal Science Learning: Testing an Exploratory Model , 2017 .

[43]  C. A. Santos,et al.  Exploring the Tourist Experience , 2017 .