Interactive, Tangible and Multi-sensory Technology for a Cultural Heritage Exhibition: The Battle of Pavia

New generation multimedia may have a great impact on exhibition visit experience. This contribution focuses on the innovative use of interactive digital technologies in cultural heritage practices. “Live” displays steered by visitors support the creation of various content formats, smartly adapt the content delivered to the visitor, stimulate self-motivated learning, and lead to a memorable and effective experience. Multimodal interaction modalities have been developed for the exhibition “1525–2015. Pavia, the Battle, the Future. Nothing was the same again”, a satellite event of the Universal Exhibition in Milan (Expo 2015). The Computer Vision & Multimedia Lab of the University of Pavia, in cooperation with the Bulgarian Academy of Sciences, in the framework of the European project “Advanced Computing for Innovation”, has contributed to set up the exhibition, enriching an educational and experiential room with products and targeted applications. Visitors can observe and analyze seven ancient tapestries, illustrating different phases of the battle, through 3D reconstructions, virtual simulations, eye interaction and gesture navigation, along with transpositions of the tapestries into tactile images that enable the exploration by partially sighted and blind people. In the near future, we may assess the impact of this interactive experience. Due to the novelty of the approach, new insights can be potentially derived about the effectiveness and manageability of each specific system component. Under this scope, not only the exhibition success is important, but also the augmented learning experience in cultural heritage contexts.

[1]  Areti Damala,et al.  Exploring the Affective Museum Visiting Experience: Adaptive Augmented Reality (A2R) and Cultural Heritage: , 2013 .

[2]  Slavko Milekic Designing digital environments for art education/exploration , 2000 .

[3]  Marco Porta,et al.  Vision-based user interfaces: methods and applications , 2002, Int. J. Hum. Comput. Stud..

[4]  James Ze Wang,et al.  Digital imagery for significant cultural and historical materials , 2005, International Journal on Digital Libraries.

[5]  Zhengyou Zhang,et al.  Microsoft Kinect Sensor and Its Effect , 2012, IEEE Multim..

[6]  Julia Noordegraaf,et al.  Modeling crowdsourcing for cultural heritage , 2014 .

[7]  Marco Porta,et al.  Online newspapers and ad banners: an eye tracking study on the effects of congruity , 2013, Online Inf. Rev..

[8]  M. Just,et al.  Eye fixations and cognitive processes , 1976, Cognitive Psychology.

[9]  Brad A. Myers,et al.  A brief history of human-computer interaction technology , 1998, INTR.

[10]  Luca Lombardi,et al.  Development of gesture-based human-computer interaction applications by fusion of depth and colour video streams , 2014, IET Comput. Vis..

[11]  Linden J. Ball,et al.  Eye tracking in HCI and usability research. , 2006 .

[12]  Larry Johnson,et al.  NMC Horizon Report: 2010 Museum Edition , 2010 .

[13]  Harold Pashler,et al.  Visual attention and eye movements , 2016 .

[14]  Steven Wu,et al.  Digital Heritage and Culture:Strategy and Implementation , 2014 .

[15]  G. Hein Learning in the museum , 1998 .

[16]  S. Jaramillo,et al.  Adams Becker, S.; Cummins, M.; Davis, A.; Freeman, A.; Hall Giesinger, C.; Ananthanarayanan, V. NMC Horizon Report: 2017 Higher Education Edition. Austin, Texas: The New Media Consortium, 2017 , 2017 .

[17]  M A Just,et al.  A theory of reading: from eye fixations to comprehension. , 1980, Psychological review.

[18]  A. L. I︠A︡rbus Eye Movements and Vision , 1967 .

[19]  Virginio Cantoni,et al.  Eye tracking as a computer input and interaction method , 2014, CompSysTech.

[20]  Lisa F. Smith,et al.  Spending Time on Art , 2001 .