Automatic Analysis of Eye-Tracking Data for Augmented Reality Applications: A Prospective Outlook

Eye-tracking technology is becoming easier and cheaper to use, resulting in its increasing application to numerous fields of research. Recent years have seen rapid developments in this area. In light of the foregoing, in the context of Cultural Heritage (CH), the definition of a modern approach to understand how individuals perceive art is challenging. Despite the art perception is highly subjective and variable according to knowledge and experience, more recently, several scientific study and enterprises started to quantify how subjects observe art by the application of the eye-tracking technology. The aim of this study was to understand the visual behaviour of subjects looking at paintings, using eye-tracking technology, in order to define a protocol for optimizing an existing Augmented Reality (AR) application that allows the visualization of digital contents through a display. The stimuli used are three famous paintings preserved at the National Gallery of Marche (Urbino, Marche Region, Italy). We applied eye-tracking to have a deeper understanding of people visual activities in front of these paintings and to analyse how digital contents eventually influence their behaviour. The description of the applied procedure and the preliminary results are presented.

[1]  Sarah Kenderdine,et al.  Theorizing Digital Cultural Heritage: A Critical Discourse (Media in Transition) , 2007 .

[2]  C. Redies,et al.  Statistical regularities in art: Relations with visual coding and perception , 2010, Vision Research.

[3]  Sofia Pescarin,et al.  Archeovirtual 2011: An evaluation approach to virtual museums , 2012, 2012 18th International Conference on Virtual Systems and Multimedia.

[4]  Volker Paelke,et al.  Augmented Reality Visualization of Archeological Data , 2014 .

[5]  V. Gallese,et al.  When Art Moves the Eyes: A Behavioral and Eye-Tracking Study , 2012, PloS one.

[6]  John Krogstie,et al.  Mobile augmented reality for cultural heritage: A technology acceptance study , 2012, 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[7]  Eva Hornecker,et al.  Lessons from an AR book study , 2007, TEI.

[8]  Nikos K. Logothetis,et al.  Intracortical recordings and fMRI: An attempt to study operational modules and networks simultaneously , 2012, NeuroImage.

[9]  Fiona R. Cameron,et al.  Theorizing Digital Cultural Heritage : a Critical Discourse , 2007 .

[10]  Mary M Hayhoe,et al.  Task and context determine where you look. , 2016, Journal of vision.

[11]  Roberto Pierdicca,et al.  Robust and affordable retail customer profiling by vision and radio beacon sensor fusion , 2016, Pattern Recognit. Lett..

[12]  Ramona Quattrini,et al.  Augmented Reality Experience: From High-Resolution Acquisition to Real Time Augmented Contents , 2014, Adv. Multim..

[13]  Duane E. Lundy,et al.  How Important is Beauty to You? The Development of the Desire for Aesthetics Scale , 2010 .

[14]  Ramona Quattrini,et al.  Advanced Interaction with Paintings by Augmented Reality and High Resolution Visualization: A Real Case Exhibition , 2015, AVR.

[15]  Josep Blat,et al.  New Tools for Studying Visitor Behaviours in Museums: A Case Study at the Louvre , 2012, ENTER.

[16]  Ioannis Fudos,et al.  AR-TagBrowse: Annotating and Browsing 3D Objects on Mobile Devices , 2014, Eurographics.

[17]  Stephan Schwan,et al.  Use of digital guides in museum galleries: Determinants of information selection , 2016, Comput. Hum. Behav..

[18]  Simon J. Julier,et al.  Tracking: how hard can it be? , 2002, IEEE Computer Graphics and Applications.

[19]  Page Widick,et al.  The Assessment of Art Attributes , 2010 .

[20]  Roberto Pierdicca,et al.  Low cost embedded system for increasing retail environment intelligence , 2015, 2015 IEEE International Conference on Multimedia & Expo Workshops (ICMEW).

[21]  R. Quiroga,et al.  How Do We See Art: An Eye-Tracker Study , 2011, Front. Hum. Neurosci..

[22]  Andrew T. Duchowski Acuity-matching resolution degradation through wavelet coefficient scaling , 2000, IEEE Trans. Image Process..

[23]  G. Kreiman,et al.  Face Recognition: Vision and Emotions beyond the Bubble , 2011, Current Biology.

[24]  A. Damala,et al.  Tailoring the Adaptive Augmented Reality (A2R) museum visit: Identifying Cultural Heritage professionals' motivations and needs , 2012, 2012 IEEE International Symposium on Mixed and Augmented Reality - Arts, Media, and Humanities (ISMAR-AMH).

[25]  Hirokazu Kato,et al.  Marker tracking and HMD calibration for a video-based augmented reality conferencing system , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).