What do luthiers look at? An eye tracking study on the identification of meaningful areas in historical violins

Stylistic analysis of artworks is an important practice in the field of Cultural Heritage. Over time, significant stylistic characteristics have been identified for paintings and sculptures, but not for historical musical instruments. Even if various stylistic features of instruments are well known, their importance for attributing an instrument to its maker remains unclear. In this work, we propose a study carried out in relation to 34 luthiers’ examinations recorded with an eye tracker. Our goal was to find which regions of a violin are most closely observed by experts during the attribution process. The retrieved data were used to create a multimedia presentation that shows a violin in the same way in which luthiers look at it. This application can be employed for knowledge dissemination (e.g,. inside museums) or as an educational tool for students of violin making schools. The experiments were carried out on a series of images of 17th-18th century historical violins kept at the “Museo del Violino” in Cremona (Italy).

[1]  Marco Porta,et al.  Playing music with the eyes through an isomorphic interface , 2018, COGAIN@ETRA.

[2]  P. Vik,et al.  Regression, ANOVA, and the General Linear Model: A Statistics Primer , 2013 .

[3]  Luca Lombardi,et al.  Automatic Analysis of UV-Induced Fluorescence Imagery of Historical Violins , 2017, JOCCH.

[4]  Virginio Cantoni,et al.  Eye Tracking for Cultural Heritage: a Gaze-controlled System for Handless Interaction with Artworks , 2016, CompSysTech.

[5]  Towry Piper Violins and Violin Manufacture from the Death of Stradivari to the Present Time , 1898 .

[6]  Styliani Sylaiou,et al.  Exploring roads less traveled: eye tracking in art , 2014 .

[7]  J. Enns,et al.  Rembrandt's Textural Agency: A Shared Perspective in Visual Art and Science , 2010, Leonardo.

[8]  Laura Chamberlain Eye Tracking Methodology; Theory and Practice , 2007 .

[9]  Erica L. Olmsted-Hawala,et al.  Age-Related Differences in Eye Tracking and Usability Performance: Website Usability for Older Adults , 2013, Int. J. Hum. Comput. Interact..

[10]  Frans W Cornelissen,et al.  The Eyelink Toolbox: Eye tracking with MATLAB and the Psychophysics Toolbox , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[11]  Frouke Hermens,et al.  Dummy eye measurements of microsaccades: Testing the influence of system noise and head movements on microsaccade detection in a popular video-based eye tracker , 2015 .

[12]  Luca Lombardi,et al.  3D modelling and measurements of historical violins , 2017 .

[13]  Thomas Kieninger,et al.  Museum Guide 2.0 – An Eye-Tracking based Personal Assistant for Museums and Exhibits , 2011 .

[14]  Ulrich Ansorge,et al.  The influence of color during continuity cuts in edited movies: an eye-tracking study , 2015, Multimedia Tools and Applications.

[15]  Marco Porta,et al.  A study on text entry methods based on eye gestures , 2015 .

[16]  Giuseppe Riva,et al.  Visual exploration patterns of human figures in action: an eye tracker study with art paintings , 2015, Front. Psychol..

[17]  Marco Malagodi,et al.  The elemental composition of Stradivari's musical instruments: new results through non-invasive EDXRF analysis , 2018 .

[18]  Luca Lombardi,et al.  An Interactive Tool for Speed up the Analysis of UV Images of Stradivari Violins , 2015, ICIAP Workshops.

[19]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[20]  R. Pieters,et al.  A Review of Eye-Tracking Research in Marketing , 2008 .

[21]  David S Wooding,et al.  Eye movements of large populations: II. Deriving regions of interest, coverage, and similarity using fixation maps , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[22]  Kang Zhang,et al.  Computational analysis and eye movement experiments of white space in Chinese paintings , 2015, 2015 IEEE International Conference on Progress in Informatics and Computing (PIC).

[23]  A. Damala,et al.  Tailoring the Adaptive Augmented Reality (A2R) museum visit: Identifying Cultural Heritage professionals' motivations and needs , 2012, 2012 IEEE International Symposium on Mixed and Augmented Reality - Arts, Media, and Humanities (ISMAR-AMH).

[24]  Eva Mayr,et al.  Re-viewing the museum visitors view , 2007 .

[25]  Kristien Ooms,et al.  Accuracy and precision of fixation locations recorded with the low-cost Eye Tribe tracker in different experimental set- ups , 2015 .

[26]  H. Leder,et al.  The effects of visual context and individual differences on perception and evaluation of modern art and graffiti art. , 2015, Acta psychologica.

[27]  Thomas Widlok,et al.  Potentials and Limitations of Mobile Eye Tracking in Visitor Studies , 2013 .

[28]  C. Luzzatti,et al.  Phonological rehabilitation in acquired aphasia , 2015 .

[29]  Marco Porta,et al.  Human Neuroscience , 2022 .

[30]  Jason C. Hung,et al.  Tracking students’ visual attention on manga-based interactive e-book while reading: an eye-movement approach , 2018, Multimedia Tools and Applications.

[31]  J. R. Charlier,et al.  Museum application of an eye tracker , 2006, Medical and Biological Engineering and Computing.

[32]  Weidong Huang,et al.  Handbook of Human Centric Visualization , 2013, Springer New York.

[33]  Monica Gulmini,et al.  Spectroscopic Analysis to Characterize Finishing Treatments of Ancient Bowed String Instruments , 2017, Applied spectroscopy.

[34]  Hubert Cecotti,et al.  A Multimodal Gaze-Controlled Virtual Keyboard , 2016, IEEE Transactions on Human-Machine Systems.

[35]  David S Wooding,et al.  Eye movements of large populations: I. Implementation and performance of an autonomous public eye tracker , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[36]  Thomas Armstrong,et al.  Eye tracking of attention in the affective disorders: a meta-analytic review and synthesis. , 2012, Clinical psychology review.

[37]  Panagiotis Petridis,et al.  Learning cultural heritage by serious games , 2014 .

[38]  Daniela D'Auria,et al.  E.Y.E. C. U.: an Emotional eYe trackEr for Cultural heritage sUpport , 2016 .

[39]  Roberto Pierdicca,et al.  A Survey of Augmented, Virtual, and Mixed Reality for Cultural Heritage , 2018, ACM Journal on Computing and Cultural Heritage.

[40]  Ioannis Paliokas,et al.  The Use of Serious Games in Museum Visits and Exhibitions: A Systematic Mapping Study , 2016, 2016 8th International Conference on Games and Virtual Worlds for Serious Applications (VS-GAMES).

[41]  Eghbal-AzarKira,et al.  Potentials and Limitations of Mobile Eye Tracking in Visitor Studies , 2013 .

[42]  Jakob Nielsen,et al.  Eyetracking Web Usability , 2009 .

[43]  Karel Jalovec Beautiful Italian Violins , 1963 .

[44]  Slavko Milekic The More You Look the More You Get: Intention-Based Interface Using Gaze-Tracking. , 2003 .