Overt visual attention on rendered 3D objects

This work covers multiple aspects of overt visual attention on 3D renders: measurement, projection, visualization, and application to studying the influence of material appearance on looking behaviour. In the scope of this work, we ran an eye-tracking experiment in which the observers are presented with animations of rotating 3D objects. The objects were rendered to simulate different metallic appearance, particularly smooth (glossy), rough (matte), and coated gold. The eye-tracking results illustrate how material appearance itself influences the observer's attention, while all the other parameters remain unchanged. In order to make visualization of the attention maps more natural and also make the analysis more accurate, we develop a novel technique of projection of gaze fixations on the 3D surface of the figure itself, instead of the conventional 2D plane of the screen. The proposed methodology will be useful for further studies of attention and saliency in the computer graphics domain.

[1]  Leonidas J. Guibas,et al.  The Earth Mover's Distance as a Metric for Image Retrieval , 2000, International Journal of Computer Vision.

[2]  Carol O'Sullivan,et al.  Predicting and Evaluating Saliency for Simplified Polygonal Models , 2005, TAP.

[3]  Robert W. Kentridge,et al.  Glossiness perception can be mediated independently of cortical processing of colour or texture , 2012, Cortex.

[4]  Robert J. K. Jacob,et al.  Eye tracking in human-computer interaction and usability research : Ready to deliver the promises , 2002 .

[5]  Lina I. Conlan,et al.  Eye movement patterns during the recognition of three-dimensional objects: preferential fixation of concave surface curvature minima. , 2012, Journal of vision.

[6]  Junyu Dong,et al.  Fusing Visual Saliency for Material Recognition , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[7]  Hiroshi Ando,et al.  Human cortical areas involved in perception of surface glossiness , 2014, NeuroImage.

[8]  A. L. Yarbus,et al.  Eye Movements and Vision , 1967, Springer US.

[9]  Jennifer C. Romano Bergstrom,et al.  Eye tracking in user experience design , 2014 .

[10]  R. Fleming.  Visual perception of materials and their properties , 2014, Vision Research.

[11]  Rafal Mantiuk,et al.  Gaze‐driven Object Tracking for Real Time Rendering , 2013, Comput. Graph. Forum.

[12]  Barton L Anderson,et al.  Visual perception of materials and surfaces , 2011, Current Biology.

[13]  Michael S. Landy,et al.  Visual perception: A gloss on surface properties , 2007, Nature.

[14]  Andrew T. Duchowski,et al.  Eye Movement Analysis , 2017 .

[15]  Iain D. Gilchrist,et al.  Mediaeval artists: Masters in directing the observers' gaze , 2007, Current Biology.

[16]  Mohamed-Chaker Larabi,et al.  Visual Attention for Rendered 3D Shapes , 2018, Comput. Graph. Forum.

[17]  Tommy Strandvall,et al.  Eye Tracking in Human-Computer Interaction and Usability Research , 2009, INTERACT.

[18]  Frédo Durand,et al.  What Do Different Evaluation Metrics Tell Us About Saliency Models? , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  R. W. Kentridge,et al.  The perception of gloss: A review , 2015, Vision Research.

[20]  A. L. I︠A︡rbus.  Eye Movements and Vision , 1967 .

[21]  O. Meur,et al.  Predicting visual fixations on video based on low-level visual features , 2007, Vision Research.

[22]  Marc Alexa,et al.  Tracking the gaze on objects in 3D , 2018, ACM Trans. Graph..

[23]  Linden J. Ball,et al.  An Eye Movement Analysis of Web Page Usability , 2002 .

[24]  Nicolas Riche,et al.  Saliency and Human Fixations: State-of-the-Art and Study of Comparison Metrics , 2013, 2013 IEEE International Conference on Computer Vision.

[25]  David W. Jacobs,et al.  Mesh saliency and human eye fixations , 2010, TAP.

[26]  Andrew J. Stewart,et al.  Integrating text and pictorial information: eye movements when looking at print advertisements. , 2001, Journal of experimental psychology. Applied.

[27]  Carlo Tomasi,et al.  The Earth Mover’s Distance , 2001 .