Understanding gloss perception through the lens of art: Combining perception, image analysis, and painting recipes of 17th century painted grapes.

To understand the key image features that we use to infer the glossiness of materials, we analyzed the pictorial shortcuts used by 17th century painters to imitate the optical phenomenon of specular reflections when depicting grapes. Gloss perception of painted grapes was determined via a rating experiment. We computed the contrast, blurriness, and coverage of the grapes' highlights in the paintings' images, inspired by Marlow and Anderson (2013). The highlights were manually segmented from the images, and next the features contrast, coverage, and blurriness were semiautomatically quantified using self-defined algorithms. Multiple linear regressions of contrast and blurriness resulted in a predictive model that could explain 69% of the variance in gloss perception. No effect was found for coverage. These findings are in agreement with the instructions to render glossiness of grapes contained in a 17th century painting manual (Beurs, 1692/in press), suggesting that painting practice embeds knowledge about key image features that trigger specific material percepts.

[1]  Roland W Fleming,et al.  Real-world illumination and the perception of surface reflectance properties. , 2003, Journal of vision.

[2]  David H Brainard,et al.  Joint effects of illumination geometry and object shape in the perception of surface reflectance , 2011, i-Perception.

[3]  M. Landy,et al.  Conjoint Measurement of Gloss and Surface Texture , 2008, Psychological science.

[4]  Baingio Pinna Art as a scientific object: toward a visual science of art. , 2007, Spatial vision.

[5]  Albert A. Michelson,et al.  XXXVIII. On the application of interference-methods to spectroscopic measurements.—I , 1891 .

[6]  J. Koenderink,et al.  Photometric Invariants Related to Solid Shape , 1980 .

[7]  Edward H. Adelson,et al.  On seeing stuff: the perception of materials by humans and machines , 2001, IS&T/SPIE Electronic Imaging.

[8]  Pascal Barla,et al.  The perception of hazy gloss. , 2017, Journal of vision.

[9]  Sylvia C Pont,et al.  Highlight shapes and perception of gloss for real and photographed objects. , 2016, Journal of vision.

[10]  J. Beck,et al.  Highlights and the perception of glossiness , 1981, Perception & psychophysics.

[11]  E. Mingolla,et al.  Remote Effects of Highlights on Gloss Perception , 2005, Perception.

[12]  Edward H. Adelson,et al.  Do colored highlights look like highlights , 2010 .

[13]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[14]  Fan Zhang,et al.  The influence of lighting on visual perception of material qualities , 2015, Electronic Imaging.

[15]  Maria Olkkonen,et al.  Perceived glossiness and lightness under real-world illumination. , 2010, Journal of vision.

[16]  Barton L Anderson,et al.  Image statistics and the perception of surface gloss and lightness. , 2010, Journal of vision.

[17]  Philip Dutré,et al.  The influence of shape on the perception of material reflectance , 2007, ACM Trans. Graph..

[18]  Andrea J. van Doorn,et al.  Texture, illumination, and material perception , 2015, Electronic Imaging.

[19]  E. Adelson,et al.  Accuracy and speed of material categorization in real-world images. , 2014, Journal of vision.

[20]  P. Mamassian Ambiguities and conventions in the perception of visual art , 2008, Vision Research.

[21]  Koen Janssens,et al.  Jan Davidsz. de Heem (1606–1684): a technical examination of fruit and flower still lifes combining MA-XRF scanning, cross-section analysis and technical historical sources , 2017, Heritage Science.

[22]  R. Pepperell,et al.  Double Vision as a Pictorial Depth Cue , 2013 .

[23]  Barton L Anderson,et al.  Image statistics do not explain the perception of gloss and lightness. , 2009, Journal of vision.

[24]  Gudrun Klinker,et al.  A physical approach to color image understanding , 1989, International Journal of Computer Vision.

[25]  Bevil R. Conway,et al.  Perspectives on science and art , 2007, Current Opinion in Neurobiology.

[26]  Junyu Dong,et al.  Why do rough surfaces appear glossy? , 2014, Journal of the Optical Society of America. A, Optics, image science, and vision.

[27]  Denis G. Pelli,et al.  ECVP '07 Abstracts , 2007, Perception.

[28]  Phillip J. Marlow,et al.  The Perception and Misperception of Specular Surface Reflectance , 2012, Current Biology.

[29]  Patrick Cavanagh,et al.  Reflections in art. , 2008, Spatial vision.

[30]  Donald P. Greenberg,et al.  Psychophysically based model of surface gloss perception , 2001, IS&T/SPIE Electronic Imaging.

[31]  R. S. Hunter,et al.  Methods of determining gloss , 1937 .

[32]  F. Faul,et al.  Increasing the Complexity of the Illumination May Reduce Gloss Constancy , 2017, i-Perception.

[33]  Barton L Anderson,et al.  The dark side of gloss , 2012, Nature Neuroscience.

[34]  S. Pont,et al.  Material — Illumination Ambiguities and the Perception of Solid Objects , 2006, Perception.

[35]  Barton L. Anderson,et al.  Material properties derived from three-dimensional shape representations , 2015, Vision Research.

[36]  H. Ono,et al.  Leonardo da Vinci's Struggles with Representations of Reality , 2001, Leonardo.

[37]  Richard F Murray,et al.  The human visual system's assumption that light comes from above is weak , 2011, Proceedings of the National Academy of Sciences.

[38]  P. Mamassian,et al.  Prior knowledge on the illumination position , 2001, Cognition.

[39]  M. Blanke,et al.  The wax bloom on blueberry: Application of luster sensor technology to assess glossiness and the effect of polishing as a fruit quality parameter , 2017 .

[40]  P. Cavanagh The artist as neuroscientist , 2005, Nature.

[41]  Juno Kim,et al.  Image Statistics and the Fine Lines of Material Perception , 2016, i-Perception.

[42]  Matteo Toscani,et al.  Statistical correlates of perceived gloss in natural images , 2015, Vision Research.

[43]  Arie Wallert,et al.  Still Lifes: Techniques and Style : An Examination of Paintings from the Rijksmuseum , 2000 .

[44]  E. Adelson,et al.  Image statistics and the perception of surface qualities , 2007, Nature.

[45]  Barton L Anderson,et al.  Generative constraints on image cues for perceived gloss. , 2013, Journal of vision.

[46]  Sylvia C Pont,et al.  Illusory gloss on Lambertian surfaces. , 2010, Journal of vision.

[47]  E. Adelson,et al.  Image statistics for surface reflectance perception. , 2008, Journal of the Optical Society of America. A, Optics, image science, and vision.

[48]  Maarten W. A. Wijntjes,et al.  Annotating shadows, highlights and faces: the contribution of a 'human in the loop' for digital art history , 2018, ArXiv.

[49]  A. Torralba,et al.  Specular reflections and the perception of shape. , 2004, Journal of vision.

[50]  Claus-Christian Carbon,et al.  Reliable Top-Left Light Convention Starts With Early Renaissance: An Extensive Approach Comprising 10k Artworks , 2018, Front. Psychol..

[51]  Franz Faul,et al.  Highlight disparity contributes to the authenticity and strength of perceived glossiness. , 2008, Journal of vision.

[52]  J. Enns,et al.  Following the Masters: Portrait Viewing and Appreciation is Guided by Selective Detail , 2013, Perception.

[53]  Phillip J. Marlow,et al.  The perception of gloss depends on highlight congruence with surface shading. , 2011, Journal of vision.

[54]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[55]  M. Blanke,et al.  Non-invasive assessment of glossiness and polishing of the wax bloom of European plum , 2014 .