Aesthetics by Numbers: Links between Perceived Texture Qualities and Computed Visual Texture Properties

Our world is filled with texture. For the human visual system, this is an important source of information for assessing environmental and material properties. Indeed—and presumably for this reason—the human visual system has regions dedicated to processing textures. Despite their abundance and apparent relevance, only recently the relationships between texture features and high-level judgments have captured the interest of mainstream science, despite long-standing indications for such relationships. In this study, we explore such relationships, as these might be used to predict perceived texture qualities. This is relevant, not only from a psychological/neuroscience perspective, but also for more applied fields such as design, architecture, and the visual arts. In two separate experiments, observers judged various qualities of visual textures such as beauty, roughness, naturalness, elegance, and complexity. Based on factor analysis, we find that in both experiments, ~75% of the variability in the judgments could be explained by a two-dimensional space, with axes that are closely aligned to the beauty and roughness judgments. That a two-dimensional judgment space suffices to capture most of the variability in the perceived texture qualities suggests that observers use a relatively limited set of internal scales on which to base various judgments, including aesthetic ones. Finally, for both of these judgments, we determined the relationship with a large number of texture features computed for each of the texture stimuli. We find that the presence of lower spatial frequencies, oblique orientations, higher intensity variation, higher saturation, and redness correlates with higher beauty ratings. Features that captured image intensity and uniformity correlated with roughness ratings. Therefore, a number of computational texture features are predictive of these judgments. This suggests that perceived texture qualities—including the aesthetic appreciation—are sufficiently universal to be predicted—with reasonable accuracy—based on the computed feature content of the textures.

[1]  H. Kaiser The varimax criterion for analytic rotation in factor analysis , 1958 .

[2]  J. M. Kittross The measurement of meaning , 1959 .

[3]  V. Ball The Aesthetics of Color: A Review of Fifty Years of Experimentation , 1965 .

[4]  D. Berlyne Novelty, complexity, and hedonic value , 1970 .

[5]  F. Hutcheson,et al.  An Inquiry concerning Beauty, Order, Harmony, Design , 1974 .

[6]  Richard Bell,et al.  A manual for repertory grid technique , 1977 .

[7]  G. Mandler,et al.  Knowing and liking , 1983 .

[8]  M. Akita,et al.  Objective evaluation of color design , 1987 .

[9]  E. Adelson,et al.  Early vision and texture perception , 1988, Nature.

[10]  S. Dickman Living in a material world , 1988, Nature.

[11]  W. Velicer,et al.  Relation of sample size to the stability of component patterns. , 1988, Psychological bulletin.

[12]  D. Field,et al.  Human discrimination of fractal images. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[13]  C. Martindale,et al.  Aesthetic preference: Anomalous findings for Berlyne's psychobiological theory. , 1990 .

[14]  J. Bergen,et al.  Texture segregation and orientation gradient , 1991, Vision Research.

[15]  B Julesz,et al.  Perceptual asymmetry in texture perception. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[16]  Takeo Watanabe,et al.  Transparent surfaces defined by implicit X junctions , 1993, Vision Research.

[17]  P. Valdez,et al.  Effects of color on emotions. , 1994, Journal of experimental psychology. General.

[18]  S. Takahashi Aesthetic properties of pictorial perception. , 1995, Psychology Review.

[19]  A. Ravishankar Rao,et al.  Towards a texture naming system: Identifying relevant dimensions of texture , 1993, Vision Research.

[20]  Deborah J. Aks,et al.  Quantifying Aesthetic Preference for Chaotic Patterns , 1996 .

[21]  Mary M. Conte,et al.  The role of high-order phase correlations in texture processing , 1996, Vision Research.

[22]  T. Allison,et al.  Differential Sensitivity of Human Visual Cortex to Faces, Letterstrings, and Textures: A Functional Magnetic Resonance Imaging Study , 1996, The Journal of Neuroscience.

[23]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[24]  W. Merigan Cortical area V4 is critical for certain texture discriminations, but this effect is not dependent on attention , 2000, Visual Neuroscience.

[25]  J D Kaufman,et al.  Determining the number of factors to retain: Q windows-based FORTRAN-IMSL program for parallel analysis , 2000, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[26]  A. Stamps Entropy, Visual Diversity, and Preference , 2002, The Journal of general psychology.

[27]  T. Jacobsen,et al.  Descriptive and evaluative judgment processes: Behavioral and electrophysiological indices of processing symmetry and aesthetics , 2003, Cognitive, affective & behavioral neuroscience.

[28]  Ben R. Newell,et al.  Universal aesthetic of fractals , 2003, Comput. Graph..

[29]  Gretchen Schira,et al.  Texture Preference and Global Frequency Magnitudes , 2003 .

[30]  R. Dolan,et al.  Distinct spatial frequency sensitivities for processing faces and emotional expressions , 2003, Nature Neuroscience.

[31]  Bela Julesz,et al.  A theory of preattentive texture discrimination based on first-order statistics of textons , 2004, Biological Cybernetics.

[32]  James C. Hayton,et al.  Factor Retention Decisions in Exploratory Factor Analysis: a Tutorial on Parallel Analysis , 2004 .

[33]  G. Orban,et al.  Attention to 3-D Shape, 3-D Motion, and Texture in 3-D Structure from Motion Displays , 2004, Journal of Cognitive Neuroscience.

[34]  D. Perrett,et al.  The relationship between shape symmetry and perceived skin condition in male facial attractiveness , 2004 .

[35]  Mary M. Conte,et al.  Interaction of luminance and higher-order statistics in texture discrimination , 2005, Vision Research.

[36]  R. Sireteanu,et al.  Children with developmental dyslexia show a left visual “minineglect” , 2005, Vision Research.

[37]  M. Eimer,et al.  The role of spatial frequency information for ERP components sensitive to faces and emotional facial expression. , 2005, Brain research. Cognitive brain research.

[38]  Heinrich H. Bülthoff,et al.  Low-Level Image Cues in the Perception of Translucent Materials , 2005, TAP.

[39]  S. Pont,et al.  Material — Illumination Ambiguities and the Perception of Solid Objects , 2006, Perception.

[40]  D. Yves von Cramon,et al.  Brain correlates of aesthetic judgment of beauty , 2006, NeuroImage.

[41]  Lydia J. Price,et al.  The Impact of Self-Construal on Aesthetic Preference for Angular Versus Rounded Shapes , 2006, Personality & social psychology bulletin.

[42]  M. Landy,et al.  How direction of illumination affects visually perceived surface roughness. , 2006, Journal of vision.

[43]  Ohad Ben-Shahar,et al.  Visual saliency and texture segregation without feature gradient , 2006, Proceedings of the National Academy of Sciences.

[44]  Sung Yong Shin,et al.  On pixel-based texture synthesis by non-parametric sampling , 2006, Comput. Graph..

[45]  C. Redies,et al.  Artists portray human faces with the Fourier statistics of complex natural scenes , 2007, Network.

[46]  M. Bar,et al.  Visual elements of subjective preference modulate amygdala activation , 2007, Neuropsychologia.

[47]  Miguel P Eckstein,et al.  Classification images for simple detection and discrimination tasks in correlated noise. , 2007, Journal of the Optical Society of America. A, Optics, image science, and vision.

[48]  P. Montoya,et al.  Low spatial frequency filtering modulates early brain processing of affective complex pictures , 2007, Neuropsychologia.

[49]  I. Motoyoshi,et al.  Specular reflectance and the perception of metallic surfaces. , 2007 .

[50]  E. Adelson,et al.  Image statistics and the perception of surface qualities , 2007, Nature.

[51]  Jonathan S. Cant,et al.  Cerebral Cortex Advance Access published April 28, 2006 Attention to Form or Surface Properties Modulates Different Regions of Human , 2022 .

[52]  K. Scherer,et al.  Spatial frequencies or emotional effects? A systematic measure of spatial frequencies for IAPS pictures by a discrete wavelet analysis , 2007, Journal of Neuroscience Methods.

[53]  F. Cornelissen,et al.  Feature based prediction of the perceived and aesthetic properties of visual textures , 2008 .

[54]  Edwin Lughofer,et al.  Modeling human aesthetic perception of visual textures , 2008, ACM Trans. Appl. Percept..

[55]  M. Lesch,et al.  Visually based perceptions of slipperiness: Underlying cues, consistency and relationship to coefficient of friction , 2008, Ergonomics.

[56]  M. Carrasco,et al.  On the flexibility of sustained attention and its effects on a texture segmentation task , 2008, Vision Research.

[57]  Huib de Ridder,et al.  Roughness in sound and vision , 2009, Electronic Imaging.

[58]  J. Koeman The impact of self construal on advertising attitudes among ethnic youth , 2009 .

[59]  A. Hollingworth,et al.  Object correspondence across brief occlusion is established on the basis of both spatiotemporal and surface feature cues , 2009, Cognition.

[60]  Jonathan S. Cant,et al.  Living in a material world: how visual cues to material properties affect the way that we lift objects and perceive their weight. , 2009, Journal of neurophysiology.

[61]  M. Webster,et al.  Visual Discomfort and Natural Image Statistics , 2010, Perception.

[62]  C. Redies,et al.  Statistical regularities in art: Relations with visual coding and perception , 2010, Vision Research.

[63]  Richard H. A. H. Jacobs,et al.  Different Judgments about Visual Textures Invoke Different Eye Movement Patterns , 2010 .

[64]  Naokazu Goda,et al.  Transformation from image-based to perceptual representation of materials along the human ventral visual pathway , 2011, NeuroImage.

[65]  Branka Spehar,et al.  Fractals in art and nature: why do we like them? , 2013, Electronic Imaging.

[66]  Christiane B. Wiebel,et al.  Perceptual qualities and material classes. , 2013, Journal of vision.

[67]  Karl R. Gegenfurtner,et al.  The representation of material categories in the brain , 2014, Front. Psychol..

[68]  C. Redies,et al.  Beauty in abstract paintings: perceptual contrast and statistical properties , 2014, Front. Hum. Neurosci..

[69]  Richard P. Taylor,et al.  Beauty and the beholder: the role of visual sensitivity in visual preference , 2015, Front. Hum. Neurosci..

[70]  Xianyi Zeng,et al.  Aesthetic perception of visual textures: a holistic exploration using texture analysis, psychological experiment, and perception modeling , 2015, Front. Comput. Neurosci..

[71]  Margaret E. Sereno,et al.  Aesthetic Responses to Exact Fractals Driven by Physical Complexity , 2016, Front. Hum. Neurosci..

[72]  Richard H. A. H. Jacobs,et al.  Liking versus Complexity: Decomposing the Inverted U-curve , 2016, Front. Hum. Neurosci..

[73]  M. Hulliung The Republic That Was , 2017 .

[74]  C. Weiß On Flexibility , 2022 .