Aesthetic perception of visual textures: a holistic exploration using texture analysis, psychological experiment, and perception modeling

Modeling human aesthetic perception of visual textures is important and valuable in numerous industrial domains, such as product design, architectural design, and decoration. Based on results from a semantic differential rating experiment, we modeled the relationship between low-level basic texture features and aesthetic properties involved in human aesthetic texture perception. First, we compute basic texture features from textural images using four classical methods. These features are neutral, objective, and independent of the socio-cultural context of the visual textures. Then, we conduct a semantic differential rating experiment to collect from evaluators their aesthetic perceptions of selected textural stimuli. In semantic differential rating experiment, eights pairs of aesthetic properties are chosen, which are strongly related to the socio-cultural context of the selected textures and to human emotions. They are easily understood and connected to everyday life. We propose a hierarchical feed-forward layer model of aesthetic texture perception and assign 8 pairs of aesthetic properties to different layers. Finally, we describe the generation of multiple linear and non-linear regression models for aesthetic prediction by taking dimensionality-reduced texture features and aesthetic properties of visual textures as dependent and independent variables, respectively. Our experimental results indicate that the relationships between each layer and its neighbors in the hierarchical feed-forward layer model of aesthetic texture perception can be fitted well by linear functions, and the models thus generated can successfully bridge the gap between computational texture features and aesthetic texture properties.

[1]  Theo Gevers,et al.  Texture affects color emotion , 2011 .

[2]  S. Zeki,et al.  The brain's specialized systems for aesthetic and perceptual judgment , 2013, The European journal of neuroscience.

[3]  Dong Wei,et al.  Product color design based on multi-emotion , 2013 .

[4]  J. Macgregor,et al.  Image texture analysis: methods and comparisons , 2004 .

[5]  Hannes P. Saal,et al.  Natural scenes in tactile texture. , 2014, Journal of neurophysiology.

[6]  Vittorio Castelli,et al.  Image Databases: Search and Retrieval of Digital Imagery , 2002 .

[7]  Edwin Lughofer,et al.  Modeling human aesthetic perception of visual textures , 2008, ACM Trans. Appl. Percept..

[8]  Deng Cai,et al.  Laplacian Score for Feature Selection , 2005, NIPS.

[9]  Östen Axelsson,et al.  Individual differences in preferences to photographs , 2007 .

[10]  Mitsuhiko Hanada,et al.  Analyses of color emotion for color pairs with independent component analysis and factor analysis , 2013 .

[11]  Larry S. Davis,et al.  Texture Analysis Using Generalized Co-Occurrence Matrices , 1979, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  L. Ou,et al.  A study of colour emotion and colour preference. Part II: Colour emotions for two‐colour combinations , 2004 .

[13]  Wolfgang Heidl,et al.  A Quantitative Evaluation of Texture Feature Robustness and Interpolation Behaviour , 2009, CAIP.

[14]  Karen B. Schloss,et al.  Visual aesthetics and human preference. , 2013, Annual review of psychology.

[15]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.

[16]  Ferat Sahin,et al.  A survey on feature selection methods , 2014, Comput. Electr. Eng..

[17]  James Ze Wang,et al.  Studying Aesthetics in Photographic Images Using a Computational Approach , 2006, ECCV.

[18]  L. Ou,et al.  A cross‐cultural comparison of colour emotion for two‐colour combinations , 2012 .

[19]  Eduard Montseny,et al.  Variability estimation of hue and saturation components in the HSV space , 2012 .

[20]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[21]  A. Chatterjee,et al.  Neuroaesthetics , 2014, Trends in Cognitive Sciences.

[22]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[23]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[24]  Parham Moradi,et al.  An unsupervised feature selection algorithm based on ant colony optimization , 2014, Eng. Appl. Artif. Intell..

[25]  William Robson Schwartz,et al.  Multi-scale gray level co-occurrence matrices for texture description , 2013, Neurocomputing.

[26]  B. H. McCormick,et al.  ANALYSIS OF TEXTURE. , 1972 .

[27]  L. Ou,et al.  A study of colour emotion and colour preference. Part I: Colour emotions for single colours , 2004 .

[28]  Andrea Baraldi,et al.  An investigation of the textural characteristics associated with gray level cooccurrence matrix statistical parameters , 1995, IEEE Transactions on Geoscience and Remote Sensing.

[29]  F. Parmiggiani,et al.  An investigation of the textural characteristics associated with gray level cooccurrence matrix statistical parameters , 1995, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Gabriel Gasque,et al.  Small molecule drug screening in Drosophila identifies the 5HT2A receptor as a feeding modulation target , 2013, Scientific Reports.

[31]  Xianyi Zeng,et al.  Wavelet energy signatures and robust Bayesian neural network for visual quality recognition of nonwovens , 2011, Expert Syst. Appl..

[32]  D. Simmons Colour and emotion , 2011 .

[33]  Edwin Lughofer,et al.  Associating visual textures with human perceptions using genetic algorithms , 2010, Inf. Sci..

[34]  S. Sitharama Iyengar,et al.  Recognition in the wavelet domain: A survey , 2001, J. Electronic Imaging.

[35]  Alexander C. Loui,et al.  Automatic aesthetic value assessment in photographic images , 2010, 2010 IEEE International Conference on Multimedia and Expo.

[36]  T. Gevers,et al.  Emotional effects of dynamic textures , 2011, i-Perception.

[37]  H. Leder,et al.  A model of aesthetic appreciation and aesthetic judgments. , 2004, British journal of psychology.

[38]  Giovanni Pilato,et al.  Binding representational spaces of colors and emotions for creativity , 2013, BICA 2013.

[39]  Chie Muraki Asano,et al.  Analysis of texture characteristics associated with visual complexity perception , 2012 .

[40]  W. Chu Studying Aesthetics in Photographic Images Using a Computational Approach , 2013 .

[41]  C. Mirasso,et al.  Dynamics of brain networks in the aesthetic appreciation , 2013, Proceedings of the National Academy of Sciences.

[42]  H. Leder,et al.  How art is appreciated. , 2012 .

[43]  Wei-Yin Loh,et al.  Classification and regression trees , 2011, WIREs Data Mining Knowl. Discov..

[44]  Jinwen Ma,et al.  Wavelet-Based Image Texture Classification Using Local Energy Histograms , 2011, IEEE Signal Processing Letters.

[45]  Yaliang Chuang,et al.  How to Rate 100 Visual Stimuli Efficiently , 2008 .

[46]  Minh N. Do,et al.  Wavelet-based texture retrieval using generalized Gaussian density and Kullback-Leibler distance , 2002, IEEE Trans. Image Process..

[47]  Hideyuki Tamura,et al.  Textural Features Corresponding to Visual Perception , 1978, IEEE Transactions on Systems, Man, and Cybernetics.

[48]  B. Berglund,et al.  Feeling Small: Exploring the Tactile Perception Limits , 2013, Scientific Reports.

[49]  Daniel J Graham,et al.  Artistic representations: Clues to efficient coding in human vision , 2011, Visual Neuroscience.

[50]  Edwin Lughofer,et al.  Evolving Fuzzy Systems - Methodologies, Advanced Concepts and Applications , 2011, Studies in Fuzziness and Soft Computing.

[51]  Anil K. Jain,et al.  Is there any texture in the image? , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[52]  Semir Zeki Trying to make sense of art , 2002, Nature.

[53]  Hod Lipson,et al.  Distilling Free-Form Natural Laws from Experimental Data , 2009, Science.

[54]  Peer F. Bundgaard Feeling, meaning, and intentionality—a critique of the neuroaesthetics of beauty , 2015 .

[55]  Christian Eitzinger,et al.  Making Tactile Textures with Predefined Affective Properties , 2014, IEEE Transactions on Affective Computing.

[56]  Joseph P. Huston,et al.  The neural foundations of aesthetic appreciation , 2011, Progress in Neurobiology.

[57]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .