Genetic programming approach to evaluate complexity of texture images

Abstract. We adopt genetic programming (GP) to define a measure that can predict complexity perception of texture images. We perform psychophysical experiments on three different datasets to collect data on the perceived complexity. The subjective data are used for training, validation, and test of the proposed measure. These data are also used to evaluate several possible candidate measures of texture complexity related to both low level and high level image features. We select four of them (namely roughness, number of regions, chroma variance, and memorability) to be combined in a GP framework. This approach allows a nonlinear combination of the measures and could give hints on how the related image features interact in complexity perception. The proposed complexity measure MGP exhibits Pearson correlation coefficients of 0.890 on the training set, 0.728 on the validation set, and 0.724 on the test set. MGP outperforms each of all the single measures considered. From the statistical analysis of different GP candidate solutions, we found that the roughness measure evaluated on the gray level image is the most dominant one, followed by the memorability, the number of regions, and finally the chroma variance.

[1]  Christof Koch,et al.  Advances in Learning Visual Saliency: From Image Primitives to Semantic Contents , 2014 .

[2]  Azriel Rosenfeld,et al.  Visual Texture Analysis: An Overview , 1975 .

[3]  Jianxiong Xiao,et al.  What makes an image memorable , 2011 .

[4]  Bruce Walter,et al.  Dimensionality of visual complexity in computer graphics scenes , 2008, Electronic Imaging.

[5]  D. Chandler Seven Challenges in Image Quality Assessment: Past, Present, and Future Research , 2013 .

[6]  Gianluigi Ciocca,et al.  Does Color Influence Image Complexity Perception? , 2015, CCIW.

[7]  Victor Ciesielski,et al.  Texture Segmentation by Genetic Programming , 2008, Evolutionary Computation.

[8]  Richard Alan Peters,et al.  Image Complexity Metrics for Automatic Target Recognizers , 1990 .

[9]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[10]  Harris Wu,et al.  The effects of fitness functions on genetic programming-based ranking discovery forWeb search , 2004, J. Assoc. Inf. Sci. Technol..

[11]  Shuo Wang,et al.  Predicting human gaze beyond pixels. , 2014, Journal of vision.

[12]  Gianluigi Ciocca,et al.  Complexity Perception of Texture Images , 2015, ICIAP Workshops.

[13]  J. G. Snodgrass,et al.  A standardized set of 260 pictures: norms for name agreement, image agreement, familiarity, and visual complexity. , 1980, Journal of experimental psychology. Human learning and memory.

[14]  Mansour Jamzad,et al.  Estimating Watermarking Capacity in Gray Scale Images Based on Image Complexity , 2010, EURASIP J. Adv. Signal Process..

[15]  Noel Sheehy,et al.  Measuring icon complexity: An automated analysis , 2003, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[16]  Akira Asano,et al.  Visual Complexity Perception and Texture Image Characteristics , 2011, 2011 International Conference on Biometrics and Kansei Engineering.

[17]  Mengjie Zhang,et al.  Reusing Extracted Knowledge in Genetic Programming to Solve Complex Texture Image Classification Problems , 2016, PAKDD.

[18]  Riccardo Poli,et al.  A Field Guide to Genetic Programming , 2008 .

[19]  Bir Bhanu,et al.  Evolutionary feature synthesis for facial expression recognition , 2006, Pattern Recognit. Lett..

[20]  Francesco Bianconi,et al.  Discrimination between tumour epithelium and stroma via perception-based features , 2015, Neurocomputing.

[21]  Stefan Winkler,et al.  Image complexity and spatial information , 2013, 2013 Fifth International Workshop on Quality of Multimedia Experience (QoMEX).

[22]  Hideyuki Tamura,et al.  Textural Features Corresponding to Visual Perception , 1978, IEEE Transactions on Systems, Man, and Cybernetics.

[23]  Gianluigi Ciocca,et al.  Predicting Complexity Perception of Real World Images , 2016, PloS one.

[24]  Chie Muraki Asano,et al.  Analysis of texture characteristics associated with visual complexity perception , 2012 .

[25]  Edward A. Fox,et al.  A genetic programming framework for content-based image retrieval , 2009, Pattern Recognit..

[26]  Paolo Napoletano,et al.  Intensity and color descriptors for texture classification , 2013, Electronic Imaging.

[27]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Raimondo Schettini,et al.  No reference image quality classification for JPEG-distorted images , 2014, Digit. Signal Process..

[29]  Victor Ciesielski,et al.  Texture analysis by genetic programming , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[30]  Aapo Hyvärinen,et al.  Modelling Image Complexity by Independent Component Analysis, with Application to Content-Based Image Retrieval , 2009, ICANN.

[31]  A. Kolmogorov Three approaches to the quantitative definition of information , 1968 .

[32]  Sara Silva,et al.  GPLAB A Genetic Programming Toolbox for MATLAB , 2004 .

[33]  C. Heaps,et al.  Similarity and Features of Natural Textures , 1999 .

[34]  David A. Freedman,et al.  Statistical Models: Theory and Practice: References , 2005 .

[35]  Anil K. Jain,et al.  Texture Analysis , 2018, Handbook of Image Processing and Computer Vision.

[36]  Weiguo Fan,et al.  Learning to advertise , 2006, SIGIR.

[37]  Bir Bhanu,et al.  Object detection in multi-modal images using genetic programming , 2004, Appl. Soft Comput..

[38]  Katharina Reinecke,et al.  Predicting users' first impressions of website aesthetics with a quantification of perceived visual complexity and colorfulness , 2013, CHI.

[39]  Huahui Wu A Study of Video Motion and Scene Complexity , 2006 .

[40]  Michael L. Mack,et al.  Identifying the Perceptual Dimensions of Visual Complexity of Scenes , 2004 .

[41]  Yuanzhen Li,et al.  Measuring visual clutter. , 2007, Journal of vision.

[42]  Paolo Napoletano,et al.  Evaluating color texture descriptors under large variations of controlled lighting conditions , 2015, Journal of the Optical Society of America. A, Optics, image science, and vision.

[43]  A. Ravishankar Rao,et al.  Identifying High Level Features of Texture Perception , 1993, CVGIP Graph. Model. Image Process..

[44]  Sabine Süsstrunk,et al.  Measuring colorfulness in natural images , 2003, IS&T/SPIE Electronic Imaging.