Perception-based fuzzy partitions for visual texture modeling

Abstract Visual textures in images are usually described by humans using linguistic terms related to their perceptual properties, like “very coarse”, “low directional”, or “high contrasted”. Computational models with the ability of providing a perceptual texture characterization on the basis of these terms can be very useful in tasks like semantic description of images, content-based image retrieval using linguistic queries, or expert systems design based on low level visual features. In this paper, we address the problem of simulating the human perception of texture, obtaining linguistic labels to describe it in natural language. For this modeling, fuzzy partitions defined on the domain of some of the most representative measures of each property are employed. In order to define the fuzzy partitions, the number of linguistic labels and the parameters of the membership functions are calculated taking into account the relationship between the computational values given by the measures and the human perception of the corresponding property. The performance of each fuzzy partition is analyzed and tested using the human assessments, and a ranking of measures is obtained according to their ability to represent the perception of the property, allowing to identify the most suitable measure.

[1]  Usman Qamar,et al.  Texture Classification Using Rotation- and Scale-Invariant Gabor Texture Features , 2013, IEEE Signal Processing Letters.

[2]  Jefersson Alex dos Santos,et al.  A relevance feedback method based on genetic programming for classification of remote sensing images , 2011, Inf. Sci..

[3]  Zhibin Huang,et al.  SU‐E‐J‐108: Texture Segmentation in Magnetic Resonance Images Using Discrete Wavelet Transform Combined with Gabor Wavelets , 2013 .

[4]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[5]  L. Foulloy,et al.  Fuzzy clustering for color recognition application to image understanding , 1996, Proceedings of IEEE 5th International Fuzzy Systems.

[6]  Changyin Sun,et al.  Supervised class-specific dictionary learning for sparse modeling in action recognition , 2012, Pattern Recognit..

[7]  José M. Soto-Hidalgo,et al.  A fuzzy approach for modelling visual texture properties , 2015, Inf. Sci..

[8]  Ling Shao,et al.  Feature Learning for Image Classification Via Multiobjective Genetic Programming , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[9]  Gang Hua,et al.  Weakly Supervised Visual Dictionary Learning by Harnessing Image Attributes , 2014, IEEE Transactions on Image Processing.

[10]  Neamat El Gayar,et al.  A new approach in content-based image retrieval using fuzzy , 2009, Telecommun. Syst..

[11]  Odemir Martinez Bruno,et al.  Gabor wavelets combined with volumetric fractal dimension applied to texture analysis , 2014, Pattern Recognit. Lett..

[12]  R.M. Haralick,et al.  Statistical and structural approaches to texture , 1979, Proceedings of the IEEE.

[13]  Md. Monirul Islam,et al.  Combination of Gabor and Curvelet Texture Features for Face Recognition Using Principal Component Analysis , 2012 .

[14]  Mary M. Galloway,et al.  Texture analysis using gray level run lengths , 1974 .

[15]  Phil Brodatz,et al.  Textures: A Photographic Album for Artists and Designers , 1966 .

[16]  Ling Shao,et al.  Learning Object-to-Class Kernels for Scene Classification , 2014, IEEE Transactions on Image Processing.

[17]  Benoit B. Mandelbrot,et al.  Fractal Geometry of Nature , 1984 .

[18]  S. S. Tripathy,et al.  Texture Retrieval System Using Intuitionistic Fuzzy Set Theory , 2011, 2011 International Conference on Devices and Communications (ICDeCom).

[19]  Mengjie Zhang,et al.  A domain independent Genetic Programming approach to automatic feature extraction for image classification , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[20]  Hao Wu,et al.  An effective feature selection method for hyperspectral image classification based on genetic algorithm and support vector machine , 2011, Knowl. Based Syst..

[21]  Yong Xu,et al.  Wavelet Domain Multifractal Analysis for Static and Dynamic Texture Classification , 2013, IEEE Transactions on Image Processing.

[22]  Kata Praditwong,et al.  Automatic Feature Weight Assignment Based on Image Retrieval Using Genetic Algorithm , 2014 .

[23]  Brijesh Verma,et al.  A fuzzy-neural approach for interpretation and fusion of colour and texture features for CBIR systems , 2004, Appl. Soft Comput..

[24]  E. Dougherty,et al.  Fuzzification of set inclusion: theory and applications , 1993 .

[25]  Dragutin Petkovic,et al.  Query by Image and Video Content: The QBIC System , 1995, Computer.

[26]  K. Suganya,et al.  Performance analysis for coal texture classification , 2012, 2012 International Conference on Emerging Trends in Science, Engineering and Technology (INCOSET).

[27]  A. Ravishankar Rao,et al.  Identifying High Level Features of Texture Perception , 1993, CVGIP Graph. Model. Image Process..

[28]  Jun Zhou,et al.  Hyperspectral Image Classification Based on Structured Sparse Logistic Regression and Three-Dimensional Wavelet Texture Features , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Pedro Martínez-Jiménez,et al.  A comparative study of texture coarseness measures , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[30]  B. S. Manjunath,et al.  Introduction to MPEG-7: Multimedia Content Description Interface , 2002 .

[31]  A. Tamhane,et al.  Multiple Comparison Procedures , 1989 .

[32]  Azriel Rosenfeld,et al.  A Comparative Study of Texture Measures for Terrain Classification , 1975, IEEE Transactions on Systems, Man, and Cybernetics.

[33]  An-Zen Shih The approach of using fractal dimension and linguistic descriptors in CBIR , 2012, 2012 International Conference on Machine Learning and Cybernetics.

[34]  D. Kleinbaum,et al.  Applied Regression Analysis and Other Multivariate Methods , 1978 .

[35]  Chuen-Horng Lin,et al.  Image Segmentation Using the K-means Algorithm for Texture Features , 2010 .

[36]  Xinghao Jiang,et al.  A Robust Image Classification Scheme with Sparse Coding and Multiple Kernel Learning , 2012, IWDW.

[37]  Shan Hu,et al.  Texture feature extraction based on wavelet transform and gray-level co-occurrence matrices applied to osteosarcoma diagnosis. , 2014, Bio-medical materials and engineering.

[38]  Siwei Luo,et al.  A Neural Network Approach for Bridging the Semantic Gap in Texture Image Retrieval , 2007, 2007 International Joint Conference on Neural Networks.

[39]  Isabelle Bloch,et al.  Directional relative position between objects in image processing: a comparison between fuzzy approaches , 2003, Pattern Recognit..

[40]  Chris Cornelis,et al.  Sinha-Dougherty approach to the fuzzification of set inclusion revisited , 2003, Fuzzy Sets Syst..

[41]  Rama Chellappa,et al.  Multiple Kernel Learning for Sparse Representation-Based Classification , 2014, IEEE Transactions on Image Processing.

[42]  Christos Faloutsos,et al.  QBIC project: querying images by content, using color, texture, and shape , 1993, Electronic Imaging.

[43]  Noureddine Abbadeni,et al.  Computational Perceptual Features for Texture Representation and Retrieval , 2011, IEEE Transactions on Image Processing.

[44]  Sunhyo Kim,et al.  Texture classification using run difference matrix , 1991, IEEE 1991 Ultrasonics Symposium,.

[45]  Anca L. Ralescu,et al.  Fuzzy logic approach to model-based image analysis , 1993 .

[46]  Zhiqiang Zhou,et al.  Binary Gabor pattern: An efficient and robust descriptor for texture classification , 2012, 2012 19th IEEE International Conference on Image Processing.

[47]  H. Yoshida,et al.  Wavelet-packet-based texture analysis for differentiation between benign and malignant liver tumours in ultrasound images. , 2003, Physics in medicine and biology.

[48]  M. Boukadoum,et al.  Hybrid Discrete Wavelet Transform and Gabor Filter Banks Processing for Features Extraction from Biomedical Images , 2013, Journal of medical engineering.

[49]  Hideyuki Tamura,et al.  Textural Features Corresponding to Visual Perception , 1978, IEEE Transactions on Systems, Man, and Cybernetics.

[50]  Gustavo Camps-Valls,et al.  Learning Relevant Image Features With Multiple-Kernel Classification , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[51]  Sebastiano Battiato,et al.  Perceptive visual texture classification and retrieval , 2003, 12th International Conference on Image Analysis and Processing, 2003.Proceedings..

[52]  Shengrui Wang,et al.  Autocovariance-based perceptual textural features corresponding to human visual perception , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[53]  John F. Roddick,et al.  Kernel self-optimization learning for kernel-based feature extraction and recognition , 2014, Inf. Sci..

[54]  Robert King,et al.  Textural features corresponding to textural properties , 1989, IEEE Trans. Syst. Man Cybern..

[55]  Chandrika Kamath,et al.  Retrieval using texture features in high-resolution multispectral satellite imagery , 2004, SPIE Defense + Commercial Sensing.

[56]  S.J.J. Smith,et al.  Empirical Methods for Artificial Intelligence , 1995 .

[57]  Hans Burkhardt,et al.  Relational Features for Texture Classification , 2011, FGIT-SIP.

[58]  Ling Shao,et al.  Weakly-Supervised Cross-Domain Dictionary Learning for Visual Recognition , 2014, International Journal of Computer Vision.

[59]  Mohand Saïd Allili,et al.  Wavelet Modeling Using Finite Mixtures of Generalized Gaussian Distributions: Application to Texture Discrimination and Retrieval , 2012, IEEE Transactions on Image Processing.

[60]  José M. Soto-Hidalgo,et al.  An adaptive fuzzy approach for modeling visual texture properties , 2016, Fuzzy Sets Syst..

[61]  Chih-Chin Lai,et al.  A User-Oriented Image Retrieval System Based on Interactive Genetic Algorithm , 2011, IEEE Transactions on Instrumentation and Measurement.

[62]  José M. Soto-Hidalgo,et al.  A fuzzy approach for retrieving images in databases using dominant color and texture descriptors , 2010, International Conference on Fuzzy Systems.

[63]  Enrique H. Ruspini,et al.  A New Approach to Clustering , 1969, Inf. Control..

[64]  José M. Soto-Hidalgo,et al.  Retrieving images in fuzzy object-relational databases using dominant color descriptors , 2007, Fuzzy Sets Syst..

[65]  Yannick Berthoumieu,et al.  Gaussian Copula Multivariate Modeling for Texture Image Retrieval Using Wavelet Transforms , 2014, IEEE Transactions on Image Processing.

[66]  Matthieu Guillaumin,et al.  Quantized Kernel Learning for Feature Matching , 2014, NIPS.

[67]  Joseph Naor,et al.  Multiple Resolution Texture Analysis and Classification , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[68]  Brijesh Verma,et al.  Fuzzy logic based texture queries for CBIR , 2003, Proceedings Fifth International Conference on Computational Intelligence and Multimedia Applications. ICCIMA 2003.

[69]  Donghui Wang,et al.  A Dictionary Learning Approach for Classification: Separating the Particularity and the Commonality , 2012, ECCV.

[70]  William G. Wee,et al.  Neighboring gray level dependence matrix for texture classification , 1982, Comput. Graph. Image Process..

[71]  S. Pizer,et al.  The Image Processing Handbook , 1994 .

[72]  Laurent Wendling,et al.  A New Way to Represent the Relative Position between Areal Objects , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[73]  Jinwen Ma,et al.  Wavelet-Based Image Texture Classification Using Local Energy Histograms , 2011, IEEE Signal Processing Letters.

[74]  Chih-Yi Chiu,et al.  Finding textures by textual descriptions, visual examples, and relevance feedbacks , 2003, Pattern Recognit. Lett..

[75]  S. Tamil Selvi,et al.  Multiple Representations of Perceptual Features for Texture Classification and Retrieval , 2012 .