Comparison of Texture Analysis Schemes Under Nonideal Conditions

Several recent advancements in the field of texture analysis prompt some fundamental questions. For instance, what is the true impact of these novel advancements under real-world environments? When do these novel advancements fail to perform? Which methods perform better and under what conditions? In this work, we investigate these and other issues under nonideal image acquisition environments, specifically, environments with changing conditions due to illumination variations and those caused by both affine and nonaffine transformations. We study the performance of nine popular texture analysis algorithms using three different datasets, with varying levels of difficulty. Experiments are performed on nonideal texture datasets under five different setups. We find that most state-of-the-art techniques do not perform well under these conditions. To a large extent, their performance under nonideal conditions depends critically on the nature of the textural surface. Moreover, most techniques fail to perform reliably when the number of classes in the dataset is increased significantly, over the regular-size datasets used in previous work. Multiscale features performed reasonably well against variations caused by illumination and rotation but are prone to fail under changes in scale. Surprisingly, the performance for most of the algorithms is generally stable on structured or periodic textures, even with variations in illumination or affine transformations.

[1]  Heinrich Niemann,et al.  To each according to its need: kernel class specific classifiers , 2002, Object recognition supported by user interaction for service robots.

[2]  Anil K. Jain,et al.  Unsupervised texture segmentation using Gabor filters , 1990, 1990 IEEE International Conference on Systems, Man, and Cybernetics Conference Proceedings.

[3]  Jitendra Malik,et al.  Recognizing surfaces using three-dimensional textons , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[4]  Michael Unser,et al.  Texture classification and segmentation using wavelet frames , 1995, IEEE Trans. Image Process..

[5]  Mike J. Chantler,et al.  Illuminant-tilt estimation from images of isotropic texture , 1997 .

[6]  David A. Clausi,et al.  Preserving boundaries for image texture segmentation using grey level co-occurring probabilities , 2006, Pattern Recognit..

[7]  Matti Pietikäinen,et al.  View-based recognition of 3D-textured surfaces , 2003, 12th International Conference on Image Analysis and Processing, 2003.Proceedings..

[8]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[10]  Michael Unser,et al.  Multiresolution Feature Extraction and Selection for Texture Segmentation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Wilson S. Geisler,et al.  Multichannel Texture Analysis Using Localized Spatial Filters , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  H. Bastian Sensation and Perception.—I , 1869, Nature.

[13]  Shree K. Nayar,et al.  Reflectance and texture of real-world surfaces , 1999, TOGS.

[14]  Jun Xie,et al.  Segmentation of kidney from ultrasound images based on texture and shape priors , 2005, IEEE Transactions on Medical Imaging.

[15]  Shree K. Nayar,et al.  Multiresolution histograms and their use for recognition , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  E. Land Recent advances in retinex theory , 1986, Vision Research.

[17]  Amit Jain,et al.  A multiscale representation including opponent color features for texture recognition , 1998, IEEE Trans. Image Process..

[18]  Maria Petrou,et al.  Multidimensional Co-occurrence Matrices for Object Recognition and Matching , 1996, CVGIP Graph. Model. Image Process..

[19]  Takeo Kanade,et al.  Surface Reflection: Physical and Geometrical Perspectives , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Manik Varma,et al.  Learning The Discriminative Power-Invariance Trade-Off , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[21]  Jian Fan,et al.  Texture Classification by Wavelet Packet Signatures , 1993, MVA.

[22]  Fang Liu,et al.  Periodicity, Directionality, and Randomness: Wold Features for Image Modeling and Retrieval , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Gerald Schaefer,et al.  Illuminant and device invariant colour using histogram equalisation , 2005, Pattern Recognit..

[24]  Vassilis Anastassopoulos,et al.  Textural characterization from various representations of MERIS data , 2007 .

[25]  Barbara Caputo,et al.  Cue integration through discriminative accumulation , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[26]  M. Chantler Why illuminant direction is fundamental to texture analysis , 2022 .

[27]  David A. Clausi,et al.  Fusion of Gabor Filter and Co-occurrence Probability Features for Texture Recognition , 2003 .

[28]  Ales Leonardis,et al.  Towards correct and informative evaluation methodology for texture classification under varying viewpoint and illumination , 2010, Comput. Vis. Image Underst..

[29]  R. Porter,et al.  Robust rotation-invariant texture classification: wavelet, Gabor filter and GMRF based schemes , 1997 .

[30]  Cordelia Schmid,et al.  Local Features and Kernels for Classification of Texture and Object Categories: A Comprehensive Study , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[31]  Moulay A. Akhloufi,et al.  A New Color-Texture Approach for Industrial Products Inspection , 2008, J. Multim..

[32]  Trygve Randen,et al.  Filtering for Texture Classification: A Comparative Study , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  B. S. Manjunath,et al.  A Texture Thesaurus for Browsing Large Aerial Photographs , 1998, J. Am. Soc. Inf. Sci..

[34]  Rama Chellappa,et al.  Markov random field models in image processing , 1998 .

[35]  Petros Maragos,et al.  Pattern Spectrum and Multiscale Shape Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  Andrew Zisserman,et al.  A Statistical Approach to Texture Classification from Single Images , 2004, International Journal of Computer Vision.

[37]  Pau-Choo Chung,et al.  Discrimination of Liver Diseases from CT Images Based on Gabor Filters , 2006, 19th IEEE Symposium on Computer-Based Medical Systems (CBMS'06).

[38]  Donald A. Adjeroh,et al.  Efficient texture analysis of SAR imagery , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[39]  David A. Clausi,et al.  Design-based texture feature fusion using Gabor filters and co-occurrence probabilities , 2005, IEEE Transactions on Image Processing.

[40]  Mario Fritz,et al.  On the Significance of Real-World Conditions for Material Classification , 2004, ECCV.

[41]  B. S. Manjunath,et al.  Texture Features for Browsing and Retrieval of Image Data , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[42]  Anil K. Jain,et al.  Texture classification and segmentation using multiresolution simultaneous autoregressive models , 1992, Pattern Recognit..

[43]  R H Masland Unscrambling Color Vision , 1996, Science.

[44]  Maria Petrou,et al.  Performance Evaluation of Texture Segmentation Algorithms based on Wavelets , 1996 .

[45]  Barbara Caputo,et al.  Class-Specific Material Categorisation , 2005, ICCV.

[46]  Bea Thai,et al.  Modeling and Classifying Symmetries Using a Multiscale Opponent Color Representation , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[47]  David A. Clausi,et al.  Comparison and fusion of co‐occurrence, Gabor and MRF texture features for classification of SAR sea‐ice imagery , 2001 .

[48]  Ingrid Daubechies,et al.  The wavelet transform, time-frequency localization and signal analysis , 1990, IEEE Trans. Inf. Theory.

[49]  Matti Pietikäinen,et al.  View-based recognition of real-world textures , 2004, Pattern Recognit..

[50]  Richard W. Conners,et al.  A Theoretical Comparison of Texture Algorithms , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[51]  Cordelia Schmid,et al.  A sparse texture representation using local affine regions , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[52]  Jitendra Malik,et al.  Representing and Recognizing the Visual Appearance of Materials using Three-dimensional Textons , 2001, International Journal of Computer Vision.

[53]  Ian Burns,et al.  Measuring texture classification algorithms , 1997, Pattern Recognit. Lett..

[54]  Matti Pietikäinen,et al.  Classification with color and texture: jointly or separately? , 2004, Pattern Recognit..

[55]  Shaoning Pang,et al.  Face membership authentication using SVM classification tree generated by membership-based LLE data partition , 2005, IEEE Trans. Neural Networks.

[56]  Larry S. Davis,et al.  Texture Analysis Using Generalized Co-Occurrence Matrices , 1979, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[57]  Kevin W. Bowyer,et al.  Evaluation of Texture Segmentation Algorithms , 1999, CVPR.

[58]  Li WangDong-Chen He,et al.  Texture classification using texture spectrum , 1990, Pattern Recognit..

[59]  Matti Pietikäinen,et al.  Outex - new framework for empirical evaluation of texture analysis algorithms , 2002, Object recognition supported by user interaction for service robots.

[60]  Nicolai Petkov,et al.  Comparison of texture features based on Gabor filters , 1999, Proceedings 10th International Conference on Image Analysis and Processing.

[61]  Maria Petrou,et al.  Classifying Surface Texture while Simultaneously Estimating Illumination Direction , 2005, International Journal of Computer Vision.

[62]  M.,et al.  Statistical and Structural Approaches to Texture , 2022 .