TCvBsISM: Texture Classification via B-Splines-Based Image Statistical Modeling

This paper presents an image statistical modeling-based texture classification (TC) approach via the Bayesian-driven B-splines probability density estimation of the image textural surface appearance (ITSA), termed TCvBsISM. It approximates the probability density functions (pdfs) of the marginal distribution and joint distribution, involving the global organization and the locally structural layout of local homogeneous patches in the texture surface, respectively, of both the image raw pixel space and the filter response space, by the linear combination of B-spline basis functions (BsBFs) for ITSA feature characterization. The corresponding linear weighting coefficients (LWCs) are determined by an entropy-based optimization criterion with a prior smooth constraint over the LWCs. By leveraging the B-spline-based pdf modeling, distinctive ITSA structural features of texture images are characterized by the LWCs of the pre-defined BsBFs, which are then embedded in an integrated statistical feature dictionary learning, texture pattern representation, and discrimination model to perform TC. Extensive confirmative and comparative experiments on three different texture databases and one natural environmental scene database demonstrate that the proposed TCvBsISM is very promising, especially when the images of different texture patterns appear to be quite similar with the limited training samples. The effects of various parameters on TCvBsISM, such as the choice of the filter bank, the size of the image statistical feature dictionary, as well as the number of BsBFs, are also discussed.

[1]  张进,et al.  Quality­Related Monitoring and Grading of Granulated Products by Weibull­Distribution Modeling of Visual Images with Semi­supervised Learning , 2016 .

[2]  Mathews Jacob,et al.  Design of steerable filters for feature detection using canny-like criteria , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  唐朝晖,et al.  Toward Automated Quality Classification via Statistical Modeling of Grain Images for Rice Processing Monitoring , 2016 .

[4]  Cordelia Schmid,et al.  A sparse texture representation using local affine regions , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Jitendra Malik,et al.  Representing and Recognizing the Visual Appearance of Materials using Three-dimensional Textons , 2001, International Journal of Computer Vision.

[6]  K. Lam,et al.  Estimation of complicated distributions using B-spline functions , 1998 .

[7]  Andrew Zisserman,et al.  A Statistical Approach to Texture Classification from Single Images , 2004, International Journal of Computer Vision.

[8]  Antonio Torralba,et al.  Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope , 2001, International Journal of Computer Vision.

[9]  Shenglan Liu,et al.  Multi-trend binary code descriptor: a novel local texture feature descriptor for image retrieval , 2017, Signal, Image and Video Processing.

[10]  Eero P. Simoncelli,et al.  Image Modeling and Denoising With Orientation-Adapted Gaussian Scale Mixtures , 2008, IEEE Transactions on Image Processing.

[11]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[12]  Xiaojun Zhou,et al.  Entropy-based estimation of bubble size distributions in froth flotation using B-spline functions , 2016 .

[13]  Marko Heikkilä,et al.  Description of interest regions with local binary patterns , 2009, Pattern Recognit..

[14]  Shu Liao,et al.  Dominant Local Binary Patterns for Texture Classification , 2009, IEEE Transactions on Image Processing.

[15]  Paul W. Fieguth,et al.  Texture Classification from Random Features , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  J. Daugman Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[17]  Jianfei Cai,et al.  LETRIST: Locally Encoded Transform Feature Histogram for Rotation-Invariant Texture Classification , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Jianping Fan,et al.  Statistical modeling and conceptualization of natural images , 2005, Pattern Recognit..

[19]  桂卫华,et al.  Application of statistical modeling of image spatial structures to automated visual inspection of product quality , 2016 .

[20]  Guowei Yang,et al.  Fusing DTCWT and LBP Based Features for Rotation, Illumination and Scale Invariant Texture Classification , 2018, IEEE Access.

[21]  Mathieu Fauvel,et al.  Large-Scale Feature Selection With Gaussian Mixture Models for the Classification of High Dimensional Remote Sensing Images , 2017, IEEE Transactions on Computational Imaging.

[22]  William Robson Schwartz,et al.  Multi-scale gray level co-occurrence matrices for texture description , 2013, Neurocomputing.

[23]  Pietro Perona,et al.  A Bayesian hierarchical model for learning natural scene categories , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[24]  Yan Ke,et al.  PCA-SIFT: a more distinctive representation for local image descriptors , 2004, CVPR 2004.

[25]  Zhi Zong,et al.  Bayesian estimation of complicated distributions , 2000 .

[26]  D. G. Albrecht,et al.  Spatial frequency selectivity of cells in macaque visual cortex , 1982, Vision Research.

[27]  Joost van de Weijer,et al.  Fast Anisotropic Gauss Filtering , 2002, ECCV.

[28]  Rong Xiao,et al.  Pairwise Rotation Invariant Co-Occurrence Local Binary Pattern , 2014, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Trygve Randen,et al.  Filtering for Texture Classification: A Comparative Study , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Safia Abdelmounaime,et al.  New Brodatz-Based Image Databases for Grayscale Color and Multiband Texture Analysis , 2013 .

[31]  Jin Zhang,et al.  Visual Perception-Based Statistical Modeling of Complex Grain Image for Product Quality Monitoring and Supervision on Assembly Production Line , 2016, PloS one.

[32]  Luming Zhang,et al.  Perceptual multi-channel visual feature fusion for scene categorization , 2018, Inf. Sci..

[33]  Shree K. Nayar,et al.  Reflectance and texture of real-world surfaces , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[34]  Matti Pietikäinen,et al.  IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2009, TPAMI-2008-09-0620 1 WLD: A Robust Local Image Descriptor , 2022 .

[35]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[36]  Jun Liu,et al.  Texture classification using multiresolution Markov random field models , 1999, Pattern Recognit. Lett..

[37]  Lei Yu,et al.  Gabor texture representation method for face recognition using the Gamma and generalized Gaussian models , 2010, Image Vis. Comput..

[38]  Zhili Zhou,et al.  Local Adaptive Binary Patterns Using Diamond Sampling Structure for Texture Classification , 2017, IEEE Signal Processing Letters.

[39]  Michael Unser,et al.  Steerable Wavelet Machines (SWM): Learning Moving Frames for Texture Classification , 2017, IEEE Transactions on Image Processing.

[40]  Eero P. Simoncelli,et al.  On Advances in Statistical Modeling of Natural Images , 2004, Journal of Mathematical Imaging and Vision.

[41]  Huosheng Hu,et al.  Machine Vision Based Production Condition Classification and Recognition for Mineral Flotation Process Monitoring , 2013, Int. J. Comput. Intell. Syst..

[42]  Bernard De Baets,et al.  Unsupervised ridge detection using second order anisotropic Gaussian kernels , 2015, Signal Process..

[43]  Tai Sing Lee,et al.  Image Representation Using 2D Gabor Wavelets , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[44]  Andrew Zisserman,et al.  A Statistical Approach to Material Classification Using Image Patch Exemplars , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[45]  Ling Shao,et al.  Evolutionary compact embedding for large-scale image classification , 2015, Inf. Sci..

[46]  Edward H. Adelson,et al.  The Design and Use of Steerable Filters , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[47]  Zhibin Pan,et al.  Feature based local binary pattern for rotation invariant texture classification , 2017, Expert Syst. Appl..

[48]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..