Virtual hexagonal and multi-scale operator for fuzzy rank order texture classification using one-dimensional generalised Fourier analysis

This paper presents a study on a family of local hexagonal and multi-scale operators useful for texture analysis. The hexagonal grid shows an attractive rotation symmetry with uniform neighbour distances. The operator depicts a closed connected curve (1D periodic). It is resized within a scale interval during the conversion from the original square grid to the virtual hexagonal grid. Complementary image features, together with their tangential first-order hexagonal derivatives, are calculated. The magnitude/phase information from the Fourier or Fractional Fourier Transform (FFT, FrFT) are accumulated in thirty different Cartesian (polar for visualisation) and multi-scale domains. Simultaneous phase-correlation of a subset of the data gives an estimate of scaling/rotation relative the references. Similarity metrics are used as template matching. The sample, unseen by the system, is classified into the group with the maximum fuzzy rank order. An instantiation of a 12-point hexagonal operator (radius=2) is first successfully evaluated on a set of thirteen Brodatz images (no scaling/rotation). Then it is evaluated on the more challenging KTH-TIPS2b texture dataset (scaling/rotation, varying pose/illumination). A confusion matrix and cumulative fuzzy rank order summaries show, for example, that the correct class is top-ranked 44 – 50% and top-three ranked 68 – 76% of all sample images. A similar evaluation, using a box-like 12-point mask of square grids, gives overall lower accuracies. Finally, the FrFT parameter is an additional tuning parameter influencing the accuracies significantly.

[1]  Lin He,et al.  Solving the Chan-Vese Model by a Multiphase Level Set Algorithm Based on the Topological Derivative , 2007, SSVM.

[2]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  J. Koenderink.  The structure of images , 2004, Biological Cybernetics.

[4]  Vincent Lepetit,et al.  A fast local descriptor for dense matching , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Xiaofeng Wang,et al.  An efficient local Chan-Vese model for image segmentation , 2010, Pattern Recognit..

[6]  James L. Crowley,et al.  Local Binary Patterns Calculated over Gaussian Derivative Images , 2014, 2014 22nd International Conference on Pattern Recognition.

[7]  Anand Singh Jalal,et al.  The State-of-the-Art in Visual Object Tracking , 2012, Informatica.

[8]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[9]  Subhransu Maji,et al.  Deep filter banks for texture recognition and segmentation , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Anil K. Jain,et al.  Texture classification and segmentation using multiresolution simultaneous autoregressive models , 1992, Pattern Recognit..

[11]  B. Gardiner,et al.  Multi-scale Feature Extraction in a Sub-pixel Virtual Hexagonal Environment , 2008, 2008 International Machine Vision and Image Processing Conference.

[12]  Ville Ojansivu,et al.  Blur Insensitive Texture Classification Using Local Phase Quantization , 2008, ICISP.

[13]  Ran Tao,et al.  An Efficient FPGA-based Implementation of Fractional Fourier Transform Algorithm , 2010, J. Signal Process. Syst..

[14]  AhonenTimo,et al.  Local phase quantization for blur-insensitive image analysis , 2012 .

[15]  Iasonas Kokkinos,et al.  Describing Textures in the Wild , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Rik Van de Walle,et al.  Accepted for Publication in Ieee Transactions on Image Processing Hex-splines: a Novel Spline Family for Hexagonal Lattices , 2022 .

[17]  Thomas Brox,et al.  A TV Flow Based Local Scale Measure for Texture Discrimination , 2004, ECCV.

[18]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[19]  Cordelia Schmid,et al.  Local Features and Kernels for Classification of Texture and Object Categories: A Comprehensive Study , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[20]  James C. Bezdek,et al.  Efficient Implementation of the Fuzzy c-Means Clustering Algorithms , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Xueming Qian,et al.  PLBP: An effective local binary patterns texture descriptor with pyramid representation , 2011, Pattern Recognit..

[22]  Arash Shahriari.  Learning deep filter banks in parallel for texture recognition , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[23]  Paul W. Fieguth,et al.  Extended local binary patterns for texture classification , 2012, Image Vis. Comput..

[24]  Reinhard Klein,et al.  Fractional Fourier Texture Masks: Guiding Near‐Regular Texture Synthesis , 2005, Comput. Graph. Forum.

[25]  Z. Zalevsky,et al.  The Fractional Fourier Transform: with Applications in Optics and Signal Processing , 2001 .

[26]  Federico Tombari,et al.  ZNCC-based template matching using bounded partial correlation , 2005, Pattern Recognit. Lett..

[27]  Gunilla Borgefors,et al.  Distance transformations on hexagonal grids , 1989, Pattern Recognit. Lett..

[28]  Michael Felsberg,et al.  Compact color-texture description for texture classification , 2015, Pattern Recognit. Lett..

[29]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[30]  Anil K. Jain,et al.  Statistical Pattern Recognition: A Review , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Jayanthi Sivaswamy,et al.  Hexagonal Image Processing: A Practical Approach , 2014, Advances in Pattern Recognition.

[32]  Jie Yang,et al.  Texture Segmentation using LBP embedded Region Competition , 2005 .

[33]  Tony Lindeberg,et al.  Feature Detection with Automatic Scale Selection , 1998, International Journal of Computer Vision.

[34]  Matti Pietikäinen,et al.  Rotation-invariant texture classification using feature distributions , 2000, Pattern Recognit..

[35]  Robert Sekuler,et al.  Fourier analysis of polar coordinate data in visual physiology and psychophysics , 1978 .

[36]  J. Sarvaiya,et al.  Image registration using log-polar transform and phase correlation , 2009, TENCON 2009 - 2009 IEEE Region 10 Conference.

[37]  Robert P. W. Duin,et al.  Dimensionality reduction of image features using the canonical contextual correlation projection , 2005, Pattern Recognit..

[38]  Jana Reinhard,et al.  Textures A Photographic Album For Artists And Designers , 2016 .

[39]  Bryan W. Scotney,et al.  A Biologically Inspired Approach for Fast Image Processing , 2013, MVA.

[40]  Paul F. Whelan,et al.  Using filter banks in Convolutional Neural Networks for texture classification , 2016, Pattern Recognit. Lett..

[41]  Andreas Uhl,et al.  A scale- and orientation-adaptive extension of Local Binary Patterns for texture classification , 2015, Pattern Recognit..

[42]  Pavel O. Smirnov,et al.  Robust Estimation of the Correlation Coefficient: An Attempt of Survey , 2011 .

[43]  Saeed Mozaffari,et al.  Scale- and rotation-invariant texture description with improved local binary pattern features , 2015, Signal Process..

[44]  Matti Pietikäinen,et al.  Performance evaluation of texture measures with classification based on Kullback discrimination of distributions , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[45]  Tony Lindeberg,et al.  Edge Detection and Ridge Detection with Automatic Scale Selection , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[46]  Timo Ahonen,et al.  Local phase quantization for blur-insensitive image analysis , 2012, Image Vis. Comput..

[47]  Evgueni A. Haroutunian,et al.  Information Theory and Statistics , 2011, International Encyclopedia of Statistical Science.