Affine Invariant Texture Segmentation and Shape from Texture by Variational Methods

We address the problem of texture segmentation by using a novel affine invariant model. The introduction of affine invariance as a requirement for texture analysis goes beyond what is known of the human performance and also beyond the psychophysical theories. We propose to compute texture features using affine invariant intrinsic neighborhoods and affine invariant intrinsic orientation matrices. We discuss several possibilities for the definition of the channels and give comparative experimental results where an affine invariant Mumford-Shah type energy functional is used to compute the multichannel affine invariant segmentation. We prove that the method is able to retrieve faithfully the texture regions and to recover the shape from texture information in images where several textures are present. The numerical algorithm is multiscale.

[1]  P. Lions,et al.  User’s guide to viscosity solutions of second order partial differential equations , 1992, math/9207212.

[2]  Roland T. Chin,et al.  On Image Analysis by the Methods of Moments , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  A. Ravishankar Rao,et al.  Computing oriented texture fields , 1991, CVGIP Graph. Model. Image Process..

[4]  Hudai Dirilten,et al.  Pattern Matching Under Affine Transformations , 1977, IEEE Transactions on Computers.

[5]  Alan C. Bovik,et al.  Shape-from-texture by wavelet-based measurement of local spectral moments , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  Johan Wiklund,et al.  Multidimensional orientation : texture analysis and optical flow , 1991 .

[7]  Stanley M. Dunn,et al.  Efficient Recovery of Shape from Texture , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  D. Hubel,et al.  Receptive fields of single neurones in the cat's striate cortex , 1959, The Journal of physiology.

[9]  G. Sapiro,et al.  On affine plane curve evolution , 1994 .

[10]  T. Lindeberg,et al.  Direct computation of shape cues by multi-scale retinotopic processing , 1994 .

[11]  Tomaso Poggio,et al.  Computing texture boundaries from images , 1988, Nature.

[12]  Dennis Gabor,et al.  Theory of communication , 1946 .

[13]  Coloma Ballester,et al.  Texture segmentation by variational methods , 1996 .

[14]  Vicent Caselles,et al.  Affine Invariant Segmentation by Variational Method , 1996, SIAM J. Appl. Math..

[15]  C Blakemore,et al.  On the existence of neurones in the human visual system selectively sensitive to the orientation and size of retinal images , 1969, The Journal of physiology.

[16]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[17]  J. Morel,et al.  A multiscale algorithm for image segmentation by variational method , 1994 .

[18]  P Perona,et al.  Preattentive texture discrimination with early vision mechanisms. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[19]  K. Laws.  Textured Image Segmentation , 1980 .

[20]  A. Grossmann,et al.  DECOMPOSITION OF HARDY FUNCTIONS INTO SQUARE INTEGRABLE WAVELETS OF CONSTANT SHAPE , 1984 .

[21]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .

[22]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  J. Aloimonos.  Shape from texture , 1988, Biological cybernetics.

[24]  Ruzena Bajcsy,et al.  Texture gradient as a depth cue , 1976 .

[25]  Mohan M. Trivedi,et al.  Segmentation of a high-resolution urban scene using texture operators , 1984, Comput. Vis. Graph. Image Process..

[26]  Narendra Ahuja,et al.  Shape From Texture: Integrating Texture-Element Extraction and Surface Estimation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  C. Lopez,et al.  Axiomatization of shape analysis and application to texture hyperdiscrimination , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[28]  Andrew P. Witkin,et al.  Analyzing Oriented Patterns , 1985, IJCAI.

[29]  Guillermo Sapiro,et al.  Affine invariant scale-space , 1993, International Journal of Computer Vision.

[30]  P. Lions,et al.  Axioms and fundamental equations of image processing , 1993 .

[31]  M. Unser.  Local linear transforms for texture measurements , 1986 .

[32]  J. Morel,et al.  Segmentation of images by variational methods: a constructive approach. , 1988 .

[33]  Andrew Blake,et al.  Shape from texture: the homogeneity hypothesis , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[34]  Azriel Rosenfeld,et al.  A Comparative Study of Texture Measures for Terrain Classification , 1975, IEEE Transactions on Systems, Man, and Cybernetics.

[35]  Andrew Blake,et al.  Shape from Texture: Estimation, Isotropy and Moments , 1990, Artif. Intell..

[36]  Christian Lopez.  Théorie de la discrimination de textures : axiomatisation et algorithmes numériques , 1993 .

[37]  Josef Bigun.  Frequency and orientation selective texture measures using linear symmetry and Laplacian pyramid , 1990, Other Conferences.

[38]  J. M. Hans du Buf,et al.  A review of recent texture segmentation and feature extraction techniques , 1993 .

[39]  Michael Spann,et al.  A quad-tree approach to image segmentation which combines statistical and spatial information , 1985, Pattern Recognit..

[40]  Lisa M. Brown,et al.  Surface Orientation from Projective Foreshortening of Isotropic Texture Autocorrelation , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[41]  Kenichi Kanatani,et al.  Detection of Surface Orientation and Motion from Texture by a Stereological Technique , 1984, Artif. Intell..

[42]  David J. Fleet,et al.  Hierarchical Construction of Orientation and Velocity Selective Filters , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[43]  J. Garding,et al.  Shape from texture and contour by weak isotropy , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[44]  Georges Koepfler,et al.  Segmentation by minimizing functionals and the merging methods , 1996 .

[45]  David Mumford,et al.  Filtering, Segmentation and Depth , 1993, Lecture Notes in Computer Science.

[46]  Demetri Psaltis,et al.  Recognitive Aspects of Moment Invariants , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[47]  M. Teague.  Image analysis via the general theory of moments , 1980 .

[48]  Tai Sing Lee,et al.  Texture Segmentation by Minimizing Vector-Valued Energy Functionals: The Coupled-Membrane Model , 1992, ECCV.

[49]  D. Marr,et al.  An Information Processing Approach to Understanding the Visual Cortex , 1980 .

[50]  Jean-Michel Morel,et al.  Variational methods in image segmentation , 1995 .

[51]  A. Bhatia,et al.  On the circle polynomials of Zernike and related orthogonal sets , 1954, Mathematical Proceedings of the Cambridge Philosophical Society.

[52]  P. J. Burt,et al.  Fast Filter Transforms for Image Processing , 1981 .

[53]  J. F. Boyce,et al.  Moment invariants for pattern recognition , 1983, Pattern Recognit. Lett..

[54]  Ramesh C. Jain,et al.  Computerized Flow Field Analysis: Oriented Texture Fields , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[55]  Kenichi Kanatani,et al.  Shape from Texture: General Principle , 1989, Artif. Intell..

[56]  Roland T. Chin,et al.  On image analysis by the methods of moments , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[57]  Alireza Khotanzad,et al.  Invariant Image Recognition by Zernike Moments , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[58]  A. U.S.,et al.  Recovering Surface Shape and Orientation from Texture , 2002 .

[59]  Richard W. Conners,et al.  A Theoretical Comparison of Texture Algorithms , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[60]  J. Daugman.  Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[61]  R. Hetherington.  The Perception of the Visual World , 1952 .

[62]  B. Julesz,et al.  Texton gradients: The texton theory revisited , 2004, Biological Cybernetics.