Visual Texture

Visual information is the most important information on which the majority of all living organisms base their cognition and survival strategy. A visual scene has two important cognitive categories, which are crucial for image understanding: shapes and materials. This book focuses on the latter category—visual aspects of surface materials which manifest themselves as visual textures. Visual texture is of key importance for recognition of objects as well as for estimation of their properties. Pixels, as the basic elements of any digitized visual texture, are known to be highly spatially, and spectrally correlated, but they are also correlated in the time or viewing and illumination angular spaces. Representations of visual textures which respect these multi-dimensional visual space correlations thus form an advantageous foundation for any advanced visual information processing applied to both cognitive (analysis) and modeling (synthesis) purposes. 1.1 Visual Texture Definition The notion of texture comes from Latin word texere which means to weave; and textura is a weaving, web, structure. Its meaning may, according to Oxford or Webster’s dictionaries, be any of these: • The process or art of weaving; the fabricating or composing of schemes, writings, etc. A woven fabric, or any natural structure having an appearance or consistence as if woven. • The character of a textile fabric (fine, coarse, close, loose, etc.) resulting from a way in which it is woven. • The constitution, structure, or substance of anything with regard to its constituents or formative elements. • Something composed of closely interwoven or intertwined threads, strands, or the like elements. • The essential part of something, an identifying quality. • The size and organization of small constituent part of a body or substance; the visual or tactile surface characteristics and appearance of something. The exact meaning of texture depends on the application area. While in geology it is a physical appearance or rock character, in material science it is a distribution M. Haindl, J. Filip, Visual Texture, Advances in Computer Vision and Pattern Recognition, DOI 10.1007/978-1-4471-4902-6_1, © Springer-Verlag London 2013 1

[1]  Petr Somol,et al.  Novel Path Search Algorithm for Image Stitching and Advanced Texture Tiling , 2005, WSCG.

[2]  Robert J. Woodham,et al.  Analysing Images of Curved Surfaces , 1981, Artif. Intell..

[3]  Baining Guo,et al.  Synthesis of bidirectional texture functions on arbitrary surfaces , 2002, SIGGRAPH.

[4]  D. Stoyan,et al.  Stochastic Geometry and Its Applications , 1989 .

[5]  M. Haindl,et al.  Multiresolution Colour Texture Synthesis , 1998 .

[6]  R. L. Kashyap,et al.  Analysis and Synthesis of Image Patterns by Spatial Interaction Models , 1981 .

[7]  Stephen H. Westin,et al.  A Field Guide to BRDF Models , 2004 .

[8]  Mineichi Kudo,et al.  A Gaussian mixture-based colour texture model , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[9]  Jirí Grim,et al.  On numerical evaluation of maximum-likelihood estimates for finite mixtures of distributions , 1982, Kybernetika.

[10]  Tien-Tsin Wong,et al.  Image-based Rendering with Controllable Illumination , 1997, Rendering Techniques.

[11]  Joseph Naor,et al.  Multiple Resolution Texture Analysis and Classification , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Andrew Chi-Sing Leung,et al.  Compression of illumination-adjustable images , 2003, IEEE Trans. Circuits Syst. Video Technol..

[13]  Donald S. Fussell,et al.  Computer rendering of stochastic models , 1998 .

[14]  Elena Ranguelova,et al.  Analysis and synthesis of three-dimensional Gaussian Markov random fields , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[15]  M. Haindl,et al.  A Discrete Mixtures Colour Texture Model , 2002 .

[16]  Michael Ashikhmin,et al.  Synthesizing natural textures , 2001, I3D '01.

[17]  Yanxi Liu,et al.  A computational model for periodic pattern perception based on frieze and wallpaper groups , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Wang,et al.  Nonuniversal critical dynamics in Monte Carlo simulations. , 1987, Physical review letters.

[19]  Yanxi Liu,et al.  Quantitative Evaluation of Near Regular Texture Synthesis Algorithms , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[20]  Stephen H. Westin,et al.  Predicting reflectance functions from complex surfaces , 1992, SIGGRAPH.

[21]  Holly E. Rushmeier,et al.  Physically-based interactive bi-scale material design , 2011, ACM Trans. Graph..

[22]  Michal Haindl,et al.  Texture modelling by discrete distribution mixtures , 2003, Comput. Stat. Data Anal..

[23]  Michal Haindl,et al.  Colour texture representation based on multivariate Bernoulli mixtures , 2010, 10th International Conference on Information Science, Signal Processing and their Applications (ISSPA 2010).

[24]  V. Karthlkeyani,et al.  Texture analysis and synthesis for near-regular textures , 2005, Proceedings of 2005 International Conference on Intelligent Sensing and Information Processing, 2005..

[25]  Junyu Dong,et al.  Comparison of Five 3D Surface Texture Synthesis Methods , 2003 .

[26]  Marc Levoy,et al.  Fast texture synthesis using tree-structured vector quantization , 2000, SIGGRAPH.

[27]  Sylvain Lefebvre,et al.  State of the Art in Example-based Texture Synthesis , 2009, Eurographics.

[28]  Jeremy S. De Bonet,et al.  Multiresolution sampling procedure for analysis and synthesis of texture images , 1997, SIGGRAPH.

[29]  Marc Levoy,et al.  Texture synthesis over arbitrary manifold surfaces , 2001, SIGGRAPH.

[30]  Alexei A. Efros,et al.  Image quilting for texture synthesis and transfer , 2001, SIGGRAPH.

[31]  Michal Haindl,et al.  Visual Data Recognition and Modeling Based on Local Markovian Models , 2012, Mathematical Methods for Signal and Image Analysis and Representation.

[32]  Reinhard Klein,et al.  Fractional Fourier Texture Masks: Guiding Near‐Regular Texture Synthesis , 2005, Comput. Graph. Forum.

[33]  Michal Haindl,et al.  A Multiresolution Causal Colour Texture Model , 2000, SSPR/SPR.

[34]  Neil A. Dodgson,et al.  Integrating procedural textures with replicated image editing , 2005, GRAPHITE '05.

[35]  Jun Zhang,et al.  A wavelet-based multiresolution statistical model for texture , 1998, IEEE Trans. Image Process..

[36]  Stephen H. Westin,et al.  A Comparison of Four BRDF Models , 2005 .

[37]  Michael F. Barnsley,et al.  Fractals everywhere , 1988 .

[38]  Kun Zhou,et al.  Decorating surfaces with bidirectional texture functions , 2005, IEEE Transactions on Visualization and Computer Graphics.

[39]  Pavel Pudil,et al.  A Subspace Approach to Texture Modelling by Using Gaussian Mixtures , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[40]  Alexander Wilkie,et al.  Arbitrarily layered micro-facet surfaces , 2007, GRAPHITE '07.

[41]  Felix Wichmann,et al.  The psychometric function: I , 2001 .

[42]  Ryo Furukawa,et al.  Patch-based BTF synthesis for real-time rendering , 2005, IEEE International Conference on Image Processing 2005.

[43]  Andrew Gardner,et al.  Performance relighting and reflectance transformation with time-multiplexed illumination , 2005, ACM Trans. Graph..

[44]  A. Rosenfeld,et al.  Random Mosaic Models for Textures , 1978 .

[45]  Alex Pentland,et al.  Fractal-Based Description of Natural Scenes , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[46]  Michal Haindl,et al.  BTF image space utmost compression and modelling method , 2004, ICPR 2004.

[47]  Michal Haindl,et al.  A multiscale colour texture model , 2002, Object recognition supported by user interaction for service robots.

[48]  Oliver Deussen,et al.  Wang Tiles for image and texture generation , 2003, ACM Trans. Graph..

[49]  Michal Haindl,et al.  Probabilistic mixture-based image modelling , 2011, Kybernetika.

[50]  Jean Serra,et al.  Image Analysis and Mathematical Morphology , 1983 .

[51]  Michael Garland,et al.  Interactive Texture Synthesis on Surfaces using Jump Maps , 2003, Rendering Techniques.

[52]  Yanxi Liu,et al.  Near-regular texture analysis and manipulation , 2004, SIGGRAPH 2004.

[53]  Terrance E. Boult,et al.  Constraining Object Features Using a Polarization Reflectance Model , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[54]  M. Haindl,et al.  A Hybrid BTF Model Based on Gaussian Mixtures , 2005 .

[55]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[56]  Jirí Filip,et al.  A Fast Probabilistic Bidirectional Texture Function Model , 2004, ICIAR.

[57]  Brian J. Ross,et al.  Procedural 3D texture synthesis using genetic programming , 2004, Comput. Graph..

[58]  Irfan A. Essa,et al.  Graphcut textures: image and video synthesis using graph cuts , 2003, ACM Trans. Graph..

[59]  Jirí Filip,et al.  Bidirectional Texture Function Modeling: A State of the Art Survey , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[60]  Michal Haindl,et al.  A Roller - Fast Sampling-Based Texture Synthesis Algorithm , 2005, WSCG.

[61]  Holly E. Rushmeier,et al.  A Sparse Parametric Mixture Model for BTF Compression, Editing and Rendering , 2011, Comput. Graph. Forum.

[62]  Sylvain Lefebvre,et al.  Parallel controllable texture synthesis , 2005, ACM Trans. Graph..

[63]  N. Ahuja,et al.  Out-of-core tensor approximation of multi-dimensional matrices of visual data , 2005, SIGGRAPH 2005.

[64]  Yanxi Liu,et al.  Texture replacement in real images , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[65]  Ken Perlin,et al.  [Computer Graphics]: Three-Dimensional Graphics and Realism , 2022 .

[66]  Alexei A. Efros,et al.  Texture synthesis by non-parametric sampling , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[67]  Harry Shum,et al.  Synthesizing bidirectional texture functions for real-world surfaces , 2001, SIGGRAPH.

[68]  Jirí Filip,et al.  Extreme Compression and Modeling of Bidirectional Texture Function , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[69]  Chi-Wing Fu,et al.  Tileable BTF , 2007, IEEE Transactions on Visualization and Computer Graphics.

[70]  Y. Hel-Or,et al.  Synthesis of Reflectance Function Textures from Examples , 2003 .

[71]  Michal Haindl,et al.  Potts compound Markovian texture model , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[72]  Yanxi Liu,et al.  A comparison study of four texture synthesis algorithms on near-regular textures , 2004, SIGGRAPH '04.

[73]  J. Besag.  Spatial Interaction and the Statistical Analysis of Lattice Systems , 1974 .

[74]  Alireza Khotanzad,et al.  Multispectral Random Field Models for Synthesis and Analysis of Color Images , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[76]  Jirí Filip,et al.  BTF modelling using BRDF texels , 2007, Int. J. Comput. Math..

[77]  Baining Guo,et al.  Chaos Mosaic: Fast and Memory Efficient Texture Synthesis , 2000 .

[78]  Robert J. Woodham,et al.  Photometric method for determining surface orientation from multiple images , 1980 .

[79]  Yanghai Tsin,et al.  The Promise and Perils of Near-Regular Texture , 2005 .

[80]  Song-Chun Zhu,et al.  Modeling Visual Patterns by Integrating Descriptive and Generative Methods , 2004, International Journal of Computer Vision.

[81]  Nigel Dodd,et al.  Multispectral Texture Synthesis Using Fractal Concepts , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[82]  Michal Haindl,et al.  A Compound MRF Texture Model , 2010, 2010 20th International Conference on Pattern Recognition.

[83]  M. Gross,et al.  Analysis of human faces using a measurement-based skin reflectance model , 2006, ACM Trans. Graph..

[84]  A. Rosenfeld,et al.  Mosaic Models for Textures , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[85]  William R. Mathew,et al.  Color as a Science , 2005 .