An Examplar-Based Approach for Texture Compaction Synthesis and Retrieval

A texture representation should corroborate various functions of a texture. In this paper, we present a novel approach that incorporates texture features for retrieval in an examplar-based texture compaction and synthesis algorithm. The original texture is compacted and compressed in the encoder to obtain a thumbnail texture, which the decoder then synthesizes to obtain a perceptually high quality texture. We propose using a probabilistic framework based on the generalized EM algorithm to analyze the solutions of the approach. Our experiment results show that a high quality synthesized texture can be generated in the decoder from a compressed thumbnail texture. The number of bits in the compressed thumbnail is 400 times lower than that in the original texture and 50 times lower than that needed to compress the original texture using JPEG2000. We also show that, in terms of retrieval and synthesization, our compressed and compacted textures perform better than compressed cropped textures and compressed compacted textures derived by the patchwork algorithm.

[1]  Nuno Vasconcelos,et al.  Library-based image coding , 1994, Proceedings of ICASSP '94. IEEE International Conference on Acoustics, Speech and Signal Processing.

[2]  Tomas Akenine-Möller,et al.  iPACKMAN: high-quality, low-complexity texture compression for mobile phones , 2005, HWWS '05.

[3]  N. England,et al.  Graphics Hardware , 2019, IEEE Computer Graphics and Applications.

[4]  Alexei A. Efros,et al.  Image quilting for texture synthesis and transfer , 2001, SIGGRAPH.

[5]  Brendan J. Frey,et al.  Graphical Models for Machine Learning and Digital Communication , 1998 .

[6]  Xuejie Qin,et al.  Aura 3D Textures , 2007, IEEE Transactions on Visualization and Computer Graphics.

[7]  Minh N. Do,et al.  Wavelet-based texture retrieval using generalized Gaussian density and Kullback-Leibler distance , 2002, IEEE Trans. Image Process..

[8]  Kun Zhou,et al.  Inverse texture synthesis , 2008, ACM Trans. Graph..

[9]  Charles E. Hughes,et al.  High-dynamic-range still-image encoding in JPEG 2000 , 2005, IEEE Computer Graphics and Applications.

[10]  Matti Pietikäinen,et al.  Unsupervised texture segmentation using feature distributions , 1997, Pattern Recognit..

[11]  James R. Bergen,et al.  Pyramid-based texture analysis/synthesis , 1995, Proceedings., International Conference on Image Processing.

[12]  Baining Guo,et al.  Context-aware textures , 2007, TOGS.

[13]  Yanxi Liu,et al.  Near-regular texture analysis and manipulation , 2004, SIGGRAPH 2004.

[14]  Saïd Ladjal,et al.  Exemplar-Based Inpainting from a Variational Point of View , 2010, SIAM J. Math. Anal..

[15]  Michael S. Lew Next-Generation Web Searches for Visual Content , 2000, Computer.

[16]  Baining Guo,et al.  Real-time texture synthesis by patch-based sampling , 2001, TOGS.

[17]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Rupert Paget,et al.  Texture synthesis via a noncausal nonparametric multiscale Markov random field , 1998, IEEE Trans. Image Process..

[19]  Eitan Grinspun,et al.  Multiscale texture synthesis , 2008, SIGGRAPH 2008.

[20]  Rosalind W. Picard A Society of Models for Video and Image Libraries , 1996, IBM Syst. J..

[21]  Alessandro Neri,et al.  A perceptually lossless, model-based, texture compression technique , 2000, IEEE Trans. Image Process..

[22]  Moulay A. Akhloufi,et al.  A New Color-Texture Approach for Industrial Products Inspection , 2008, J. Multim..

[23]  Eero P. Simoncelli,et al.  A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients , 2000, International Journal of Computer Vision.

[24]  Linda G. Shapiro,et al.  Efficient content-based retrieval: experimental results , 1999, Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries (CBAIVL'99).

[25]  Sung Yong Shin,et al.  On pixel-based texture synthesis by non-parametric sampling , 2006, Comput. Graph..

[26]  P. Bickel,et al.  Texture synthesis and nonparametric resampling of random fields , 2006, math/0611258.

[27]  Wen-Liang Hwang,et al.  Performance evaluation of a novel sampling-based texture synthesis technique using different sized patches , 2008, Signal Image Video Process..

[28]  Nuno Vasconcelos,et al.  Library-based coding: a representation for efficient video compression and retrieval , 1997, Proceedings DCC '97. Data Compression Conference.

[29]  Marc Levoy,et al.  Fast texture synthesis using tree-structured vector quantization , 2000, SIGGRAPH.

[30]  Kimmo Roimela,et al.  High dynamic range texture compression , 2006, ACM Trans. Graph..

[31]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Alessandro Neri,et al.  Texture synthesis-by-analysis with hard-limited Gaussian processes , 1998, IEEE Trans. Image Process..