Compressing Bidirectional Texture Functions via Tensor Train Decomposition

Material reflectance properties play a central role in photorealistic rendering. Bidirectional texture functions (BTFs) can faithfully represent these complex properties, but their inherent high dimensionality (texture coordinates, color channels, view and illumination spatial directions) requires many coefficients to encode. Numerous algorithms based on tensor decomposition have been proposed for efficient compression of multidimensional BTF arrays, however, these prior methods still grow exponentially in size with the number of dimensions. We tackle the BTF compression problem with a different model, the tensor train (TT) decomposition. The main difference is that TT compression scales linearly with the input dimensionality and is thus much better suited for high-dimensional data tensors. Furthermore, it allows faster random-access texel reconstruction than the previous Tucker-based approaches. We demonstrate the performance benefits of the TT decomposition in terms of accuracy and visual appearance, compression rate and reconstruction speed.

[1]  Andrew Chi-Sing Leung,et al.  Compressing the illumination-adjustable images with principal component analysis , 2005, IEEE Trans. Circuits Syst. Video Technol..

[2]  Ivan Oseledets,et al.  Tensor-Train Decomposition , 2011, SIAM J. Sci. Comput..

[3]  Zen-Chung Shih,et al.  K-clustered tensor approximation: A sparse multilinear model for real-time rendering , 2012, TOGS.

[4]  Chun Chen,et al.  Hierarchical Tensor Approximation of Multi-Dimensional Visual Data , 2008, IEEE Transactions on Visualization and Computer Graphics.

[5]  Reinhard Klein,et al.  BTF Compression via Sparse Tensor Decomposition , 2009, Comput. Graph. Forum.

[6]  Murat Kurt,et al.  A General BRDF Representation Based on Tensor Decomposition , 2011, Comput. Graph. Forum.

[7]  Renato Pajarola,et al.  Lossy volume compression using Tucker truncation and thresholding , 2016, The Visual Computer.

[8]  Yu-Ting Tsai,et al.  Multiway K-Clustered Tensor Approximation , 2015, ACM Trans. Graph..

[9]  Joos Vandewalle,et al.  On the Best Rank-1 and Rank-(R1 , R2, ... , RN) Approximation of Higher-Order Tensors , 2000, SIAM J. Matrix Anal. Appl..

[10]  N. Ahuja,et al.  Out-of-core tensor approximation of multi-dimensional matrices of visual data , 2005, SIGGRAPH 2005.

[11]  Ralf Sarlette,et al.  Efficient and Realistic Visualization of Cloth , 2003, Rendering Techniques.

[12]  M. Alex O. Vasilescu,et al.  TensorTextures: multilinear image-based rendering , 2004, SIGGRAPH 2004.

[13]  Christopher Schwartz,et al.  Data Driven Surface Reflectance from Sparse and Irregular Samples , 2012, Comput. Graph. Forum.