High dynamic range preserving compression of light fields and reflectance fields

Surface structures at meso- and micro-scale are almost impossible to convincingly reproduce with analytical BRDFs. Therefore, image-based methods like light fields, surface light fields, reflectance fields and bidirectional texture functions became widely accepted to represent spatially nonuniform surfaces. For all of these techniques a set of input photographs from varying view and/or light directions is taken that usually by far exceeds the available graphics memory. The recent development of HDR photography additionally increased the amount of data generated by current acquisition systems since every image needs to be stored as an array of floating point numbers. Furthermore, statistical compression methods -- like principal component analysis (PCA) -- that are commonly used for compression are optimal for linearly distributed values and thus cannot handle the high dynamic range radiance values appropriately. In this paper, we address both of these problems introduced by the acquisition of high dynamic range light and reflectance fields. Instead of directly compressing the radiance data with a truncated PCA, a non-linear transformation is applied to input values in advance to assure an almost uniform distribution. This does not only significantly improve the approximation quality after an arbitrary tone mapping operator is applied to the reconstructed HDR images, but also allows to efficiently quantize the principal components and even apply hardware-supported texture compression without much further loss of quality. Thus, in addition to the improved visual quality, the storage requirements are reduced by more than an order of magnitude.

[1]  Tomas Akenine-Möller,et al.  High dynamic range texture compression for graphics hardware , 2006, ACM Trans. Graph..

[2]  Edward H. Adelson,et al.  Compressing and companding high dynamic range images with subband architectures , 2005, SIGGRAPH 2005.

[3]  Jan Kautz,et al.  Hardware Rendering with Bidirectional Reflectances , 1999 .

[4]  Jan Kautz,et al.  Interactive rendering with arbitrary BRDFs using separable approximations , 1999, SIGGRAPH '99.

[5]  Shree K. Nayar,et al.  Reflectance and texture of real-world surfaces , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  C. Lanczos An iteration method for the solution of the eigenvalue problem of linear differential and integral operators , 1950 .

[7]  Paul E. Debevec,et al.  Acquiring the reflectance field of a human face , 2000, SIGGRAPH.

[8]  Andreas Kolb,et al.  Homomorphic factorization of BRDF-based lighting computation , 2002, ACM Trans. Graph..

[9]  Kimmo Roimela,et al.  High dynamic range texture compression , 2006, ACM Trans. Graph..

[10]  Real-Time BRDF-based Lighting using Cube-Maps , 2002 .

[11]  Charles E. Hughes,et al.  High-dynamic-range still-image encoding in JPEG 2000 , 2005, IEEE Computer Graphics and Applications.

[12]  Wei-Chao Chen,et al.  Light field mapping: efficient representation and hardware rendering of surface light fields , 2002, SIGGRAPH.

[13]  Alan Chalmers,et al.  Evaluation of tone mapping operators using a High Dynamic Range display , 2005, ACM Trans. Graph..

[14]  Reinhard Klein,et al.  Compression and Real-Time Rendering of Measured BTFs Using Local PCA , 2003, VMV.

[15]  Tomas Akenine-Möller,et al.  High dynamic range texture compression for graphics hardware , 2006, SIGGRAPH 2006.

[16]  Michael D. McCool,et al.  Homomorphic factorization of BRDFs for high-performance rendering , 2001, SIGGRAPH.

[17]  Ralf Sarlette,et al.  Acquisition, Synthesis, and Rendering of Bidirectional Texture Functions , 2005, Comput. Graph. Forum.

[18]  Jitendra Malik,et al.  Recovering high dynamic range radiance maps from photographs , 1997, SIGGRAPH.

[19]  Ralf Sarlette,et al.  Data‐driven Local Coordinate Systems for Image‐Based Rendering , 2006, Comput. Graph. Forum.

[20]  Katsushi Ikeuchi,et al.  Appearance compression and synthesis based on 3D model for mixed reality , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.