RTI compression for mobile devices

Currently, Reflectance Transformation Imaging (RTI) technology is restricted to desktop and high performance computing devices. In recent years, mobile devices and tablets have become ubiquitous due to their increased performance. However, the size of RTI files (≈100 MB) limits the range of portable devices capable of displaying RTI files. In this paper, we explore different compression techniques, and develop an RTI viewer prototype for both Android and iOS devices. Experiments with JPEG, JPEG2000, lossless compression show the resulting error for compression ratios of 30:1 is comparable to the error of traditional two-dimensional images. For higher compression rates, we present a novel αβ-JPEG algorithm which compresses color and reflectance information individually.

[1]  Jirí Filip,et al.  Extreme Compression and Modeling of Bidirectional Texture Function , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Thomas Malzbender,et al.  Polynomial texture maps , 2001, SIGGRAPH.

[3]  Antoine Vacavant,et al.  Fast smoothed shock filtering , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[4]  Travis E. Oliphant,et al.  Python for Scientific Computing , 2007, Computing in Science & Engineering.

[5]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[6]  Moshe Caine,et al.  Pixels and Parchment: The Application of RTI and Infrared Imaging to the Dead Sea Scrolls , 2011, EVA.

[7]  Peter-Pike J. Sloan,et al.  Local, deformable precomputed radiance transfer , 2005, ACM Trans. Graph..

[8]  Flemming Friche Rodler.  Wavelet based 3D compression with fast random access for very large volume data , 1999, Proceedings. Seventh Pacific Conference on Computer Graphics and Applications (Cat. No.PR00293).

[9]  David Wheatley,et al.  Rock art and digital technologies: the application of Reflectance Transformation Imaging (RTI) and 3D laser scanning to the study of Late Bronze Age Iberian stelae , 2013 .

[10]  Hembo Pagi,et al.  Reflectance Transformation Imaging Systems for Ancient Documentary Artefacts , 2011, EVA.

[11]  Tien-Tsin Wong,et al.  Noise-resistant hemispherical basis for image-based relighting , 2012 .

[12]  Giovanni Motta,et al.  Compression of Polynomial Texture Maps , 2001 .

[13]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[14]  Anselmo Lastra,et al.  Efficient rendering of spatial bi-directional reflectance distribution functions , 2002, HWWS '02.

[15]  Shu Shi,et al.  A low latency remote rendering system for interactive mobile graphics , 2012 .

[16]  Chang Wen Chen,et al.  Low-delay cloud-based rendering of free viewpoint video for mobile devices , 2013, Optics & Photonics - Optical Engineering + Applications.

[17]  Andrew Chi-Sing Leung,et al.  Noise-resistant fitting for spherical harmonics , 2006, IEEE Transactions on Visualization and Computer Graphics.

[18]  Christopher Schwartz,et al.  Level‐of‐Detail Streaming and Rendering using Bidirectional Sparse Virtual Texture Functions , 2013, Comput. Graph. Forum.

[19]  Chung-Lin Huang,et al.  Texture Compression and Relighting of 3-D Color Objects Using Singular Value Decomposition , 2010, J. Inf. Sci. Eng..

[20]  Reinhard Klein,et al.  Compression and Real-Time Rendering of Measured BTFs Using Local PCA , 2003, VMV.

[21]  Andrew Chi-Sing Leung,et al.  An RBF-based compression method for image-based relighting , 2006, IEEE Transactions on Image Processing.

[22]  Tien-Tsin Wong,et al.  Dense Photometric Stereo: A Markov Random Field Approach , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Jan Kautz,et al.  Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments , 2002 .

[24]  Bernd Girod,et al.  Rate-Distortion Optimized Interactive Light Field Streaming , 2007, IEEE Transactions on Multimedia.

[25]  Shree K. Nayar,et al.  Reflectance and texture of real-world surfaces , 1999, TOGS.

[26]  David Salesin,et al.  Spatio-angular resolution tradeoffs in integral photography , 2006, EGSR '06.