Perceptual radiometric compensation for inter-reflection in immersive projection environment

We present a fast perceptual radiometric compensation method for inter-reflection in immersive projection environment. Radiometric compensation is the inverse process of light transport. As light transport process can be described by a matrix-vector multiplication equation, radiometric compensation for inter-reflection can be achieved by solving the equation to get the vector, during which matrix inversion should be computed. As the dimensions of the matrix are equivalent to the resolution of images, such matrix inversion is both time and storage consuming. Unlike previous methods, our method adopts projector-camera system to simulate the inversion, and treats the compensation as a non-linear optimization problem which is formulated from full light transport matrix and non-linear color space conversion. To make physical multiplication simulation more practical, the method adjusts the range of projector-camera system adaptively and reduces the high-frequency errors caused by clipping error and measured error to make the compensated results smoother. We implement an immersive projection display prototype. The experiments show that our method achieves better results compared with the previous method.

[1]  Stefania Bellavia,et al.  A Globally Convergent Newton-GMRES Subspace Method for Systems of Nonlinear Equations , 2001, SIAM J. Sci. Comput..

[2]  Lothar Reichel,et al.  On the Choice of Subspace for Iterative Methods for Linear Discrete Ill-Posed Problems , 2001 .

[3]  Yuichi Ohta,et al.  A Compensation Method of Inter-reflection for Pattern Projection onto Non-planar Surface , 2005 .

[4]  Oliver Bimber,et al.  Compensating Indirect Scattering for Immersive and Semi-Immersive Projection Displays , 2006, IEEE Virtual Reality Conference (VR 2006).

[5]  Tony Q. S. Quek,et al.  Radiometric compensation using stratified inverses , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[6]  Aditi Majumder,et al.  Photometric Self-Calibration of a Projector-Camera System , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Tian-Tsong Ng,et al.  A Dual Theory of Inverse and Forward Light Transport , 2010, ECCV.

[8]  Gordon Wetzstein,et al.  Radiometric Compensation through Inverse Light Transport , 2007, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[9]  Yuandong Tian,et al.  A Combined Theory of Defocused Illumination and Global Light Transport , 2012, International Journal of Computer Vision.

[10]  Marc Levoy,et al.  Efficiently acquiring reflectance fields using patterned illumination , 2006 .

[11]  Hideo Saito,et al.  Defocus Blur Correcting Projector-Camera System , 2008, ACIVS.

[12]  Chao Chen,et al.  Perceptual Global Illumination Cancellation in Complex Projection Environments , 2011, EGSR '11.

[13]  Shree K. Nayar,et al.  A Projection System with Radiometric Compensation for Screen Imperfections , 2003 .

[14]  Hassane Sadok,et al.  Implementations of range restricted iterative methods for linear discrete ill-posed problems , 2012 .

[15]  Kosuke Sato,et al.  Dynamic defocus and occlusion compensation of projected imagery by model-based optimal projector selection in multi-projection environment , 2011, Virtual Reality.

[16]  P. Hansen,et al.  Noise propagation in regularizing iterations for image deblurring , 2008 .

[17]  Thomas S. Huang,et al.  Compressive Inverse Light Transport , 2011, BMVC.

[18]  Dongming Lu,et al.  Real-time Continuous Geometric Calibration for Projector-Camera System under Ambient Illumination , 2012, 2012 International Conference on Virtual Reality and Visualization.

[19]  Kiriakos N. Kutulakos,et al.  A theory of inverse light transport , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[20]  Kiriakos N. Kutulakos,et al.  Optical computing for fast light transport analysis , 2010, SIGGRAPH 2010.

[21]  Shree K. Nayar,et al.  Projection defocus analysis for scene capture and image display , 2006, SIGGRAPH 2006.

[22]  Steve Marschner,et al.  Dual photography , 2005, ACM Trans. Graph..

[23]  Hassane Sadok,et al.  Algorithms for range restricted iterative methods for linear discrete ill-posed problems , 2012, Numerical Algorithms.