Perceptual Global Illumination Cancellation in Complex Projection Environments

The unintentional scattering of light between neighboring surfaces in complex projection environments increases the brightness and decreases the contrast, disrupting the appearance of the desired imagery. To achieve satisfactory projection results, the inverse problem of global illumination must be solved to cancel this secondary scattering. In this paper, we propose a global illumination cancellation method that minimizes the perceptual difference between the desired imagery and the actual total illumination in the resulting physical environment. Using Gauss‐Newton and active set methods, we design a fast solver for the bound constrained nonlinear least squares problem raised by the perceptual error metrics. Our solver is further accelerated with a CUDA implementation and multi‐resolution method to achieve 1–2 fps for problems with approximately 3000 variables. We demonstrate the global illumination cancellation algorithm with our multi‐projector system. Results show that our method preserves the color fidelity of the desired imagery significantly better than previous methods.

[1]  Tian-Tsong Ng,et al.  A Dual Theory of Inverse and Forward Light Transport , 2010, ECCV.

[2]  Greg Welch,et al.  The office of the future: a unified approach to image-based modeling and spatially immersive displays , 1998, SIGGRAPH.

[3]  Aditi Majumder,et al.  Color nonuniformity in projection-based displays: analysis and solutions , 2004, IEEE Transactions on Visualization and Computer Graphics.

[4]  P. Toint,et al.  Global convergence of a class of trust region algorithms for optimization with simple bounds , 1988 .

[5]  K. Mclaren XIII—The Development of the CIE 1976 (L* a* b*) Uniform Colour Space and Colour‐difference Formula , 2008 .

[6]  Christopher Young,et al.  A Spatially Augmented Reality Sketching Interface for Architectural Daylighting Design , 2011, IEEE Transactions on Visualization and Computer Graphics.

[7]  Barbara Cutler,et al.  Global Illumination Compensation for Spatially Augmented Reality , 2010, Comput. Graph. Forum.

[8]  Francisco Facchinei,et al.  An Active Set Newton Algorithm for Large-Scale Nonlinear Programs with Box Constraints , 1998, SIAM J. Optim..

[9]  Kuo-Cheng Liu,et al.  A Fidelity Metric for Assessing Visual Quality of Color Images , 2007, 2007 16th International Conference on Computer Communications and Networks.

[10]  D. Bertsekas Projected Newton methods for optimization problems with simple constraints , 1981, 1981 20th IEEE Conference on Decision and Control including the Symposium on Adaptive Processes.

[11]  Donald P. Greenberg,et al.  Modeling the interaction of light between diffuse surfaces , 1984, SIGGRAPH.

[12]  Gordon Wetzstein,et al.  Radiometric Compensation through Inverse Light Transport , 2007, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[13]  Hans-Peter Seidel,et al.  Visible difference predicator for high dynamic range images , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[14]  Steve Marschner,et al.  Dual photography , 2005, ACM Trans. Graph..

[15]  Shree K. Nayar,et al.  A Projection System with Radiometric Compensation for Screen Imperfections , 2003 .

[16]  Marc Levoy,et al.  Dual photography , 2005, SIGGRAPH 2005.

[17]  Kiriakos N. Kutulakos,et al.  Optical computing for fast light transport analysis , 2010, SIGGRAPH 2010.

[18]  Jyh-Ming Lien Point-Based Minkowski Sum Boundary , 2007, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[19]  D. L. Macadam Visual Sensitivities to Color Differences in Daylight , 1942 .

[20]  Oliver Bimber,et al.  Real-Time Adaptive Radiometric Compensation , 2006, IEEE Transactions on Visualization and Computer Graphics.

[21]  Kiriakos N. Kutulakos,et al.  A theory of inverse light transport , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[22]  Yuichi Ohta,et al.  Analytical compensation of inter-reflection for pattern projection , 2006, VRST '06.

[23]  Brian A. Wandell,et al.  A spatial extension of CIELAB for digital color‐image reproduction , 1997 .

[24]  Kenneth Levenberg A METHOD FOR THE SOLUTION OF CERTAIN NON – LINEAR PROBLEMS IN LEAST SQUARES , 1944 .

[25]  Yu Sheng,et al.  Interactive daylighting visualization in spatially augmented reality environments , 2011 .

[26]  Janez Mrcun,et al.  Lipschitz spectrum preserving mappings on algebras of matrices , 1995 .

[27]  Oliver Bimber,et al.  Compensating Indirect Scattering for Immersive and Semi-Immersive Projection Displays , 2006, IEEE Virtual Reality Conference (VR 2006).

[28]  Chong Li,et al.  Convergence behavior of Gauss-Newton's method and extensions of the Smale point estimate theory , 2010, J. Complex..