Real-Time Adaptive Radiometric Compensation

Recent radiometric compensation techniques make it possible to project images onto colored and textured surfaces. This is realized with projector-camera systems by scanning the projection surface on a per-pixel basis. Using the captured information, a compensation image is calculated that neutralizes geometric distortions and color blending caused by the underlying surface. As a result, the brightness and the contrast of the input image is reduced compared to a conventional projection onto a white canvas. If the input image is not manipulated in its intensities, the compensation image can contain values that are outside the dynamic range of the projector. These will lead to clipping errors and to visible artifacts on the surface. In this article, we present an innovative algorithm that dynamically adjusts the content of the input images before radiometric compensation is carried out. This reduces the perceived visual artifacts while simultaneously preserving a maximum of luminance and contrast. The algorithm is implemented entirely on the GPU and is the first of its kind to run in real time.

[1]  Shree K. Nayar,et al.  A projector-camera system with real-time photometric adaptation for dynamic environments , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[2]  Donald P. Greenberg,et al.  A perceptually based physical error metric for realistic image synthesis , 1999, SIGGRAPH.

[3]  Gordon Wetzstein,et al.  Enabling view-dependent stereoscopic projection in real environments , 2005, SIGGRAPH '05.

[4]  Philippe Colantoni,et al.  Fast and Accurate Color Images Processing Using 3D Graphics Cards , 2003, VMV.

[5]  Aditi Majumder,et al.  PixelFlex 2 : A Comprehensive , Automatic , Casually-Aligned Multi-Projector Display , 2003 .

[6]  Mark Ashdown,et al.  Robust Content-Dependent Photometric Projector Compensation , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[7]  Gordon Wetzstein,et al.  Radiometric compensation of global illumination effects with projector-camera systems , 2006, SIGGRAPH '06.

[8]  Fabio Pellacini,et al.  A Perceptually-Based Texture Caching Algorithm for Hardware-Based Rendering , 2001, Rendering Techniques.

[9]  Frédo Durand,et al.  Interactive Tone Mapping , 2000, Rendering Techniques.

[10]  Shree K. Nayar,et al.  A Projection System with Radiometric Compensation for Screen Imperfections , 2003 .

[11]  Hans-Peter Seidel,et al.  Perceptual effects in real-time tone mapping , 2005, SCCG '05.

[12]  Christine D. Piatko,et al.  A visibility matching tone reproduction operator for high dynamic range scenes , 1997, SIGGRAPH '97.

[13]  Oliver Bimber,et al.  Embedded entertainment with smart projectors , 2005, Computer.

[14]  Jeffrey Lubin,et al.  A VISUAL DISCRIMINATION MODEL FOR IMAGING SYSTEM DESIGN AND EVALUATION , 1995 .

[15]  Rick Stevens,et al.  A practical framework to achieve perceptually seamless multi-projector displays , 2003 .

[16]  Oliver Bimber,et al.  Superimposing pictorial artwork with projected imagery , 2005, IEEE MultiMedia.

[17]  Thomas Ertl,et al.  Computer Graphics - Principles and Practice, 3rd Edition , 2014 .

[18]  M. Carter.  Computer graphics: Principles and practice , 1997 .

[19]  Jong-Il Park,et al.  Contrast Enhancement in Direct-Projected Augmented Reality , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[20]  Rui Wang,et al.  Interactive time-dependent tone mapping using programmable graphics hardware , 2003, Rendering Techniques.

[21]  Takahiro Okabe,et al.  Radiometric Compensation in a Projector-Camera System Based Properties of Human Vision System , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[22]  Aditi Majumder,et al.  Perceptual photometric seamlessness in projection-based tiled displays , 2005, TOGS.

[23]  H. Bastian.  Sensation and Perception.—I , 1869, Nature.