Enhancement and Speedup of Photometric Compensation for Projectors by Reducing Inter-Pixel Coupling and Calibration Patterns

For a procam to preserve the color appearance of an image projected on a color surface, the photometric distortion introduced by the color surface has to be properly compensated. The performance of such photometric compensation relies on an accurate estimation of the projector nonlinearity. In this paper, we improve the accuracy of projector nonlinearity estimation by taking inter-pixel coupling into consideration. In addition, to respond quickly to the change of projection area due to projector movement, we reduce the number of calibration patterns from six to one and use the projected image as the calibration pattern. This greatly improves the computational efficiency of re-calibration that needs to be performed on the fly during a multimedia presentation without breaking its continuity. Both objective and subjective results are provided to illustrate the effectiveness of the proposed method for color compensation.

[1]  P. Belhumeur,et al.  Making one object look like another: controlling appearance using a projector-camera system , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[2]  Wencheng Wu,et al.  The CIEDE2000 color-difference formula: Implementation notes, supplementary test data, and mathematical observations , 2005 .

[3]  Niranjan Damera-Venkata,et al.  Realizing Super-Resolution with Superimposed Projection , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Oliver Bimber,et al.  Embedded entertainment with smart projectors , 2005, Computer.

[5]  Jn Morovi,et al.  Color Gamut Mapping , 2008 .

[6]  Mark Ashdown,et al.  Robust Content-Dependent Photometric Projector Compensation , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[7]  S. Matsuda,et al.  Flare as applied to photographic lenses. , 1972, Applied optics.

[8]  Shree K. Nayar,et al.  A projector-camera system with real-time photometric adaptation for dynamic environments , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[9]  Homer H. Chen,et al.  Radiometric compensation for procam system based on anchoring theory , 2013, 2013 IEEE International Conference on Image Processing.

[10]  Shoji Tominaga,et al.  Surface Identification Using the Dichromatic Reflection Model , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Takahiro Okabe,et al.  Radiometric Compensation in a Projector-Camera System Based Properties of Human Vision System , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[12]  Jong-Il Park,et al.  Contrast Enhancement in Direct-Projected Augmented Reality , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[13]  Gordon Wetzstein,et al.  The Visual Computing of Projector‐Camera Systems , 2008, SIGGRAPH '08.

[14]  Homer H. Chen,et al.  Quality enhancement of procam system by radiometric compensation , 2012, 2012 IEEE 14th International Workshop on Multimedia Signal Processing (MMSP).

[15]  Homer H. Chen,et al.  Preserving image color appearance on non-white projection surfaces , 2015, 2015 IEEE International Conference on Multimedia & Expo Workshops (ICMEW).

[16]  Henry Fuchs,et al.  Real-Time Projector Tracking on Complex Geometry Using Ordinary Imagery , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  R. Berns,et al.  Image color-appearance specification through extension of CIELAB , 1993 .

[18]  Ruigang Yang,et al.  Automatic and Continuous Projector Display Surface Estimation Using Everyday Imagery , 2001, WSCG.

[19]  Shree K. Nayar,et al.  A Projection System with Radiometric Compensation for Screen Imperfections , 2003 .

[20]  G. Kuwabara.  On the Flare of Lenses , 1953 .

[21]  Gordon Wetzstein,et al.  Radiometric Compensation through Inverse Light Transport , 2007, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[22]  M. Ronnier Luo,et al.  The Fundamentals of Gamut Mapping: A Survey , 2001, Journal of Imaging Science and Technology.

[23]  Anselm Grundhöfer,et al.  Robust, Error-Tolerant Photometric Projector Compensation , 2015, IEEE Transactions on Image Processing.

[24]  Ruigang Yang,et al.  PixelFlex: a reconfigurable multi-projector display system , 2001, Proceedings Visualization, 2001. VIS '01..

[25]  Oliver Bimber,et al.  Imperceptible Calibration for Radiometric Compensation , 2007, Eurographics.

[26]  Albert A. Michelson,et al.  Studies in Optics , 1995 .

[27]  T. Smith,et al.  The C.I.E. colorimetric standards and their use , 1931 .

[28]  Meng Li,et al.  Color mixing property of a projector-camera system , 2008, PROCAMS '08.

[29]  Oliver Bimber,et al.  Real-Time Adaptive Radiometric Compensation , 2006, IEEE Transactions on Visualization and Computer Graphics.

[30]  Christian Jacquemin,et al.  Photometric Compensation to Dynamic Surfaces in a Projector-Camera System , 2014, ECCV Workshops.

[31]  Anselm Grundhöfer,et al.  Practical Non-linear Photometric Projector Compensation , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[32]  T. Yoshida,et al.  A Virtual Color Reconstruction System for Real Heritage with Light Projection , 2003 .