Perceptually Based Appearance Modification for Compliant Appearance Editing

Projection‐based appearances are used in a variety of computer graphics applications to impart different appearances onto physical surfaces using digitally controlled projector light. To achieve a compliant appearance, all points on the physical surface must be altered to the colours of the desired target appearance; otherwise, an incompliant appearance results in a misleading visualization. Previous systems typically assume to operate with compliant appearances or restrict themselves to the simpler case of white surfaces. To achieve compliancy, one may change the physical surface's albedo, increase the amount of projector light radiance available or modify the target appearance's colours. This paper presents an approach to modify a target appearance to achieve compliant appearance editing without altering the physical surface or the projector setup. Our system minimally alters the target appearance's colours while maintaining cues important for perceptual similarity (e.g. colour constancy). First, we discuss how to measure colour compliancy. Next, we describe our approach to partition the physical surface into patches based on the surface's colours and the target appearance's colours. Finally, we describe our appearance optimization process, which computes a compliant appearance that is as perceptually similar as possible to the target appearance's colours. We perform several real‐world projection‐based appearances and compare our results to naïve approaches, which either ignore compliancy or simply reduce the appearance's overall brightness.

[1]  Aditi Majumder,et al.  ADICT: Accurate Direct and Inverse Color Transformation , 2010, ECCV.

[2]  Shree K. Nayar,et al.  A Projection System with Radiometric Compensation for Screen Imperfections , 2003 .

[3]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Zygmunt Pizlo,et al.  Characterization of red-green and blue-yellow opponent channels , 2007 .

[5]  Oliver Bimber,et al.  Superimposing dynamic range , 2008, SIGGRAPH Asia '08.

[6]  Shree K. Nayar,et al.  Making one object look like another: controlling appearance using a projector-camera system , 2004, CVPR 2004.

[7]  Ramesh Raskar,et al.  Dynamic shader lamps : painting on movable objects , 2001, Proceedings IEEE and ACM International Symposium on Augmented Reality.

[8]  Mark D. Fairchild,et al.  General-Purpose Gamut-Mapping Algorithms: Evaluation of Contrast-Preserving Rescaling Functions for Color Gamut Mapping , 1999, CIC.

[9]  Peter Zolliker,et al.  Retaining Local Image Information in Gamut Mapping Algorithms , 2007, IEEE Transactions on Image Processing.

[10]  E. Land The retinex theory of color vision. , 1977, Scientific American.

[11]  Gordon Wetzstein,et al.  The Visual Computing of Projector‐Camera Systems , 2008, SIGGRAPH '08.

[12]  Henry Fuchs,et al.  A Unified Multi-Surface, Multi-ResolutionWorkspace with Camera-Based Scanning and Projector-Based Illumination , 2007, EGVE.

[13]  Meenakshisundaram Gopi,et al.  Color Seamlessness in Multi-Projector Displays Using Constrained Gamut Morphing , 2009, IEEE Transactions on Visualization and Computer Graphics.

[14]  Greg Welch,et al.  Shader Lamps: Animating Real Objects With Image-Based Illumination , 2001, Rendering Techniques.

[15]  Oliver Bimber,et al.  Real-Time Adaptive Radiometric Compensation , 2006, IEEE Transactions on Visualization and Computer Graphics.

[16]  Takayuki Okatani,et al.  Shape Reconstruction by Combination of Structured-Light Projection and Photometric Stereo Using a Projector-Camera System , 2009, PSIVT.

[17]  Gustav J. Braun,et al.  A Paradigm for color gamut mapping of pictorial images , 1999 .

[18]  Aditi Majumder,et al.  Perceptual photometric seamlessness in projection-based tiled displays , 2005, TOGS.

[19]  Daniel G. Aliaga,et al.  Projector Placement Planning for High Quality Visualizations on Real-World Colored Objects , 2010, IEEE Transactions on Visualization and Computer Graphics.

[20]  Gordon Wetzstein,et al.  Radiometric Compensation through Inverse Light Transport , 2007, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[21]  Michael Elad,et al.  Space-dependent color gamut mapping: a variational approach , 2005, IEEE Transactions on Image Processing.

[22]  Reiner Eschbach,et al.  Gamut Mapping to Preserve Spatial Luminance Variations , 2000, CIC.

[23]  Daniel G. Aliaga,et al.  A virtual restoration stage for real-world objects , 2008, SIGGRAPH Asia '08.