SmartColor: Real-Time Color and Contrast Correction for Optical See-Through Head-Mounted Displays

Users of optical see-through head-mounted displays (OHMD) perceive color as a blend of the display color and the background. Color-blending is a major usability challenge as it leads to loss of color encodings and poor text legibility. Color correction aims at mitigating color blending by producing an alternative color which, when blended with the background, more closely approximates the color originally intended. In this paper we present an end-to-end approach to the color blending problem addressing the distortions introduced by the transparent material of the display efficiently and in realtime. We also present a user evaluation of correction efficiency. Finally, we present a graphics library called SmartColor showcasing the use of color correction for different types of display content. SmartColor uses color correction to provide three management strategies: correction, contrast, and show-up-on-contrast. Correction determines the alternate color which best preserves the original color. Contrast determines the color which best supports text legibility while preserving as much of the original hue. Show-up-on-contrast makes a component visible when a related component does not have enough contrast to be legible. We describe SmartColor's architecture and illustrate the color strategies for various types of display content.

[1]  Marcus Wan,et al.  Wearable mobile augmented reality: evaluating outdoor user experience , 2011, VRCAI '11.

[2]  Lanny S. Smoot,et al.  LCD masks for spatial augmented reality , 2014, Electronic Imaging.

[3]  David R. Flatla,et al.  Color correction for optical see-through displays using display color profiles , 2013, VRST '13.

[4]  Silvia Zuffi,et al.  Human Computer Interaction: Legibility and Contrast , 2007, 14th International Conference on Image Analysis and Processing (ICIAP 2007).

[5]  Gordon Wetzstein,et al.  Consistent illumination within optical see-through augmented environments , 2003, SIGGRAPH '03.

[6]  Wolfgang Heiden,et al.  Colorimetric and Photometric Compensation for Optical See-Through Displays , 2009, HCI.

[7]  Wencheng Wu,et al.  The CIEDE2000 color-difference formula: Implementation notes, supplementary test data, and mathematical observations , 2005 .

[8]  Hiroyuki Ohno,et al.  Occlusive optical see-through displays in a collaborative setup , 2002, SIGGRAPH '02.

[9]  Steven K. Feiner,et al.  Perceptual issues in augmented reality revisited , 2010, 2010 IEEE International Symposium on Mixed and Augmented Reality.

[10]  Hong Hua,et al.  Optical see-through head-mounted display with occlusion capability , 2013, Defense, Security, and Sensing.

[11]  Hiroyuki Ohno,et al.  An optical see-through display for mutual occlusion with a real-time stereovision system , 2001, Comput. Graph..

[12]  Stephen E. Palmer,et al.  Perception of partly occluded objects: A microgenetic analysis. , 1992 .

[13]  J. Edward Swan,et al.  More than meets the eye: An engineering study to empirically examine the blending of real and virtual color spaces , 2010, 2010 IEEE Virtual Reality Conference (VR).

[14]  Henry Fuchs,et al.  Computational augmented reality eyeglasses , 2013, 2013 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[15]  Mihran Tuceryan,et al.  Automatic determination of text readability over textured backgrounds for augmented reality systems , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[16]  Jannick P. Rolland,et al.  A compact optical see-through head-worn display with occlusion support , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[17]  Hong Hua,et al.  Occlusion capable optical see-through head-mounted display using freeform optics , 2012, 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[18]  Reinhard Koch,et al.  Interactive visualization technique for truthful color reproduction in spatial augmented reality applications , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[19]  Jeffrey Heer,et al.  Color naming models for color selection, image editing and palette design , 2012, CHI.

[20]  Tsutomu Terada,et al.  An information layout method for an optical see-through head mounted display focusing on the viewability , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[21]  L. V. Eycken,et al.  Evaluation of Uniform Color Spaces Developed after the Adoption of CIELAB and CIELUV , 1994, Color Research & Application.

[22]  Assessing the Usability of a Wearable Computer System For Outdoor Pedestrian Navigation , 2005 .

[23]  Ramesh Raskar,et al.  Modern approaches to augmented reality: introduction to current approaches , 2006, SIGGRAPH Courses.