Shadow induction on optical see-through head-mounted displays

Abstract In this paper, we present two effects of illusion-based virtual shadows on a real surface for optical see-through head-mounted displays without devices that selectively reduce or intercept light rays from the real scene. The virtual shadows are based on the simultaneous brightness-contrast illusion in which a central region surrounded by a lighter one is perceived as darker than one without such a lighter region. To display a virtual shadow, a virtual object with a real image texture is placed around the shadow region as the lighter region to provide a sense of a darker area. We conducted two kinds of experiments to validate the feasibility of our method. The first experiment showed that users tend to perceive the virtual shadow part as darker than the surrounding area with the same physical luminance. The second experiment provided evidence that there are cases in which the virtual shadows can improve the reality of virtual objects.

[1]  P. Bressan,et al.  Simultaneous Lightness Contrast on Plain and Articulated Surrounds , 2006, Perception.

[2]  S. Shapiro,et al.  An Analysis of Variance Test for Normality (Complete Samples) , 1965 .

[3]  Yasuhiro Takaki,et al.  See-through integral imaging display with background occlusion capability. , 2016, Applied optics.

[4]  Masataka Sawayama,et al.  Local computation of lightness on articulated surrounds , 2010, i-Perception.

[5]  Dale Purves,et al.  The statistical structure of natural light patterns determines perceived light intensity. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[6]  Douglas Lanman,et al.  Pinlight displays: wide field of view augmented reality eyeglasses using defocused point light sources , 2014, SIGGRAPH '14.

[7]  Steven K. Shevell,et al.  Brightness contrast from inhomogeneous surrounds , 1996, Vision Research.

[8]  Jannick P. Rolland,et al.  A compact optical see-through head-worn display with occlusion support , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[9]  Hong Hua,et al.  Occlusion capable optical see-through head-mounted display using freeform optics , 2012, 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[10]  Gordon Wetzstein,et al.  Consistent illumination within optical see-through augmented environments , 2003, SIGGRAPH '03.

[11]  Matthias Nießner,et al.  A Lightweight Approach for On-the-Fly Reflectance Estimation , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[12]  Takahiro Kawabe Perceptual Transparency From Cast Shadow , 2019, i-Perception.

[13]  Yuta Itoh,et al.  Occlusion Leak Compensation for Optical See-Through Displays Using a Single-Layer Transmissive Spatial Light Modulator , 2017, IEEE Transactions on Visualization and Computer Graphics.

[14]  A. Gilchrist Lightness contrast and failures of constancy: A common explanation , 1988, Perception & psychophysics.

[15]  Andreas Georgiou,et al.  Holographic near-eye displays for virtual and augmented reality , 2017, ACM Trans. Graph..

[16]  Fumihisa Shibata,et al.  Shadow Inducers: Inconspicuous Highlights for Casting Virtual Shadows on OST-HMOs , 2019, 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[17]  Robert G. D. Steel,et al.  A Rank Sum Test for Comparing All Pairs of Treatments , 1960 .

[18]  R. Shapley,et al.  Brightness induction by local contrast and the spatial dependence of assimilation , 1988, Vision Research.

[19]  Fumihisa Shibata,et al.  Casting Virtual Shadows Based on Brightness Induction for Optical See-Through Displays , 2018, 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[20]  Dieter Schmalstieg,et al.  Efficient and robust radiance transfer for probeless photorealistic augmented reality , 2014, 2014 IEEE Virtual Reality (VR).

[21]  Takeshi Oishi,et al.  Visibility-based blending for real-time applications , 2014, 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[22]  Sei Ikeda,et al.  Can Transparent Virtual Objects Be Represented Realistically on OST-HMDs? , 2019, 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[23]  Mark Billinghurst,et al.  An occlusion capable optical see-through head mount display for supporting co-located collaboration , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[24]  Hiroyuki Ohno,et al.  An optical see-through display for mutual occlusion with a real-time stereovision system , 2001, Comput. Graph..

[25]  Eric G. Heinemann,et al.  A quantitative model for simultaneous brightness induction , 1995, Vision Research.

[26]  F. Mosteller,et al.  Remarks on the method of paired comparisons: III. A test of significance for paired comparisons when equal standard deviations and equal correlations are assumed , 1951, Psychometrika.

[27]  Hong Hua,et al.  Optical see-through head-mounted display with occlusion capability , 2013, Defense, Security, and Sensing.

[28]  D. Jameson,et al.  Complexities of perceived brightness. , 1961, Science.

[29]  M. McCourt,et al.  A multiscale spatial filtering account of the White effect, simultaneous brightness contrast and grating induction , 1999, Vision Research.

[30]  Oliver Bimber,et al.  Occlusion shadows: using projected light to generate realistic occlusion effects for view-dependent optical see-through displays , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[31]  S. Shevell,et al.  Brightness contrast and assimilation from patterned inducing backgrounds , 2004, Vision Research.

[32]  E. William Yund,et al.  Color and brightness contrast effects as a function of spatial variables , 1975, Vision Research.

[33]  Lance Williams,et al.  Casting curved shadows on curved surfaces , 1978, SIGGRAPH.

[34]  Henry Fuchs,et al.  Computational augmented reality eyeglasses , 2013, 2013 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[35]  Jan Kautz,et al.  Exposure Fusion , 2007, 15th Pacific Conference on Computer Graphics and Applications (PG'07).