Cast Shadow Illusions

Shadows are everywhere, but they usually go unnoticed. We do, however, use their consequences all the time. Figure 1A shows two pictures each with a green square in front of a checkerboard background. The two pictures differ only in the cast shadows of the square. Because of these differences, the right square appears to be further from the background than the left square. By adding motion to the cast shadow, the effect on the perception of depth can be made quite striking. Moving the shadow, leaving the square fixed in the image, results in the square appearing to move in depth (see: http://youtu.be/ig2CV1TLn5A). It is only with scrutiny that one is convinced that the square is not moving at all within the picture frame. In particular, the square is not changing size, as it should if it was indeed moving in depth. Shadows seem to create a paradox for the visual system. While on the one hand they can be quite useful as cues for depth, their unobtrusiveness suggests that there may be good reasons for a visual system to get rid of them.1 Cast shadows can be distinguished from “attached” or “form” shadows (see Mamassian et al., 1998; Castiello, 2001). An attached shadow on an object is the darkened surface that faces away from the light source. A cast shadow on a surface is the dark area created by an object blocking light onto that surface. A cast shadow can also be created when part of an object blocks light onto another part of the same object. For simplicity, in this chapter, the word “shadow” will usually refer to “cast shadow”.

[1]  David L. Waltz,et al.  Generating Semantic Descriptions From Drawings of Scenes With Shadows , 1972 .

[2]  Alan L. Yuille,et al.  An Extremum Principle for Shape from Contour , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  D. Knill,et al.  The perception of cast shadows , 1998, Trends in Cognitive Sciences.

[4]  D Kersten,et al.  Perceptual categories for spatial layout. , 1997, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[5]  Frederick A. A. Kingdom,et al.  Colour vision brings clarity to shadows , 2010 .

[6]  Steffen Werner,et al.  Why Cast Shadows are Expendable: Insensitivity of Human Observers and the Inherent Ambiguity of Cast Shadows in Pictorial Art , 2004, Perception.

[7]  Hany Farid The Lee Harvey Oswald Backyard Photos: Real or Fake? , 2009, Perception.

[8]  Heinrich H Bülthoff,et al.  Why the visual recognition system might encode the effects of illumination , 1998, Vision Research.

[9]  U. Castiello,et al.  Differential Effects of Cast Shadows on Perception and Action , 2004, Perception.

[10]  Wendy L. Braje,et al.  Invariant Recognition of Natural Objects in the Presence of Shadows , 2000, Perception.

[11]  Patrick Cavanagh,et al.  The Influence of Cast Shadows on Visual Search , 2004, Perception.

[12]  Patrick Cavanagh,et al.  Perceiving Illumination Inconsistencies in Scenes , 2005, Perception.

[13]  Alfred Cuschieri,et al.  Optimum shadow-casting illumination for endoscopic task performance. , 2004, Archives of surgery.

[14]  M. Landy,et al.  Measurement and modeling of depth cue combination: in defense of weak fusion , 1995, Vision Research.

[15]  H. Bülthoff,et al.  Merging the senses into a robust percept , 2004, Trends in Cognitive Sciences.

[16]  Pascal Mamassian,et al.  Impossible Shadows and the Shadow Correspondence Problem , 2004, Perception.

[17]  Francesca Fiorani The Colors of Leonardo's Shadows , 2008, Leonardo.

[18]  Patrick Cavanagh,et al.  The artist as neuroscientist Artistic licence taps into the simplified physics used by our brain to recognize everyday scenes , says , 2005 .

[19]  Sieu K Khuu,et al.  Detecting the structural form of cast shadows patterns. , 2012, Journal of vision.

[20]  gombrich-e-h Shadows, the Depiction of Cast Shadows in Western Art , 1995 .

[21]  Peter Shirley,et al.  Visual Glue , 1998 .

[22]  U. Leonards,et al.  What makes cast shadows hard to see? , 2010, Journal of vision.

[23]  Tomoko Imura,et al.  Pacman in the sky with shadows: the effect of cast shadows on the perceptual completion of occluded figures by chimpanzees and humans , 2010, Behavioral and Brain Functions.

[25]  Cheng Lu,et al.  Entropy Minimization for Shadow Removal , 2009, International Journal of Computer Vision.

[26]  D Kersten,et al.  Moving Cast Shadows Induce Apparent Motion in Depth , 1997, Perception.

[27]  Pascal Mamassian,et al.  Illusory motion from shadows , 1996, Nature.

[28]  John M. Findlay,et al.  Representations of Vision: Trends and Tacit Assumptions in Vision Research , 2009 .

[29]  Wendy L. Braje,et al.  Illumination effects in face recognition , 1998, Psychobiology.

[30]  Hannah M. Dee,et al.  The Perception and Content of Cast Shadows: An Interdisciplinary Review , 2011, Spatial Cogn. Comput..

[31]  M. Goodale,et al.  The visual brain in action , 1995 .

[32]  Roberto Casati,et al.  Shadows: Unlocking Their Secrets, from Plato to Our Time , 2004 .

[33]  Brian E. Smits,et al.  Use of interreflection and shadow for surface contact , 2001, Perception & psychophysics.

[34]  Patrick Cavanagh,et al.  What's up in top-down processing? , 1991 .

[35]  Narumi Katsuyama,et al.  Perception of object motion in three-dimensional space induced by cast shadows , 2011, NeuroImage.

[36]  James E. Cutting,et al.  Perceiving Layout and Knowing Distances , 1995 .

[37]  D. Knill,et al.  Geometry of shadows. , 1997, Journal of the Optical Society of America. A, Optics, image science, and vision.

[38]  Roberto Casati,et al.  Some Varieties of Shadow Illusions: Split Shadows, Occluded Shadows, Stolen Shadows, and Shadows of Shadows , 2012, Perception.

[39]  James E. Cutting,et al.  Chapter 3 – Perceiving Layout and Knowing Distances: The Integration, Relative Potency, and Contextual Use of Different Information about Depth* , 1995 .

[40]  Roberto Casati,et al.  The Shadow Knows: A Primer on the Informational Structure of Cast Shadows , 2004, Perception.

[41]  Mark S. Drew,et al.  Removing Shadows from Images , 2002, ECCV.

[42]  David C Knill,et al.  Binocular and monocular depth cues in online feedback control of 3D pointing movement. , 2011, Journal of vision.

[43]  Roberto Casati The Copycat Solution to the Shadow Correspondence Problem , 2008, Perception.

[44]  A. Yonas,et al.  Infants’ perception of depth from cast shadows , 2006, Perception & psychophysics.

[45]  Akihiro Yagi,et al.  Perception of motion trajectory of object from the moving cast shadow in infants , 2006, Vision Research.

[46]  Antonio Medina Puerta,et al.  The power of shadows: shadow stereopsis , 1989 .

[47]  Jiejie Zhu,et al.  Learning to recognize shadows in monochromatic natural images , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[48]  George J Andersen,et al.  Perception of Scene Layout from Optical Contact, Shadows, and Motion , 2004, Perception.

[49]  Charless C. Fowlkes,et al.  Natural-Scene Statistics Predict How the Figure–Ground Cue of Convexity Affects Human Depth Perception , 2010, The Journal of Neuroscience.

[50]  Tomoko Imura,et al.  Moving shadows contribute to the corridor illusion in a chimpanzee (Pan troglodytes). , 2009, Journal of comparative psychology.

[51]  Paul R. Schrater,et al.  How Optimal Depth Cue Integration Depends on the Task , 2000, International Journal of Computer Vision.

[52]  Kayo Miura,et al.  Cast shadow can modulate the judged final position of a moving target , 2010, Attention, perception & psychophysics.

[53]  Tom Troscianko,et al.  Search for gross illumination discrepancies in images of natural objects. , 2009, Journal of vision.

[54]  James J. Clark,et al.  Data Fusion for Sensory Information Processing Systems , 1990 .

[55]  R. Jacobs,et al.  Optimal integration of texture and motion cues to depth , 1999, Vision Research.

[56]  H H Bülthoff,et al.  Integration of depth modules: stereo and shading. , 1988, Journal of the Optical Society of America. A, Optics and image science.