Exposing photo manipulation with inconsistent shadows

We describe a geometric technique to detect physically inconsistent arrangements of shadows in an image. This technique combines multiple constraints from cast and attached shadows to constrain the projected location of a point light source. The consistency of the shadows is posed as a linear programming problem. A feasible solution indicates that the collection of shadows is physically plausible, while a failure to find a solution provides evidence of photo tampering.

[1]  Hany Farid,et al.  Exposing Digital Forgeries in Complex Lighting Environments , 2007, IEEE Transactions on Information Forensics and Security.

[2]  Sylvia C Pont,et al.  The Visual Light Field , 2007, Perception.

[3]  Takahiro Okabe,et al.  Spherical harmonics vs. Haar wavelets: basis for recovering illumination from cast shadows , 2004, CVPR 2004.

[4]  H. Farid,et al.  Image forgery detection , 2009, IEEE Signal Processing Magazine.

[5]  Antonio Criminisi,et al.  3D-aware image editing for out of bounds photography , 2009, Graphics Interface.

[6]  Hany Farid,et al.  Exposing digital forgeries from 3-D lighting environments , 2010, 2010 IEEE International Workshop on Information Forensics and Security.

[7]  Jan-Olof Eklundh,et al.  Automatic estimation of the projected light source direction , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[8]  J. Koenderink,et al.  Perception of Illumination Direction in Images of 3-D Convex Objects: Influence of Surface Materials and Light Fields , 2006, Perception.

[9]  Mary J. Bravo,et al.  Image forensic analyses that elude the human visual system , 2010, Electronic Imaging.

[10]  David G. Stork,et al.  Estimating the location of illuminants in realist master paintings Computer image analysis addresses a debate in art history of the Baroque , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[11]  H. Farid.  A Survey of Image Forgery Detection , 2008 .

[12]  Alexei A. Efros,et al.  Estimating the Natural Illumination Conditions from a Single Outdoor Image , 2012, International Journal of Computer Vision.

[13]  Takahiro Okabe,et al.  Spherical harmonics vs. Haar wavelets: basis for recovering illumination from cast shadows , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[14]  Steffen Werner,et al.  Why Cast Shadows are Expendable: Insensitivity of Human Observers and the Inherent Ambiguity of Cast Shadows in Pictorial Art , 2004, Perception.

[15]  J. Koenderink,et al.  Matching illumination of solid objects , 2007, Perception & psychophysics.

[16]  Xiaochun Cao,et al.  Identifying Image Composites Through Shadow Matte Consistency , 2011, IEEE Transactions on Information Forensics and Security.

[17]  Pascal Mamassian,et al.  Impossible Shadows and the Shadow Correspondence Problem , 2004, Perception.

[18]  Patrick Cavanagh,et al.  Perceiving Illumination Inconsistencies in Scenes , 2005, Perception.

[19]  John Hart,et al.  ACM Transactions on Graphics , 2004, SIGGRAPH 2004.

[20]  Xiaochun Cao,et al.  Detecting photographic composites using shadows , 2009, 2009 IEEE International Conference on Multimedia and Expo.

[21]  Pat Hanrahan,et al.  An efficient representation for irradiance environment maps , 2001, SIGGRAPH.

[22]  Maneesh Agrawala,et al.  The influence of shape cues on the perception of lighting direction. , 2010, Journal of vision.

[23]  Katsushi Ikeuchi,et al.  Illumination from Shadows , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Hany Farid,et al.  Exposing digital forgeries by detecting inconsistencies in lighting , 2005, MM&Sec '05.

[25]  David A. Forsyth,et al.  Rendering synthetic objects into legacy photographs , 2011, ACM Trans. Graph..

[26]  J. Koenderink,et al.  Light Direction from Shad(ow)ed Random Gaussian Surfaces , 2004, Perception.