Exposing photo manipulation with inconsistent reflections

The advent of sophisticated photo editing software has made it increasingly easier to manipulate digital images. Often visual inspection cannot definitively distinguish the resulting forgeries from authentic photographs. In response, forensic techniques have emerged to detect geometric or statistical inconsistencies that result from specific forms of photo manipulation. In this article we describe a new forensic technique that focuses on geometric inconsistencies that arise when fake reflections are inserted into a photograph or when a photograph containing reflections is manipulated. This analysis employs basic rules of reflective geometry and linear perspective projection, makes minimal assumptions about the scene geometry, and only requires the user to identify corresponding points on an object and its reflection. The analysis is also insensitive to common image editing operations such as resampling, color manipulations, and lossy compression. We demonstrate this technique with both visually plausible forgeries of our own creation and commercially produced forgeries.

[1]  S. McKee,et al.  Visual acuity in the presence of retinal-image motion. , 1975, Journal of the Optical Society of America.

[2]  M. Potter Short-term conceptual memory for pictures. , 1976, Journal of experimental psychology. Human learning and memory.

[3]  John Montague Basic Perspective Drawing , 1985 .

[4]  M. Holly The psychology of perspective and renaissance art , 1989 .

[5]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[6]  M J Bravo,et al.  The Perception of Texture on Folded Surfaces , 2001, Perception.

[7]  M. Gazzaniga The new cognitive neurosciences, 2nd edition , 2002 .

[8]  Matthew P. Gerrie,et al.  A picture is worth a thousand lies: Using false photographs to create false childhood memories , 2002, Psychonomic bulletin & review.

[9]  Heiko Hecht,et al.  Naive optics: understanding the geometry of mirror reflections. , 2002, Journal of experimental psychology. Human perception and performance.

[10]  Marco Bertamini,et al.  The Venus Effect: People's Understanding of Mirror Reflections in Paintings , 2003, Perception.

[11]  B. Caprile,et al.  Using vanishing points for camera calibration , 1990, International Journal of Computer Vision.

[12]  Jessica Fridrich,et al.  Detection of Copy-Move Forgery in Digital Images , 2004 .

[13]  John Hart,et al.  ACM Transactions on Graphics , 2004, SIGGRAPH 2004.

[14]  Shih-Fu Chang,et al.  A model for image splicing , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[15]  Matthew P. Gerrie,et al.  When Photographs Create False Memories , 2005 .

[16]  M. Garry,et al.  Actually, a picture is worth less than 45 words: Narratives produce more false memories than photographs do , 2005, Psychonomic bulletin & review.

[17]  Hany Farid,et al.  Exposing digital forgeries by detecting traces of resampling , 2005, IEEE Transactions on Signal Processing.

[18]  O. Scholz,et al.  When is a picture? , 1993, Synthese.

[19]  M. Banks,et al.  Why pictures look right when viewed from the wrong place , 2005, Nature Neuroscience.

[20]  Alin C. Popescu,et al.  Exposing digital forgeries in color filter array interpolated images , 2005, IEEE Transactions on Signal Processing.

[21]  Hany Farid,et al.  Exposing digital forgeries by detecting inconsistencies in lighting , 2005, MM&Sec '05.

[22]  Marco Bertamini,et al.  On what people know about images on mirrors , 2005, Cognition.

[23]  Patrick Cavanagh,et al.  Perceiving Illumination Inconsistencies in Scenes , 2005, Perception.

[24]  Clone scientist relied on peers and Korean pride. , 2005, The New York times on the Web.

[25]  Hany Farid,et al.  Exposing digital forgeries through chromatic aberration , 2006, MM&Sec '06.

[26]  Pawan Sinha,et al.  Face Recognition by Humans: Nineteen Results All Computer Vision Researchers Should Know About , 2006, Proceedings of the IEEE.

[27]  Miroslav Goljan,et al.  Digital camera identification from sensor pattern noise , 2006, IEEE Transactions on Information Forensics and Security.

[28]  Tim Shelbourne Photoshop Cs3 Photo Effects Cookbook , 2007 .

[29]  S. Avidan,et al.  Seam carving for content-aware image resizing , 2007, SIGGRAPH 2007.

[30]  Hany Farid,et al.  Exposing Digital Forgeries in Complex Lighting Environments , 2007, IEEE Transactions on Information Forensics and Security.

[31]  Alexei A. Efros,et al.  Scene completion using millions of photographs , 2007, SIGGRAPH 2007.

[32]  E. Loftus,et al.  Changing history: doctored photographs affect memory for past public events , 2007 .

[33]  Hany Farid,et al.  Detecting Photographic Composites of People , 2008, IWDW.

[34]  S. Roncato Piranesi and the infinite prisons. , 2007, Spatial vision.

[35]  H. Farid A Survey of Image Forgery Detection , 2008 .

[36]  Patrick Cavanagh,et al.  Reflections in art. , 2008, Spatial vision.

[37]  Hans-Peter Seidel,et al.  Interactive reflection editing , 2009, ACM Trans. Graph..

[38]  J. Fridrich,et al.  Digital image forensics , 2009, IEEE Signal Processing Magazine.

[39]  Hans-Peter Seidel,et al.  Interactive reflection editing , 2009, SIGGRAPH 2009.

[40]  Takeo Igarashi,et al.  Generating photo manipulation tutorials by demonstration , 2009, SIGGRAPH 2009.

[41]  H. Farid,et al.  Image forgery detection , 2009, IEEE Signal Processing Magazine.

[42]  Takeo Igarashi,et al.  Generating photo manipulation tutorials by demonstration , 2009, ACM Trans. Graph..

[43]  Matthias Kirchner,et al.  On resampling detection in re-compressed images , 2009, 2009 First IEEE International Workshop on Information Forensics and Security (WIFS).

[44]  Micah K. Johnson,et al.  Multi-scale image harmonization , 2010, ACM Trans. Graph..

[45]  Matthias Kirchner Efficient estimation of CFA pattern configuration in digital camera images , 2010, Electronic Imaging.

[46]  Christian Riess,et al.  Scene Illumination as an Indicator of Image Manipulation , 2010, Information Hiding.

[47]  Mary J. Bravo,et al.  Image forensic analyses that elude the human visual system , 2010, Electronic Imaging.

[48]  Xunyu Pan,et al.  Detecting image region duplication using SIFT features , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[49]  Wojciech Matusik,et al.  Multi-scale image harmonization , 2010, SIGGRAPH 2010.

[50]  Thomas Gloe,et al.  Efficient estimation and large-scale evaluation of lateral chromatic aberration for digital image forensics , 2010, Electronic Imaging.

[51]  Hany Farid,et al.  Exposing digital forgeries from 3-D lighting environments , 2010, 2010 IEEE International Workshop on Information Forensics and Security.

[52]  J. Fridrich Digital Image Forensics Using Sensor Noise , .