Discrimination of Computer Synthesized or Recaptured Images from Real Images

An image that appears to be a photograph may not necessarily a normal photograph as we know it. For example, a photograph-like image can be rendered by computer graphics instead of being taken by a camera or it can be a photograph of an image instead of a direct photograph of a natural scene. What is really different between these photographic appearances is their underlying synthesis processes. Not being able to distinguish these images poses real social risks, as it becomes harder to refute claims of child pornography as non-photograph in the court of law and easier for attackers to mount an image or video replay attack on biometric security systems. This motivates digital image forensics research on distinguishing these photograph-like images from true photographs. In this chapter, we present the challenges, technical approaches, system design and other practical issues in tackling this multimedia forensics problem. We will also share a list of open resources and the potential future research directions in this area of research which we hope readers will find useful.

[1]  Shih-Fu Chang,et al.  Physics-motivated features for distinguishing photographic images and computer graphics , 2005, ACM Multimedia.

[2]  David J. Kriegman,et al.  Specularity Removal in Images and Videos: A PDE Approach , 2006, ECCV.

[3]  Glenn Healey,et al.  Radiometric CCD camera calibration and noise estimation , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Anderson Rocha,et al.  Is it Fake or Real , 2006 .

[5]  P. Grassberger Generalized dimensions of strange attractors , 1983 .

[6]  Tsuhan Chen,et al.  Image authentication by detecting traces of demosaicing , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[7]  Chengyun Yang,et al.  Image steganalysis based on moments of characteristic functions using wavelet decomposition, prediction-error image, and neural network , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[8]  Ann McNamara Exploring perceptual equivalence between real and simulated imagery , 2005, APGV '05.

[9]  C. Frankel,et al.  Distinguishing photographs and graphics on the World Wide Web , 1997, 1997 Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries.

[10]  Shih-Fu Chang,et al.  Lessons Learned from Online Classification of Photo-Realistic Computer Graphics and Photographs , 2007 .

[11]  Ying Wang,et al.  On Discrimination between Photorealistic and Photographic Images , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[12]  Nasir D. Memon,et al.  New Features to Identify Computer Generated Images , 2007, 2007 IEEE International Conference on Image Processing.

[13]  Ramesh Raskar,et al.  Introduction , 2006, SIGGRAPH Courses.

[14]  Edward Cutrell,et al.  Measuring the Perception of Visual Realism in Images , 2001, Rendering Techniques.

[15]  Nasir D. Memon,et al.  Benchmarking steganographic and steganalysis techniques , 2005, IS&T/SPIE Electronic Imaging.

[16]  Rainer Lienhart,et al.  Classifying images on the web automatically , 2002, J. Electronic Imaging.

[17]  Eero P. Simoncelli,et al.  On Advances in Statistical Modeling of Natural Images , 2004, Journal of Mathematical Imaging and Vision.

[18]  Tieniu Tan,et al.  Live face detection based on the analysis of Fourier spectra , 2004, SPIE Defense + Commercial Sensing.

[19]  Shree K. Nayar,et al.  Reflectance and texture of real-world surfaces , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[20]  Shih-Fu Chang,et al.  Columbia Photographic Images and Photorealistic Computer Graphics Dataset , 2005 .

[21]  Ashutosh Saxena,et al.  High speed obstacle avoidance using monocular vision and reinforcement learning , 2005, ICML.

[22]  Josef Bigün,et al.  Non-intrusive liveness detection by face images , 2009, Image Vis. Comput..

[23]  Guy Godin,et al.  Separation of diffuse and specular components of surface reflection by use of polarization and statistical analysis of images , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Tanzeem Choudhury,et al.  Multimodal person recognition using unconstrained audio and video , 1998 .

[25]  C. Sparrow The Fractal Geometry of Nature , 1984 .

[26]  Pietro Perona,et al.  Learning Generative Visual Models from Few Training Examples: An Incremental Bayesian Approach Tested on 101 Object Categories , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[27]  Derek R. Magee,et al.  Detecting lameness using 'Re-sampling Condensation' and 'multi-stream cyclic hidden Markov models' , 2002, Image Vis. Comput..

[28]  Hany Farid,et al.  Exposing digital forgeries by detecting traces of resampling , 2005 .

[29]  Fei Wang,et al.  NPIC: Hierarchical Synthetic Image Classification Using Image Search and Generic Features , 2006, CIVR.

[30]  N. G. Kingsbury,et al.  Content based image retrieval through object extraction and querying , 2000, 2000 Proceedings Workshop on Content-based Access of Image and Video Libraries.

[31]  Shih-Fu Chang,et al.  Single-view recaptured image detection based on physics-based features , 2010, 2010 IEEE International Conference on Multimedia and Expo.

[32]  Siwei Lyu,et al.  Higher-order Wavelet Statistics and their Application to Digital Forensics , 2003, 2003 Conference on Computer Vision and Pattern Recognition Workshop.

[33]  Jie Wu,et al.  Detecting Differences between Photographs and Computer Generated Images , 2006, SPPRA.

[34]  Yun Q. Shi,et al.  Identifying Computer Graphics using HSV Color Model and Statistical Moments of Characteristic Functions , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[35]  Shih-Fu Chang,et al.  Image Retrieval: Current Techniques, Promising Directions, and Open Issues , 1999, J. Vis. Commun. Image Represent..

[36]  Shih-Fu Chang,et al.  Passive-blind Image Forensics , 2006 .

[37]  Feng Pan,et al.  Discriminating between photorealistic computer graphics and natural images using fractal geometry , 2009, Science in China Series F: Information Sciences.

[38]  Nasir D. Memon,et al.  Digital Image Forensics for Identifying Computer Generated and Digital Camera Images , 2006, 2006 International Conference on Image Processing.

[39]  Yun Q. Shi,et al.  A Smart Phone Image Database for Single Image Recapture Detection , 2010, IWDW.

[40]  C. R. Hoffman,et al.  Illumination and Reflection Maps : Simulated Objects in Simulated and Real Environments Gene , 1984 .

[41]  Eero P. Simoncelli,et al.  Natural image statistics and neural representation. , 2001, Annual review of neuroscience.

[42]  James A. Ferwerda,et al.  Three varieties of realism in computer graphics , 2003, IS&T/SPIE Electronic Imaging.

[43]  Miroslav Goljan,et al.  Digital camera identification from sensor pattern noise , 2006, IEEE Transactions on Information Forensics and Security.

[44]  James T. Kajiya,et al.  The rendering equation , 1998 .

[45]  Lin Sun,et al.  Eyeblink-based Anti-Spoofing in Face Recognition from a Generic Webcamera , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[46]  Alex ChiChung Kot,et al.  Identification of recaptured photographs on LCD screens , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[47]  David G. Stork,et al.  Pattern Classification , 1973 .

[48]  Antonio Torralba,et al.  Sharing Visual Features for Multiclass and Multiview Object Detection , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[49]  Alexei A. Efros,et al.  Using Color Compatibility for Assessing Image Realism , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[50]  Yun Q. Shi,et al.  Computer graphics classification based on Markov process model and boosting feature selection technique , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[51]  Tian-Tsong Ng,et al.  Camera response function signature for digital forensics - Part I: Theory and data selection , 2009, 2009 First IEEE International Workshop on Information Forensics and Security (WIFS).

[52]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[53]  Alexander J. Smola,et al.  Online learning with kernels , 2001, IEEE Transactions on Signal Processing.

[54]  Shih-Fu Chang,et al.  Classifying Photographic and Photorealistic Computer Graphic Images using Natural Image Statistics , 2006 .

[55]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[56]  Pietro Perona,et al.  Object class recognition by unsupervised scale-invariant learning , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[57]  Shigeo Abe DrEng Pattern Classification , 2001, Springer London.

[58]  H. Farid Creating and Detecting Doctored and Virtual Images: Implications to The Child Pornography Prevention Act , 2004 .

[59]  Tian-Tsong Ng,et al.  Recaptured photo detection using specularity distribution , 2008, 2008 15th IEEE International Conference on Image Processing.

[60]  Mary J. Bravo,et al.  Perceptual discrimination of computer generated and photographic faces , 2012, Digit. Investig..

[61]  Rich Caruana,et al.  Multitask Learning , 1997, Machine-mediated learning.

[62]  Cordelia Schmid,et al.  The 2005 PASCAL Visual Object Classes Challenge , 2005, MLCW.

[63]  Norman Wang,et al.  How Real is Really? A Perceptually Motivated System for Quantifying Visual Realism in Digital Images , 2011, 2011 International Conference on Multimedia and Signal Processing.

[64]  Shih-Fu Chang,et al.  An online system for classifying computer graphics images from natural photographs , 2006, Electronic Imaging.

[65]  Shree K. Nayar,et al.  What is the space of camera response functions? , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[66]  Katsushi Ikeuchi,et al.  Separating Reflection Components of Textured Surfaces Using a Single Image , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[67]  Jan P. Allebach,et al.  Forensic techniques for classifying scanner, computer generated and digital camera images , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[68]  Arjen P. de Vries,et al.  Detecting cartoons: a case study in automatic video-genre classification , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[69]  Andrew Zisserman,et al.  Multiple View Geometry , 1999 .

[70]  Yun Q. Shi,et al.  An Enhanced Statistical Approach to Identifying Photorealistic Images , 2009, IWDW.

[71]  Wei-Ying Ma,et al.  Automatic Classification of Photographs and Graphics , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[72]  Rangding Wang,et al.  Distinguishing Photographic Images and Photorealistic Computer Graphics Using Visual Vocabulary on Local Image Edges , 2011, IWDW.

[73]  Siwei Lyu,et al.  How realistic is photorealistic , 2005 .

[74]  Yun Q. Shi,et al.  Is physics-based liveness detection truly possible with a single image? , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[75]  Andreas Pfitzmann,et al.  Attacks on Steganographic Systems , 1999, Information Hiding.

[76]  Yee-Hong Yang,et al.  Feature based classification of computer graphics and real images , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[77]  Donald P. Greenberg,et al.  An experimental evaluation of computer graphics imagery , 1986, TOGS.