Computer generated images vs. digital photographs: A synergetic feature and classifier combination approach

The development of powerful and low-cost hardware devices allied with great advances on content editing and authoring tools have promoted the creation of computer generated images (CG) to a degree of unrivaled realism. Differentiating a photo-realistic computer generated image from a real photograph (PG) can be a difficult task to naked eyes. Digital forensics techniques can play a significant role in this task. As a matter of fact, important research has been made by the scientific community in this regard. Most of the approaches focus on single image features aiming at detecting differences between real and computer generated images. However, with the current technology advances, there is no universal image characterization technique that completely solves this problem. In our work, we (1) present a complete study of several CG versus PG approaches; (2) create a large and heterogeneous dataset to be used as a training and validation database; (3) implement representative methods of the literature; and (4) devise automatic ways for combining the best approaches. We compared the implemented methods using the same validation environment showing their pros and cons with a common benchmark protocol. We collected approximately 4850 photographs and 4850 CGs with large diversity of image content and quality. We implemented a total of 13 methods. Results show that this set of methods can achieve up to 93% of accuracy when used without any form of machine learning fusion. The same methods, when combined through the implemented fusion schemes, can achieve an accuracy rate of 97%, representing a reduction of 57% of the classification error over the best individual result.

[1]  H. Farid Creating and Detecting Doctored and Virtual Images: Implications to The Child Pornography Prevention Act , 2004 .

[2]  Shih-Fu Chang,et al.  Physics-motivated features for distinguishing photographic images and computer graphics , 2005, ACM Multimedia.

[3]  Tin Kam Ho,et al.  The Random Subspace Method for Constructing Decision Forests , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Hany Farid,et al.  Detecting Photographic Composites of People , 2008, IWDW.

[5]  Shih-Fu Chang,et al.  Image Retrieval: Current Techniques, Promising Directions, and Open Issues , 1999, J. Vis. Commun. Image Represent..

[6]  E. Candès,et al.  Curvelets: A Surprisingly Effective Nonadaptive Representation for Objects with Edges , 2000 .

[7]  Nasir D. Memon,et al.  Digital Image Forensics for Identifying Computer Generated and Digital Camera Images , 2006, 2006 International Conference on Image Processing.

[8]  Gerlind Plonka-Hoch,et al.  The Curvelet Transform , 2010, IEEE Signal Processing Magazine.

[9]  B. Mandelbrot How Long Is the Coast of Britain? Statistical Self-Similarity and Fractional Dimension , 1967, Science.

[10]  Laurent Demanet,et al.  Fast Discrete Curvelet Transforms , 2006, Multiscale Model. Simul..

[11]  Christopher M. Bishop,et al.  Pattern Recognition and Machine Learning (Information Science and Statistics) , 2006 .

[12]  Erik Reinhard,et al.  Image Statistics and their Applications in Computer Graphics , 2010, Eurographics.

[13]  Minh N. Do,et al.  The finite ridgelet transform for image representation , 2003, IEEE Trans. Image Process..

[14]  Ron Kimmel,et al.  A general framework for low level vision , 1998, IEEE Trans. Image Process..

[15]  Anderson Rocha,et al.  Robust Fusion: Extreme Value Theory for Recognition Score Normalization , 2010, ECCV.

[16]  Rafael C. González,et al.  Local Determination of a Moving Contrast Edge , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Nasir D. Memon,et al.  New Features to Identify Computer Generated Images , 2007, 2007 IEEE International Conference on Image Processing.

[18]  Xiannong Meng,et al.  A Study of Color Histogram Based Image Retrieval , 2009, 2009 Sixth International Conference on Information Technology: New Generations.

[19]  Tao Zhang,et al.  Identifying photorealistic computer graphics using second-order difference statistics , 2010, 2010 Seventh International Conference on Fuzzy Systems and Knowledge Discovery.

[20]  Siwei Lyu,et al.  How realistic is photorealistic , 2005 .

[21]  Wang-Q Lim,et al.  Compactly supported shearlets are optimally sparse , 2010, J. Approx. Theory.

[22]  Francesco G. B. De Natale,et al.  Discrimination between computer generated and natural human faces based on asymmetry information , 2012, 2012 Proceedings of the 20th European Signal Processing Conference (EUSIPCO).

[23]  Christian Eitzinger,et al.  Texture features corresponding to human touch feeling , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[24]  L. Liebovitch,et al.  A fast algorithm to determine fractal dimensions by box counting , 1989 .

[25]  Fei Peng,et al.  Identification of Natural Images and Computer Generated Graphics Based on Hybrid Features , 2012, Int. J. Digit. Crime Forensics.

[26]  S. Mallat A wavelet tour of signal processing , 1998 .

[27]  Tsuhan Chen,et al.  Image authentication by detecting traces of demosaicing , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[28]  Husrev T. Sencar,et al.  Source Camera Identification Based on Sensor Dust Characteristics , 2007 .

[29]  Ying Wang,et al.  On Discrimination between Photorealistic and Photographic Images , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[30]  João Paulo Papa,et al.  How Far do We Get Using Machine Learning Black-Boxes? , 2012, Int. J. Pattern Recognit. Artif. Intell..

[31]  Eero P. Simoncelli,et al.  Image compression via joint statistical characterization in the wavelet domain , 1999, IEEE Trans. Image Process..

[32]  Yun Q. Shi,et al.  Identifying Computer Graphics using HSV Color Model and Statistical Moments of Characteristic Functions , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[33]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[35]  Anderson Rocha,et al.  Face spoofing detection through partial least squares and low-level descriptors , 2011, 2011 International Joint Conference on Biometrics (IJCB).

[36]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[37]  Jonathan S. Herberg,et al.  Real or Fake?: human judgments about photographs and computer-generated images of faces , 2012, SIGGRAPH 2012.

[38]  Anderson Rocha,et al.  Video-Based Face Spoofing Detection through Visual Rhythm Analysis , 2012, 2012 25th SIBGRAPI Conference on Graphics, Patterns and Images.

[39]  Sven Loncaric,et al.  A survey of shape analysis techniques , 1998, Pattern Recognit..

[40]  Minh N. Do,et al.  Contourlets: a directional multiresolution image representation , 2002, Proceedings. International Conference on Image Processing.

[41]  Hany Farid A 3-D Photo Forensic Analysis of the Lee Harvey Oswald Backyard Photo , 2010 .

[42]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[43]  Alin C. Popescu,et al.  Exposing digital forgeries in color filter array interpolated images , 2005, IEEE Transactions on Signal Processing.

[44]  David A Clausi An analysis of co-occurrence texture statistics as a function of grey level quantization , 2002 .

[45]  Tobias Isenberg Evaluating and Validating Non-photorealistic and Illustrative Rendering , 2013, Image and Video-Based Artistic Stylisation.

[46]  Kiyoharu Aizawa,et al.  Sketch-Based Spatial Queries for Retrieving Human Locomotion Patterns From Continuously Archived GPS Data , 2009, IEEE Transactions on Multimedia.

[47]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[48]  Anderson Rocha,et al.  Progressive randomization: Seeing the unseen , 2010, Comput. Vis. Image Underst..

[49]  Matti Pietikäinen,et al.  Multi-scale Binary Patterns for Texture Analysis , 2003, SCIA.

[50]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[51]  Mary J. Bravo,et al.  Image forensic analyses that elude the human visual system , 2010, Electronic Imaging.

[52]  Urbano Nunes,et al.  Trainable classifier-fusion schemes: An application to pedestrian detection , 2009, 2009 12th International IEEE Conference on Intelligent Transportation Systems.

[53]  Miroslav Goljan,et al.  Digital camera identification from sensor pattern noise , 2006, IEEE Transactions on Information Forensics and Security.

[54]  Matti Pietikäinen,et al.  A Generalized Local Binary Pattern Operator for Multiresolution Gray Scale and Rotation Invariant Texture Classification , 2001, ICAPR.

[55]  R. Larsen An introduction to mathematical statistics and its applications / Richard J. Larsen, Morris L. Marx , 1986 .

[56]  Kim Steenstrup Pedersen,et al.  The Nonlinear Statistics of High-Contrast Patches in Natural Images , 2003, International Journal of Computer Vision.

[57]  P. P. Vaidyanathan,et al.  A new class of two-channel biorthogonal filter banks and wavelet bases , 1995, IEEE Trans. Signal Process..

[58]  Rainer Böhme,et al.  Can we trust digital image forensics? , 2007, ACM Multimedia.

[59]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[60]  Anderson Rocha,et al.  Vision of the unseen: Current trends and challenges in digital image and video forensics , 2011, CSUR.

[61]  Shih-Fu Chang,et al.  Identifying and prefiltering images , 2009, IEEE Signal Process. Mag..

[62]  P. Vaidyanathan Quadrature mirror filter banks, M-band extensions and perfect-reconstruction techniques , 1987, IEEE ASSP Magazine.

[63]  Larry S. Davis,et al.  A novel feature descriptor based on the shearlet transform , 2011, 2011 18th IEEE International Conference on Image Processing.