Scattering transform and sparse linear classifiers for art authentication

Abstract Recently, a novel signal-processing tool was proposed, the scattering transform, which uses a cascade of wavelet filters and nonlinear (modulus) operations to build translation-invariant and deformation-stable representations. Despite being aimed at providing a theoretical understanding of deep neural networks, it also shows state-of-the-art performance in image classification. In this paper, we explore its performance for art authentication purposes. We analyze two databases of art objects (postimpressionist paintings and Renaissance drawings) with the goal of determining those authored by van Gogh and Raphael, respectively. To that end, we combine scattering coefficients with several linear classifiers, in particular sparse l1-regularized classifiers. Results show that these tools provide excellent performance, superior to state-of-the-art results. Further, they suggest the benefits of using sparse classifiers in combination with deep networks.

[1]  H. Zou,et al.  Regularization and variable selection via the elastic net , 2005 .

[2]  Daniel N. Rockmore,et al.  Empirical Mode Decomposition Analysis for Visual Stylometry , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Kazuhiro Seki,et al.  Block coordinate descent algorithms for large-scale sparse multiclass classification , 2013, Machine Learning.

[4]  Richard P. Taylor,et al.  Fractal analysis of Pollock's drip paintings , 1999, Nature.

[5]  Patrice Abry,et al.  When Van Gogh meets Mandelbrot: Multifractal classification of painting's texture , 2013, Signal Process..

[6]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[7]  Eric O. Postma,et al.  Computer analysis of Van Gogh's complementary colours , 2007, Pattern Recognit. Lett..

[8]  N. Senthilkumaran,et al.  Image Segmentation - A Survey of Soft Computing Approaches , 2009, 2009 International Conference on Advances in Recent Technologies in Communication and Computing.

[9]  Joakim Andén,et al.  Deep Scattering Spectrum , 2013, IEEE Transactions on Signal Processing.

[10]  Stéphane Mallat,et al.  Understanding deep convolutional networks , 2016, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[11]  Robert Tibshirani,et al.  1-norm Support Vector Machines , 2003, NIPS.

[12]  R. Tibshirani,et al.  �-norm Support Vector Machines , 2003 .

[13]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[14]  S. Mallat A wavelet tour of signal processing , 1998 .

[15]  S. Mallat,et al.  Invariant Scattering Convolution Networks , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Michael I. Jordan,et al.  On Discriminative vs. Generative Classifiers: A comparison of logistic regression and naive Bayes , 2001, NIPS.

[17]  Siwei Lyu,et al.  A digital technique for art authentication , 2004, Proc. Natl. Acad. Sci. USA.

[18]  Raymond H. Chan,et al.  Geometric Tight Frame based Stylometry for Art Authentication of van Gogh paintings , 2014, ArXiv.

[19]  Patrice Abry,et al.  Sparse Support Vector Machine for Intrapartum Fetal Heart Rate Classification , 2017, IEEE Journal of Biomedical and Health Informatics.

[20]  Jia Li,et al.  Image processing for artist identification , 2008, IEEE Signal Processing Magazine.

[21]  Stéphane Mallat,et al.  Group Invariant Scattering , 2011, ArXiv.

[22]  Josiane Mothe,et al.  Nonconvex Regularizations for Feature Selection in Ranking With Sparse SVM , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[23]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[24]  Armeen Taeb,et al.  Visual stylometry using background selection and wavelet-HMT-based Fisher information distances for attribution and dating of impressionist paintings , 2013, Signal Processing.

[25]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[26]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[27]  Patrice Abry,et al.  Scattering Transform of Heart Rate Variability for the Prediction of Ischemic Stroke in Patients with Atrial Fibrillation , 2018, Methods of Information in Medicine.

[28]  Eric O. Postma,et al.  Automatic extraction of brushstroke orientation from paintings , 2008, Machine Vision and Applications.

[29]  Rasmus Larsen,et al.  SpaSM: A MATLAB Toolbox for Sparse Statistical Modeling , 2018 .

[30]  Thomas Wiatowski,et al.  A Mathematical Theory of Deep Convolutional Neural Networks for Feature Extraction , 2015, IEEE Transactions on Information Theory.

[31]  Trevor J. Hastie,et al.  Sparse Discriminant Analysis , 2011, Technometrics.