Artistic Photo Filtering Recognition Using CNNs

In this paper we propose an approach based on deep Convolutional Neural Networks (CNNs) to recognize artistic photo filters applied to images. A total of 22 types of Instagram-like filters is considered. Different CNN architectures taken from the image recognition literature are compared on a dataset of more than 0.46 M images from the Places-205 dataset. Experimental results show that not only it is possible to reliably determine whether or not one of these filters has been applied, but also which one. Differently from other tasks, where the fine-tuning of a CNN trained on a different problem is usually good enough, here the fine-tuned AlexNet obtains an accuracy of only 67.5%. We show, instead, that an accuracy of about 99.0% can be obtained by training a CNN from scratch for this specific problem.

[1]  Claudio Cusano,et al.  Single and Multiple Illuminant Estimation Using Convolutional Neural Networks , 2015, IEEE Transactions on Image Processing.

[2]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[3]  Paolo Napoletano,et al.  An interactive tool for manual, semi-automatic and automatic video annotation , 2015, Comput. Vis. Image Underst..

[4]  Raimondo Schettini,et al.  Computational color constancy , 2011, 3rd European Workshop on Visual Information Processing.

[5]  Bolei Zhou,et al.  Learning Deep Features for Scene Recognition using Places Database , 2014, NIPS.

[6]  Raimondo Schettini,et al.  Local detectors and compact descriptors for visual search: A quantitative comparison , 2015, Digit. Signal Process..

[7]  David W. Aha,et al.  Unsupervised and transfer learning challenge , 2011, The 2011 International Joint Conference on Neural Networks.

[8]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[9]  Wen-Chin Chen,et al.  Filter-Invariant Image Classification on Social Media Photos , 2015, ACM Multimedia.

[10]  Stefan Carlsson,et al.  CNN Features Off-the-Shelf: An Astounding Baseline for Recognition , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[11]  Simone Bianco,et al.  Reflectance spectra recovery from tristimulus values by adaptive estimation with metameric shape correction. , 2010, Journal of the Optical Society of America. A, Optics, image science, and vision.

[12]  Raimondo Schettini,et al.  Color constancy using CNNs , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[13]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Yoshua Bengio,et al.  Deep Learning of Representations for Unsupervised and Transfer Learning , 2011, ICML Unsupervised and Transfer Learning.

[15]  Raimondo Schettini,et al.  Image quality assessment by preprocessing and full reference model combination , 2009, Electronic Imaging.

[16]  Yoshua Bengio,et al.  How transferable are features in deep neural networks? , 2014, NIPS.

[17]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[18]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.