Computational Aesthetics of Photos Quality Assessment and Classification Based on Artificial Neural Network with Deep Learning Methods

Photograph aesthetical evaluation has been widely investigated in these decades. The most used assessing methods are mainly classical data mining methods such as SVM, ANN(Artificial Neural Network), linear programming and so on. In this paper, we presented a method based on artificial neural network and deep learning methods which is also a hot research topic recently. We downloaded a medium and a large dataset from a well-known online photograph portal and trained on them. Results showed that the accuracy of classification was above 82.1%, which was better than all state-of-the-art methods as well as a moderate result from those methods never adopted up to now.

[1]  Kun Ho Lee,et al.  Aesthetic Score Assessment based on Generic Features in Digital Photography Sidra , 2012 .

[2]  Christian Bauckhage,et al.  The Good, the Bad, and the Ugly: Predicting Aesthetic Image Labels , 2010, 2010 20th International Conference on Pattern Recognition.

[3]  James Ze Wang,et al.  Studying Aesthetics in Photographic Images Using a Computational Approach , 2006, ECCV.

[4]  Leonidas J. Guibas,et al.  The Earth Mover's Distance as a Metric for Image Retrieval , 2000, International Journal of Computer Vision.

[5]  James Ze Wang,et al.  SIMPLIcity: Semantics-Sensitive Integrated Matching for Picture LIbraries , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  P. Machado,et al.  Computing Aesthetics , 1998 .

[7]  Yoshua Bengio,et al.  Classification using discriminative restricted Boltzmann machines , 2008, ICML '08.

[8]  Razvan Pascanu,et al.  Pylearn2: a machine learning research library , 2013, ArXiv.

[9]  M. Aizerman,et al.  Theoretical Foundations of the Potential Function Method in Pattern Recognition Learning , 1964 .

[10]  Mateu Sbert,et al.  Conceptualizing Birkhoff's Aesthetic Measure Using Shannon Entropy and Kolmogorov Complexity , 2007, CAe.

[11]  Frank Rosenblatt,et al.  PRINCIPLES OF NEURODYNAMICS. PERCEPTRONS AND THE THEORY OF BRAIN MECHANISMS , 1963 .

[12]  James Ze Wang,et al.  ACQUINE: aesthetic quality inference engine - real-time automatic rating of photo aesthetics , 2010, MIR '10.

[13]  Mateu Sbert,et al.  Informational Aesthetics Measures , 2008, IEEE Computer Graphics and Applications.

[14]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[15]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[16]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[17]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[18]  Dennis Couzin.  Depths of Field , 1982 .

[19]  Kunihiko Fukushima,et al.  Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position , 1980, Biological Cybernetics.

[20]  Rasmus Berg Palm,et al.  Prediction as a candidate for learning deep hierarchical models of data , 2012 .

[21]  Yan Ke,et al.  The Design of High-Level Features for Photo Quality Assessment , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[22]  Jürgen Schmidhuber,et al.  Multi-column deep neural networks for image classification , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Kok-Lim Low,et al.  Saliency-enhanced image aesthetics class prediction , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).