Aesthetics Assessment of Images Containing Faces

Recent research has widely explored the problem of aesthetics assessment of images with generic content. However, few approaches have been specifically designed to predict the aesthetic quality of images containing human faces, which make up a massive portion of photos in the web. This paper introduces a method for aesthetic quality assessment of images with faces. We exploit three different Convolutional Neural Networks to encode information regarding perceptual quality, global image aesthetics, and facial attributes; then, a model is trained to combine these features to explicitly predict the aesthetics of images containing faces. Experimental results show that our approach outperforms existing methods for both binary, i.e. low/high, and continuous aesthetic score prediction on four different databases in the state-of-the-art.

[1]  Tsuhan Chen,et al.  Aesthetic quality assessment of consumer photos with faces , 2010, 2010 IEEE International Conference on Image Processing.

[2]  Paolo Napoletano,et al.  On the use of deep learning for blind image quality assessment , 2016, Signal Image Video Process..

[3]  Paolo Napoletano,et al.  Predicting Image Aesthetics with Deep Learning , 2016, ACIVS.

[4]  Mubarak Shah,et al.  A framework for photo-quality assessment and enhancement based on visual aesthetics , 2010, ACM Multimedia.

[5]  Eric Gilbert,et al.  Faces engage us: photos with faces attract more likes and comments on Instagram , 2014, CHI.

[6]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[7]  Stefan Winkler,et al.  A Probabilistic Approach to People-Centric Photo Selection and Sequencing , 2017, IEEE Transactions on Multimedia.

[8]  Alice Caplier,et al.  How to predict the global instantaneous feeling induced by a facial picture? , 2015, Signal Process. Image Commun..

[9]  Sabine Süsstrunk,et al.  Image aesthetic predictors based on weighted CNNs , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[10]  Michael Freeman,et al.  The Photographer's Eye: Composition and Design for Better Digital Photos , 2007 .

[11]  Mislav Grgic,et al.  Aesthetic quality assessment of headshots , 2013, Proceedings ELMAR-2013.

[12]  Raimondo Schettini,et al.  Self-Adaptive Image Cropping for Small Displays , 2007, IEEE Transactions on Consumer Electronics.

[13]  Ran He,et al.  Deep Aesthetic Quality Assessment With Semantic Information , 2016, IEEE Transactions on Image Processing.

[14]  Simone Bianco,et al.  User Preferences Modeling and Learning for Pleasing Photo Collage Generation , 2015, TOMM.

[15]  Naila Murray,et al.  AVA: A large-scale database for aesthetic visual analysis , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Raimondo Schettini,et al.  Adaptive Color Constancy Using Faces , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Xiaogang Wang,et al.  Content-based photo quality assessment , 2011, 2011 International Conference on Computer Vision.

[18]  Tsuhan Chen,et al.  Towards aesthetics: a photo quality assessment and photo selection system , 2010, ACM Multimedia.

[19]  Alice Caplier,et al.  Photo rating of facial pictures based on image segmentation , 2014, 2014 International Conference on Computer Vision Theory and Applications (VISAPP).

[20]  Terrance E. Boult,et al.  AFFACT: Alignment-free facial attribute classification technique , 2016, 2017 IEEE International Joint Conference on Biometrics (IJCB).

[21]  John See,et al.  Aesthetic Evaluation of Facial Portraits Using Compositional Augmentation for Deep CNNs , 2016, ACCV Workshops.

[22]  Davis E. King,et al.  Dlib-ml: A Machine Learning Toolkit , 2009, J. Mach. Learn. Res..