A Comprehensive Survey on Image Aesthetic Quality Assessment

Image aesthetic quality assessment has demonstrated tremendous success in variety of application domains in recent years. This field has been growing so rapidly that various approaches have been proposed trying to solve this challenging problem. This report presents a comprehensive survey on image aesthetic quality assessment, mainly focus on the contributions and novelties of the existing approaches recently. In this work, we firstly illustrate datasets related to image aesthetics and investigate feature extractions. Then five different aesthetic tasks are reviewed, including aesthetic classification, aesthetic regression, aesthetic distribution, aesthetic factors and aesthetic description. In addition, we reviewed recent applications concerning image aesthetics. Finally, different evaluation criterions in different literatures are summarized. We hope the survey could serve as a comprehensive reference and be useful for those who are interested in exploiting image aesthetic for their research.

[1]  Masashi Nishiyama,et al.  Aesthetic quality classification of photographs based on color harmony , 2011, CVPR 2011.

[2]  Zhou Wang,et al.  A database for perceptual evaluation of image aesthetics , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[3]  Hendrik P. A. Lensch,et al.  Will People Like Your Image? Learning the Aesthetic Space , 2016, 2018 IEEE Winter Conference on Applications of Computer Vision (WACV).

[4]  Ran He,et al.  Automatic image cropping with aesthetic map and gradient energy map , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[5]  Kaiqi Huang,et al.  Hierarchical aesthetic quality assessment using deep convolutional neural networks , 2016, Signal Process. Image Commun..

[6]  Gabriela Csurka,et al.  Assessing the aesthetic quality of photographs using generic image descriptors , 2011, 2011 International Conference on Computer Vision.

[7]  Kok-Lim Low,et al.  Saliency-enhanced image aesthetics class prediction , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[8]  Dimitris Samaras,et al.  Squared Earth Mover's Distance-based Loss for Training Deep Neural Networks , 2016, ArXiv.

[9]  James Ze Wang,et al.  ACQUINE: aesthetic quality inference engine - real-time automatic rating of photo aesthetics , 2010, MIR '10.

[10]  Peyman Milanfar,et al.  NIMA: Neural Image Assessment , 2017, IEEE Transactions on Image Processing.

[11]  Wei Luo,et al.  Content-Based Photo Quality Assessment , 2013, IEEE Trans. Multim..

[12]  James Zijun Wang,et al.  RAPID: Rating Pictorial Aesthetics using Deep Learning , 2014, ACM Multimedia.

[13]  Radomír Mech,et al.  Photo Aesthetics Ranking Network with Attributes and Content Adaptation , 2016, ECCV.

[14]  Yan Ke,et al.  The Design of High-Level Features for Photo Quality Assessment , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[15]  Jun Gao,et al.  Learning to predict the perceived visual quality of photos , 2011, 2011 International Conference on Computer Vision.

[16]  James Zijun Wang,et al.  Rating Image Aesthetics Using Deep Learning , 2015, IEEE Transactions on Multimedia.

[17]  Alice Caplier,et al.  Low Level Features for Quality Assessment of Facial Images , 2015, VISAPP.

[18]  Jiebo Luo,et al.  Aesthetics and Emotions in Images , 2011, IEEE Signal Processing Magazine.

[19]  Sabine Süsstrunk,et al.  Image aesthetic predictors based on weighted CNNs , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[20]  Bipin Indurkhya,et al.  Learning Photography Aesthetics with Deep CNNs , 2017, MAICS.

[21]  Zhengqin Li,et al.  Automatic Image Cropping: A Computational Complexity Study , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Peyman Milanfar,et al.  Learned perceptual image enhancement , 2017, 2018 IEEE International Conference on Computational Photography (ICCP).

[23]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[24]  Mei-Chen Yeh,et al.  Relative features for photo quality assessment , 2012, 2012 19th IEEE International Conference on Image Processing.

[25]  Xuelong Li,et al.  Fusion of Multichannel Local and Global Structural Cues for Photo Aesthetics Evaluation , 2014, IEEE Transactions on Image Processing.

[26]  Hailin Jin,et al.  Sketching with Style: Visual Search with Sketches and Aesthetic Context , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[27]  Le Wu,et al.  Predicting Aesthetic Score Distribution through Cumulative Jensen-Shannon Divergence , 2017, AAAI.

[28]  Aljoscha Smolic,et al.  Automated Aesthetic Analysis of Photographic Images , 2015, IEEE Transactions on Visualization and Computer Graphics.

[29]  Hailin Jin,et al.  Composition-Preserving Deep Photo Aesthetics Assessment , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Thomas S. Huang,et al.  Brain-Inspired Deep Networks for Image Aesthetics Assessment , 2016, ArXiv.

[31]  Shuang Ma,et al.  A-Lamp: Adaptive Layout-Aware Multi-patch Deep Convolutional Neural Network for Photo Aesthetic Assessment , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  Chu-Song Chen,et al.  Aesthetic Critiques Generation for Photos , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[33]  Naila Murray,et al.  AVA: A large-scale database for aesthetic visual analysis , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[34]  Ju-Chin Chen,et al.  A statistic approach for photo quality assessment , 2012, 2012 International Conference on Information Security and Intelligent Control.

[35]  Xiaoou Tang,et al.  Image Aesthetic Assessment: An experimental survey , 2016, IEEE Signal Processing Magazine.

[36]  Naila Murray,et al.  A deep architecture for unified aesthetic prediction , 2017, ArXiv.

[37]  Weishan Zhang,et al.  Neural Aesthetic Image Reviewer , 2018, IET Comput. Vis..

[38]  Vicente Ordonez,et al.  High level describable attributes for predicting aesthetics and interestingness , 2011, CVPR 2011.

[39]  Kaiqi Huang,et al.  A2-RL: Aesthetics Aware Reinforcement Learning for Image Cropping , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[40]  Chen Huang,et al.  Learning Deep Representation for Imbalanced Classification , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[41]  Jianguo Xiao,et al.  Aesthetic Visual Quality Evaluation of Chinese Handwritings , 2015, IJCAI.

[42]  James Ze Wang,et al.  Algorithmic inferencing of aesthetics and emotion in natural images: An exposition , 2008, 2008 15th IEEE International Conference on Image Processing.

[43]  Le Wu,et al.  ILGNet: inception modules with connected local and global features for efficient image aesthetic quality classification using domain adaptation , 2016, IET Comput. Vis..

[44]  Radomír Mech,et al.  Deep Multi-patch Aggregation Network for Image Style, Aesthetics, and Quality Estimation , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[45]  Thomas S. Huang,et al.  Image aesthetics assessment using Deep Chatterjee's machine , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).