Aesthetic quality classification via subject region extraction

Aesthetic quality classification of photos gains growing interest in recent years. In this paper, we propose an aesthetic quality classification method via subject region extraction. We extract the subject region by a combination of clear region detection and saliency detection. Once the subject regions are extracted, we extract regional features to measure contrast between the subject and background regions since people usually emphasize objects by focusing them. Global features are used to describe comprehensive properties of the image. Experimental results show that our classification performance outperforms the state-of-the-art aesthetic quality classification methods even if we do not use prior knowledge of a visual content.

[1]  Vicente Ordonez,et al.  High level describable attributes for predicting aesthetics and interestingness , 2011, CVPR 2011.

[2]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[3]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[4]  Mubarak Shah,et al.  A framework for photo-quality assessment and enhancement based on visual aesthetics , 2010, ACM Multimedia.

[5]  Yan Ke,et al.  The Design of High-Level Features for Photo Quality Assessment , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[6]  Kok-Lim Low,et al.  Saliency-enhanced image aesthetics class prediction , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[7]  Wonjun Kim,et al.  Saliency detection: A self-ordinal resemblance approach , 2010, 2010 IEEE International Conference on Multimedia and Expo.

[8]  W. Chu Studying Aesthetics in Photographic Images Using a Computational Approach , 2013 .

[9]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[10]  James M. Rehg,et al.  CENTRIST: A Visual Descriptor for Scene Categorization , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Xiaoou Tang,et al.  Photo and Video Quality Evaluation: Focusing on the Subject , 2008, ECCV.

[12]  Gabriela Csurka,et al.  Assessing the aesthetic quality of photographs using generic image descriptors , 2011, 2011 International Conference on Computer Vision.

[13]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[14]  Wei Luo,et al.  Content-Based Photo Quality Assessment , 2013, IEEE Trans. Multim..

[15]  Leonidas J. Guibas,et al.  The Earth Mover's Distance as a Metric for Image Retrieval , 2000, International Journal of Computer Vision.

[16]  Anat Levin,et al.  Blind Motion Deblurring Using Image Statistics , 2006, NIPS.