Towards Category-Based Aesthetic Models of Photographs

We present a novel data-driven category-based approach to automatically assess the aesthetic appeal of photographs. In order to tackle this problem, a novel set of image segmentation methods based on feature contrast are introduced, such that luminance , sharpness , saliency , color chroma , and a measure of region relevance are computed to generate different image partitions. Image aesthetic features are computed on these regions (e.g. sharpness , colorfulness , and a novel set of light exposure features). In addition, color harmony , image simplicity , and a novel set of image composition features are measured on the overall image. Support Vector Regression models are generated for each of 7 popular image categories: animals , architecture , cityscape , floral , landscape , portraiture and seascapes . These models are analyzed to understand which features have greater influence in each of those categories, and how they perform with respect to a generic state of the art model.

[1]  Tsuhan Chen,et al.  Aesthetic quality assessment of consumer photos with faces , 2010, 2010 IEEE International Conference on Image Processing.

[2]  Patrick Rice Professional Techniques for Black & White Digital Photography , 2005 .

[3]  Stéphanie Benzaquen,et al.  Postcolonial aesthetic experiences: thinking aesthetics categories in the face of catastrophe at the begining of the 21st Century , 2011 .

[4]  Kok-Lim Low,et al.  Saliency-enhanced image aesthetics class prediction , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[5]  Raimondo Schettini,et al.  Color balancing of digital photos using simple image statistics , 2004, Pattern Recognit..

[6]  Sabine Süsstrunk,et al.  Measuring colorfulness in natural images , 2003, IS&T/SPIE Electronic Imaging.

[7]  E. Peli Contrast in complex images. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[8]  James Ze Wang,et al.  Studying Aesthetics in Photographic Images Using a Computational Approach , 2006, ECCV.

[9]  Peter Meer,et al.  Edge Detection with Embedded Confidence , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Mubarak Shah,et al.  A framework for photo-quality assessment and enhancement based on visual aesthetics , 2010, ACM Multimedia.

[11]  Pietro Perona,et al.  Graph-Based Visual Saliency , 2006, NIPS.

[12]  Nuria Oliver,et al.  Supporting personal photo storytelling for social albums , 2010, ACM Multimedia.

[13]  I. Kant,et al.  The Critique of Judgement , 2020 .

[14]  Pere Obrador,et al.  The role of image composition in image aesthetics , 2010, 2010 IEEE International Conference on Image Processing.

[15]  Kurt Hornik,et al.  kernlab - An S4 Package for Kernel Methods in R , 2004 .

[16]  Xiaoou Tang,et al.  Photo and Video Quality Evaluation: Focusing on the Subject , 2008, ECCV.

[17]  Nathan Moroney,et al.  Low level features for image appeal measurement , 2009, Electronic Imaging.

[18]  O. Sorkine,et al.  Color harmonization , 2006, SIGGRAPH 2006.

[19]  Nuria Oliver,et al.  Towards Computational Models of the Visual Aesthetic Appeal of Consumer Videos , 2010, ECCV.

[20]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[21]  Nuria Oliver,et al.  The role of tags and image aesthetics in social image search , 2009, WSM '09.