Aesthetic quality assessment of photographic images

Automatically assessing the quality of a photo is an important and challenging topic in visual computing. Previous methods mainly focus on image structures and image degradations caused by noise, distortion, or algorithmic operations such as digitization and compression. However, with the development and popularization of digital image capture devices, particularly mobile devices such as smart phones and pads, people pay more attention to the aesthetic quality of photographic images. In this paper, we propose an approach to assess the aesthetic quality of an image by computing scores for a set of fundamental and meaningful aesthetic attributes, namely clarity, contrast, and saturation. We firstly propose an adaptive window based clarity evaluation method, which performs more accurate evaluation for low depth of field images as well as normal images. Then, a method for contrast evaluation using histogram analysis is proposed. Furthermore, with the observation of a correlation between color intensity and saturation, we use logistic regression to estimate the optimal saturation of an image, and then a saturation rating is computed based on the difference between the optimal and real saturations. Finally, the aesthetic quality of an image is comprehensively evaluated as a weighted average between the scores of these three attributes. Experimental results show that our method performs well for evaluating the aesthetic quality of photographic images, which is consistent with the human visual aesthetic perception.

[1]  E. Peli Contrast in complex images. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[2]  Feng Liu,et al.  Image Signature Based Mean Square Error for Image Quality Assessment , 2015 .

[3]  Tsuhan Chen,et al.  Aesthetic quality assessment of consumer photos with faces , 2010, 2010 IEEE International Conference on Image Processing.

[4]  Xiaoou Tang,et al.  Photo and Video Quality Evaluation: Focusing on the Subject , 2008, ECCV.

[5]  James Zijun Wang,et al.  Rating Image Aesthetics Using Deep Learning , 2015, IEEE Transactions on Multimedia.

[6]  R. Hess,et al.  Contrast-coding in amblyopia. I. Differences in the neural basis of human amblyopia , 1983, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[7]  Zhou Wang,et al.  No-reference image sharpness assessment based on local phase coherence measurement , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[8]  Shi-Min Hu,et al.  Global contrast based salient region detection , 2011, CVPR 2011.

[9]  Muralidhara Subbarao,et al.  Selecting the Optimal Focus Measure for Autofocusing and Depth-From-Focus , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Eric Paul Krotkov,et al.  Active Computer Vision by Cooperative Focus and Stereo , 1989, Springer Series in Perception Engineering.

[11]  Xiaojun Wu,et al.  Blind Image Quality Assessment Using a General Regression Neural Network , 2011, IEEE Transactions on Neural Networks.

[12]  W. Chu Studying Aesthetics in Photographic Images Using a Computational Approach , 2013 .

[13]  Tsuhan Chen,et al.  > Replace This Line with Your Paper Identification Number (double-click Here to Edit) < , 2022 .

[14]  Aljoscha Smolic,et al.  Automated Aesthetic Analysis of Photographic Images , 2015, IEEE Transactions on Visualization and Computer Graphics.

[15]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[16]  Swapna Devi,et al.  A New Method for Color Image Quality Assessment , 2011 .

[17]  Sang Yingjun Image Contrast Assessment under Contrast Sensitivity , 2012 .

[18]  Yan Ke,et al.  The Design of High-Level Features for Photo Quality Assessment , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[19]  Jeffrey Lubin,et al.  A VISUAL DISCRIMINATION MODEL FOR IMAGING SYSTEM DESIGN AND EVALUATION , 1995 .