Aesthetic Preferences of Neural Style Transfer-Generated Portrait Images: An Exploratory Study with the Two-Alternative-Forced-Choice Task

Neural style transfer is a popular deep learning algorithm to generate images to mimic human artistry. This work applies the psychological method of the two-alternative forced choice (2afc) task to measure aesthetic preferences for neural style generated images. Portrait photos of three popular celebrities were generated by varying three parameters of neural style transfer in five configuration levels. Participants had to choose the image they preferred aesthetically from all pairwise combinations of configurations per style. The rate of being chosen was calculated for each neural style transfer configuration level. The findings show a differentiated picture of aesthetic preferences. On the one side, they indicate that people prefer images rendered with 500 iterations and a learning rate of 2e1, i.e. configurations that allow them to recognize the structure of the portrait image despite the stylization. On the other side, aesthetic preferences peak for two distinctly different content-tostyle weight ratios. Whereas the medium-high configuration (100:100) may be favored by people who like abstract arts, the high configuration (300:100) may be chosen by people who prefer realistic art. These results indicate that aesthetic preferences for neural style transfer-generated images can be characterized by unique patterns, and their optimal configuration levels can be captured by the 2afc task.

[1]  Leon A. Gatys,et al.  A Neural Algorithm of Artistic Style , 2015, ArXiv.

[2]  Sebastian Ruder,et al.  An overview of gradient descent optimization algorithms , 2016, Vestnik komp'iuternykh i informatsionnykh tekhnologii.

[3]  Yun Fu,et al.  Fashion Style Generator , 2017, IJCAI.

[4]  Suk Kyoung Choi,et al.  Guess, check and fix: a phenomenology of improvisation in ‘neural’ painting , 2018, Digit. Creativity.

[5]  Sarah Linsen,et al.  Aesthetic preference for spatial composition in multiobject pictures , 2012, i-Perception.

[6]  Li Fei-Fei,et al.  Perceptual Losses for Real-Time Style Transfer and Super-Resolution , 2016, ECCV.

[7]  H. Leder,et al.  How Stable Are Human Aesthetic Preferences Across the Lifespan? , 2017, Front. Hum. Neurosci..

[8]  Neil A. Macmillan,et al.  Detection Theory: A User's Guide , 1991 .

[9]  Leon A. Gatys,et al.  Image Style Transfer Using Convolutional Neural Networks , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  H. Leder,et al.  But Is It really Art? The Classification of Images as “Art”/“Not Art” and Correlation with Appraisal and Viewer Interpersonal Differences , 2017, Front. Psychol..

[11]  Karen B. Schloss,et al.  Visual aesthetics and human preference. , 2013, Annual review of psychology.

[12]  Hao Wang,et al.  Real-Time Neural Style Transfer for Videos , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Sanja Fidler,et al.  Be Your Own Prada: Fashion Synthesis with Structural Coherence , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[14]  Monica Martinussen,et al.  Likert-based vs. semantic differential-based scorings of positive psychological constructs: A psychometric comparison of two versions of a scale measuring resilience. , 2006 .

[15]  Mark W. Schmidt,et al.  Fast Patch-based Style Transfer of Arbitrary Style , 2016, ArXiv.

[16]  Qian Yang,et al.  Paired Comparison/Directional Difference Test/2-Alternative Forced Choice (2-AFC) Test, Simple Difference Test/Same-Different Test , 2017 .

[17]  Sarah Linsen,et al.  Aesthetic preferences in the size of images of real-world objects. , 2010, Perception.

[18]  Alex J. Champandard,et al.  Semantic Style Transfer and Turning Two-Bit Doodles into Fine Artworks , 2016, ArXiv.