What characterizes personalities of graphic designs?

Graphic designers often manipulate the overall look and feel of their designs to convey certain personalities (e.g., cute, mysterious and romantic) to impress potential audiences and achieve business goals. However, understanding the factors that determine the personality of a design is challenging, as a graphic design is often a result of thousands of decisions on numerous factors, such as font, color, image, and layout. In this paper, we aim to answer the question of what characterizes the personality of a graphic design. To this end, we propose a deep learning framework for exploring the effects of various design factors on the perceived personalities of graphic designs. Our framework learns a convolutional neural network (called personality scoring network) to estimate the personality scores of graphic designs by ranking the crawled web data. Our personality scoring network automatically learns a visual representation that captures the semantics necessary to predict graphic design personality. With our personality scoring network, we systematically and quantitatively investigate how various design factors (e.g., color, font, and layout) affect design personality across different scales (from pixels, regions to elements). We also demonstrate a number of practical application scenarios of our network, including element-level design suggestion and example-based personality transfer.

[1]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[2]  Matthew Q. Hill,et al.  Body talk , 2016, ACM Trans. Graph..

[3]  Yang Song,et al.  Learning Fine-Grained Image Similarity with Deep Ranking , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Rynson W. H. Lau,et al.  Automatic stylistic manga layout , 2012, ACM Trans. Graph..

[5]  Jan P. Allebach,et al.  Colors -- Messengers of Concepts: Visual Design Mining for Learning Color Semantics , 2015, ArXiv.

[6]  Barbara S. Chaparro,et al.  Visual Appeal vs. Usability: Which One Influences User Perceptions of a Website More? , 2009 .

[7]  W. K. Hastings,et al.  Monte Carlo Sampling Methods Using Markov Chains and Their Applications , 1970 .

[8]  Manfred Lau,et al.  Learning a human-perceived softness measure of virtual 3D objects , 2016, SAP.

[9]  Trevor Darrell,et al.  Recognizing Image Style , 2013, BMVC.

[10]  Aaron Hertzmann,et al.  Exploratory font selection using crowdsourced attributes , 2014, ACM Trans. Graph..

[11]  Kristen Grauman,et al.  Relative attributes , 2011, 2011 International Conference on Computer Vision.

[12]  Xiaofeng Tao,et al.  Transient attributes for high-level understanding and editing of outdoor scenes , 2014, ACM Trans. Graph..

[13]  Siddhartha Chaudhuri,et al.  Attribit: content creation with semantic attributes , 2013, UIST.

[14]  Ali Farhadi,et al.  Deep Classifiers from Image Tags in the Wild , 2015, MMCommons '15.

[15]  Miriam Redi,et al.  Bridging the Aesthetic Gap: The Wild Beauty of Web Imagery , 2017, ICMR.

[16]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[17]  Tieniu Tan,et al.  Deep semantic ranking based hashing for multi-label image retrieval , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Pat Hanrahan,et al.  Probabilistic color-by-numbers , 2013, ACM Trans. Graph..

[19]  Alexei A. Efros,et al.  What makes Paris look like Paris? , 2015, Commun. ACM.

[20]  Diego Gutierrez,et al.  A similarity measure for illustration style , 2014, ACM Trans. Graph..

[21]  Manfred Lau,et al.  Tactile mesh saliency , 2016, ACM Trans. Graph..

[22]  Hans-Peter Seidel,et al.  An intuitive control space for material appearance , 2016, ACM Trans. Graph..

[23]  Aaron Hertzmann,et al.  Color compatibility from large datasets , 2011, ACM Trans. Graph..

[24]  Levent Burak Kara,et al.  Semantic shape editing using deformation handles , 2015, ACM Trans. Graph..

[25]  N. C. Silver,et al.  Averaging Correlation Coefficients: Should Fishers z Transformation Be Used? , 1987 .

[26]  Rynson W. H. Lau,et al.  Directing user attention via visual flow on web designs , 2016, ACM Trans. Graph..

[27]  N. Metropolis,et al.  Equation of State Calculations by Fast Computing Machines , 1953, Resonance.

[28]  W H LauRynson,et al.  What characterizes personalities of graphic designs , 2018 .

[29]  Diego Gutierrez,et al.  Style-based exploration of illustration datasets , 2017, Multimedia Tools and Applications.

[30]  Frédo Durand,et al.  Learning Visual Importance for Graphic Designs and Data Visualizations , 2017, UIST.

[31]  Aaron Hertzmann,et al.  Learning Layouts for Single-PageGraphic Designs , 2014, IEEE Transactions on Visualization and Computer Graphics.

[32]  Yangqing Jia,et al.  Deep Convolutional Ranking for Multilabel Image Annotation , 2013, ICLR.

[33]  Rynson W. H. Lau,et al.  Look over here , 2014, ACM Trans. Graph..

[34]  Nathan Shedroff,et al.  Make it so: learning from sci-fi interfaces , 2012, AVI.

[35]  Yale Song,et al.  Video2GIF: Automatic Generation of Animated GIFs from Video , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[37]  Alla Sheffer,et al.  Elements of style , 2015, ACM Trans. Graph..

[38]  Aaron Hertzmann,et al.  Color compatibility from large datasets , 2011, SIGGRAPH 2011.

[39]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[40]  Adam Finkelstein,et al.  Automatic triage for a photo series , 2016, ACM Trans. Graph..

[41]  Matthew D. Zeiler ADADELTA: An Adaptive Learning Rate Method , 2012, ArXiv.

[42]  Scott R. Klemmer,et al.  d.tour: style-based exploration of design example galleries , 2011, UIST.

[43]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[44]  Maneesh Agrawala,et al.  Interactive furniture layout using interior design guidelines , 2011, SIGGRAPH 2011.

[45]  Stefanie Seiler,et al.  Elements Of Style , 2016 .

[46]  Babak Saleh,et al.  Learning style similarity for searching infographics , 2015, Graphics Interface.

[47]  Katharina Reinecke,et al.  Predicting users' first impressions of website aesthetics with a quantification of perceived visual complexity and colorfulness , 2013, CHI.