AestheticNet: deep convolutional neural network for person identification from visual aesthetic

A person’s visual aesthetics is an emerging behavioral biometric. Visual aesthetics can be defined as a person’s principles pertaining to their sense of beauty or fondness. Utilizing a person’s preference to certain images as discriminatory features forms the basis of person identification from visual aesthetics. This paper proposes a novel three-stage framework based on the convolutional neural network, AestheticNet, for the extraction of high-level features and identification of individuals from visual aesthetics. The rank-1 accuracy of 97.73% and rank-5 accuracy of 99.85% are achieved on the publicly available benchmark dataset, which outperforms all state-of-the-art methods.

[1]  Roman V. Yampolskiy,et al.  Behavioral Biometrics: Categorization and Review , 2014, Int. J. Nat. Comput. Res..

[2]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[4]  Kenneth O. Stanley,et al.  Automatic Content Generation in the Galactic Arms Race Video Game , 2009, IEEE Transactions on Computational Intelligence and AI in Games.

[5]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[6]  Morten Moshagen,et al.  Facets of visual aesthetics , 2010, Int. J. Hum. Comput. Stud..

[7]  Nicu Sebe,et al.  Tell Me What You Like and I'll Tell You What You Are: Discriminating Visual Preferences on Flickr Data , 2012, ACCV.

[8]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[9]  Ying Liu,et al.  Eye-tracking based adaptive user interface: implicit human-computer interaction for preference indication , 2011, Journal on Multimodal User Interfaces.

[10]  Yingxu Wang,et al.  Kinect Sensor Gesture and Activity Recognition: New Applications for Consumer Cognitive Systems , 2018, IEEE Consumer Electronics Magazine.

[11]  Changjun Hu,et al.  Learning aesthetic judgements in evolutionary art systems , 2013, Genetic Programming and Evolvable Machines.

[12]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[13]  Jean Ponce,et al.  A Theoretical Analysis of Feature Pooling in Visual Recognition , 2010, ICML.

[14]  Alessandro Perina,et al.  Biometrics on visual preferences: A “pump and distill” regression approach , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[15]  Marina L. Gavrilova,et al.  Emotion Recognition From Body Movement , 2020, IEEE Access.

[16]  Ben Stephenson,et al.  User-preference-based automated level generation for platform games , 2011, 2011 IEEE Conference on Computational Intelligence and Games (CIG'11).

[17]  Yichen Wei,et al.  Learning best views of 3D shapes from sketch contour , 2015, The Visual Computer.

[18]  Klaus-Robert Müller,et al.  Efficient BackProp , 2012, Neural Networks: Tricks of the Trade.

[19]  Myeongsuk Pak,et al.  A review of deep learning in image recognition , 2017, 2017 4th International Conference on Computer Applications and Information Processing Technology (CAIPT).

[20]  Marina L. Gavrilova,et al.  Facial Metamorphosis Using Geometrical Methods for Biometric Applications , 2008, Int. J. Pattern Recognit. Artif. Intell..

[21]  Marina L. Gavrilova,et al.  Artificial Neural Network Based Gait Recognition Using Kinect Sensor , 2019, IEEE Access.

[22]  Marina L. Gavrilova,et al.  Person Identification Using Discriminative Visual Aesthetic , 2017, Canadian Conference on AI.

[23]  Anikó Ekárt,et al.  Modelling Human Preference in Evolutionary Art , 2011, EvoApplications.

[24]  Alexei A. Efros,et al.  The Unreasonable Effectiveness of Deep Features as a Perceptual Metric , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[25]  Daniel Thalmann,et al.  Virtual humans: thirty years of research, what next? , 2005, The Visual Computer.

[26]  Nadia Magnenat-Thalmann,et al.  Customization and fabrication of the appearance for humanoid robot , 2016, The Visual Computer.

[27]  Alessandro Perina,et al.  Personal Aesthetics for Soft Biometrics: A Generative Multi-resolution Approach , 2014, ICMI.

[28]  Gabriela Csurka,et al.  Building look & feel concept models from color combinations , 2011, The Visual Computer.

[29]  Marina Gavrilova,et al.  Person Identification from Visual Aesthetics Using Gene Expression Programming , 2019, 2019 International Conference on Cyberworlds (CW).

[30]  Marina L. Gavrilova,et al.  Social Behavioral Biometrics: An Emerging Trend , 2015, Int. J. Pattern Recognit. Artif. Intell..