Modeling the importance of faces in natural images

In this work we study the varying importance of faces in images. Face importance is found to be affected by the size and number of faces present. We collected a dataset of 152 face images with faces in different size and number of faces. We conducted a crowdsourcing experiment where we asked people to label the important regions of the images. Analyzing the results from the experiment, we propose a simple face-importance model, which is a 2D Gaussian function, to quantitatively represent the influence of the size and number of faces on the perceived importance of faces. The face-importance model is then tested for the application of salient-object detection. For this application, we create a new salient-objects dataset, consisting of both face images and non-face images, and also through crowdsourcing we collect the ground truth. We demonstrate that our face-importance model helps us to better locate the important, thus salient, objects in the images and outperforms state-of-the-art salient-object detection algorithms.

[1]  B. S. Manjunath,et al.  Learning top down scene context for visual attention modeling in natural images , 2013, 2013 IEEE International Conference on Image Processing.

[2]  Alexander Todorov,et al.  Brain systems for assessing the affective value of faces , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[3]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[4]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[5]  Huchuan Lu,et al.  Saliency Detection via Graph-Based Manifold Ranking , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  G. Dawson,et al.  Understanding the Nature of Face Processing Impairment in Autism: Insights From Behavioral and Electrophysiological Studies , 2005, Developmental neuropsychology.

[7]  Linda Jeffery,et al.  Insights into the development of face recognition mechanisms revealed by face aftereffects. , 2011, British journal of psychology.

[8]  Marat Sophie,et al.  Gaze Prediction Improvement by Adding a Face Feature to a Saliency Model , 2009 .

[9]  Zhi Liu,et al.  Segmentation Driven Low-rank Matrix Recovery for Saliency Detection , 2013, BMVC.

[10]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Christof Koch,et al.  Predicting human gaze using low-level saliency combined with face detection , 2007, NIPS.

[12]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[13]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[14]  Larry S. Davis,et al.  Submodular Salient Region Detection , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Frédo Durand,et al.  Learning to predict where humans look , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[16]  Christof Koch,et al.  Learning a saliency map using fixated locations in natural scenes. , 2011, Journal of vision.

[17]  Lihi Zelnik-Manor,et al.  Puzzle‐like Collage , 2010, Comput. Graph. Forum.

[18]  Ali Borji,et al.  Boosting bottom-up and top-down visual features for saliency estimation , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Ying Wu,et al.  A unified approach to salient object detection via low rank matrix recovery , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  S. Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, CVPR 2009.

[21]  Lihi Zelnik-Manor,et al.  Learning Video Saliency from Human Gaze Using Candidate Selection , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Deva Ramanan,et al.  Face detection, pose estimation, and landmark localization in the wild , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Lisa M. DeBruine,et al.  The many faces of research on face perception , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[24]  Yael Pritch,et al.  Saliency filters: Contrast based filtering for salient region detection , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Huchuan Lu,et al.  Saliency Detection via Absorbing Markov Chain , 2013, 2013 IEEE International Conference on Computer Vision.

[26]  T. Field,et al.  Discrimination and imitation of facial expressions by term and preterm neonates. , 1983 .

[27]  Ariel Shamir,et al.  Seam Carving for Content-Aware Image Resizing , 2007, ACM Trans. Graph..

[28]  Yao Li,et al.  Contextual Hypergraph Modelling for Salient Object Detection , 2013, ArXiv.

[29]  Jingdong Wang,et al.  Salient Object Detection: A Discriminative Regional Feature Integration Approach , 2013, International Journal of Computer Vision.

[30]  Stella X. Yu,et al.  Image Compression Based on Visual Saliency at Individual Scales , 2009, ISVC.

[31]  Shi-Min Hu,et al.  Global contrast based salient region detection , 2011, CVPR 2011.

[32]  James H. Elder,et al.  Design and perceptual validation of performance measures for salient object segmentation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[33]  Junle Wang,et al.  Quantifying the relationship between visual salience and visual importance , 2010, Electronic Imaging.

[34]  A. Little,et al.  Facial attractiveness: evolutionary based research , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.