Modifying the Memorability of Face Photographs

Contemporary life bombards us with many new images of faces every day, which poses non-trivial constraints on human memory. The vast majority of face photographs are intended to be remembered, either because of personal relevance, commercial interests or because the pictures were deliberately designed to be memorable. Can we make a portrait more memorable or more forgettable automatically? Here, we provide a method to modify the memorability of individual face photographs, while keeping the identity and other facial traits (e.g. age, attractiveness, and emotional magnitude) of the individual fixed. We show that face photographs manipulated to be more memorable (or more forgettable) are indeed more often remembered (or forgotten) in a crowd-sourcing experiment with an accuracy of 74%. Quantifying and modifying the 'memorability' of a face lends itself to many useful applications in computer vision and graphics, such as mnemonic aids for learning, photo editing applications for social networks and tools for designing memorable advertisements.

[1]  M. Potter.  Meaning in visual search. , 1975, Science.

[2]  D. Perrett,et al.  Perception and recognition of photographic quality facial caricatures: Implications for the recognition of natural images , 1991 .

[3]  T. Valentine.  The Quarterly Journal of Experimental Psychology Section A: Human Experimental Psychology a Unified Account of the Effects of Distinctiveness, Inversion, and Race in Face Recognition , 2022 .

[4]  J. R. Vokey,et al.  Familiarity, memorability, and the effect of typicality on the recognition of faces , 1992, Memory & cognition.

[5]  Alexander J. Smola,et al.  Support Vector Regression Machines , 1996, NIPS.

[6]  A. O'Toole,et al.  Three-Dimensional Caricatures of Human Heads: Distinctiveness and the Perception of Facial Age , 1997, Perception.

[7]  Timothy F. Cootes,et al.  Active Appearance Models , 1998, ECCV.

[8]  T. Busey.  Formal models of familiarity and memorability in face recognition , 1999 .

[9]  Erik Hjelmås,et al.  Face Detection: A Survey , 2001, Comput. Vis. Image Underst..

[10]  Timothy F. Cootes,et al.  Toward Automatic Simulation of Aging Effects on Face Images , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  H. Bülthoff,et al.  The use of facial motion and facial form during the processing of identity , 2003, Vision Research.

[13]  Erik Reinhard,et al.  Human facial illustrations: Creation and psychophysical evaluation , 2004, TOGS.

[14]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[15]  J. Townsend,et al.  Computational, Geometric, and Process Perspectives on Facial Cognition : Contexts and Challenges , 2005 .

[16]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[17]  Cordelia Schmid,et al.  Learning Color Names from Real-World Images , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Chih-Jen Lin,et al.  LIBLINEAR: A Library for Large Linear Classification , 2008, J. Mach. Learn. Res..

[19]  Dani Lischinski,et al.  Data-driven enhancement of facial attractiveness , 2008, ACM Trans. Graph..

[20]  Thomas Vetter,et al.  Weight, Sex, and Facial Expressions: On the Manipulation of Attributes in Generative 3D Face Models , 2009, ISVC.

[21]  Shree K. Nayar,et al.  Attribute and simile classifiers for face verification , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[22]  Yihong Gong,et al.  Locality-constrained Linear Coding for image classification , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[23]  Shiguang Shan,et al.  A Compositional and Dynamic Model for Face Aging , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Antonio Torralba,et al.  Understanding the Intrinsic Memorability of Images , 2011, NIPS.

[25]  Brian Curless,et al.  Candid portrait selection from video , 2011, ACM Trans. Graph..

[26]  Jianxiong Xiao,et al.  What makes an image memorable? , 2011, CVPR 2011.

[27]  Jianxiong Xiao,et al.  Memorability of Image Regions , 2012, NIPS.

[28]  Jianxiong Xiao,et al.  Image memorability and visual inception , 2012, SIGGRAPH Asia Technical Briefs.

[29]  Deva Ramanan,et al.  Face detection, pose estimation, and landmark localization in the wild , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[30]  Wilma A. Bainbridge,et al.  The intrinsic memorability of face photographs. , 2013, Journal of experimental psychology. General.