What Makes a Photograph Memorable?

When glancing at a magazine, or browsing the Internet, we are continuously exposed to photographs. Despite this overflow of visual information, humans are extremely good at remembering thousands of pictures along with some of their visual details. But not all images are equal in memory. Some stick in our minds while others are quickly forgotten. In this paper, we focus on the problem of predicting how memorable an image will be. We show that memorability is an intrinsic and stable property of an image that is shared across different viewers, and remains stable across delays. We introduce a database for which we have measured the probability that each picture will be recognized after a single view. We analyze a collection of image features, labels, and attributes that contribute to making an image memorable, and we train a predictor based on global image descriptors. We find that predicting image memorability is a task that can be addressed with current computer vision techniques. While making memorable images is a challenging task in visualization, photography, and education, this work is a first attempt to quantify this useful property of images.

[1]  J. F. Cross,et al.  Sex, race, age, and beauty as factors in recognition of faces , 1971 .

[2]  L. Standing Learning 10,000 pictures. , 1973, The Quarterly journal of experimental psychology.

[3]  F. Craik,et al.  Levels of Processing in Human Memory , 1979 .

[4]  S. R. Schmidt Encoding and retrieval processes in the memory for conceptually distinctive events. , 1985, Journal of experimental psychology. Learning, memory, and cognition.

[5]  B. Tversky,et al.  Memory for faces: Are caricatures better than photographs? , 1985, Memory & cognition.

[6]  D. Schacter,et al.  Gist-Based False Recognition of Pictures in Older and Younger Adults , 1997 .

[7]  Erik Reinhard,et al.  Artistic Composition for Image Creation , 2001, Rendering Techniques.

[8]  N. Cowan The magical number 4 in short-term memory: A reconsideration of mental storage capacity , 2001, Behavioral and Brain Sciences.

[9]  M. Mather,et al.  Aging and emotional memory: the forgettable nature of negative images for older adults. , 2003, Journal of experimental psychology. General.

[10]  M. Van der Linden,et al.  The effects of happy and angry expressions on identity and expression memory for unfamiliar faces , 2003, Cognition & emotion.

[11]  Erik Reinhard,et al.  Human facial illustrations: Creation and psychophysical evaluation , 2004, TOGS.

[12]  Antonio Torralba,et al.  Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope , 2001, International Journal of Computer Vision.

[13]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[14]  Daniel Cohen-Or,et al.  Color harmonization , 2006, ACM Trans. Graph..

[15]  J. Worthen,et al.  Distinctiveness and memory. , 2006 .

[16]  Cordelia Schmid,et al.  Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[17]  James S. Nairne,et al.  Modeling Distinctiveness: Implications for General Memory Theory , 2006 .

[18]  Antonio Torralba,et al.  LabelMe: A Database and Web-Based Tool for Image Annotation , 2008, International Journal of Computer Vision.

[19]  Eli Shechtman,et al.  Matching Local Self-Similarities across Images and Videos , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  S. Vogt,et al.  Long-term memory for 400 pictures on a common theme. , 2007, Experimental psychology.

[21]  Dani Lischinski,et al.  Data-driven enhancement of facial attractiveness , 2008, SIGGRAPH 2008.

[22]  Pietro Perona,et al.  Some Objects Are More Equal Than Others: Measuring and Predicting Importance , 2008, ECCV.

[23]  Katherine A. Rawson,et al.  How does knowledge promote memory? The distinctiveness theory of skilled memory. , 2008 .

[24]  Xiaoou Tang,et al.  Photo and Video Quality Evaluation: Focusing on the Subject , 2008, ECCV.

[25]  Aude Oliva,et al.  Visual long-term memory has a massive storage capacity for object details , 2008, Proceedings of the National Academy of Sciences.

[26]  Dani Lischinski,et al.  Data-driven enhancement of facial attractiveness , 2008, ACM Trans. Graph..

[27]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[28]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Timothy F. Brady,et al.  Conceptual Distinctiveness Supports Detailed Visual Long-term Memory for Real-world Objects the Fidelity of Long-term Memory for Visual Information , 2022 .

[30]  Timothy F. Brady,et al.  Scene Memory Is More Detailed Than You Think : The Role of Categories in Visual Long-Term Memory , 2010 .

[31]  Antonio Torralba,et al.  Exploiting hierarchical context on a large database of object categories , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[32]  Krista A. Ehinger,et al.  SUN database: Large-scale scene recognition from abbey to zoo , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[33]  Daniel Cohen-Or,et al.  Optimizing Photo Composition , 2010, Comput. Graph. Forum.

[34]  Gabriela Csurka,et al.  Assessing the aesthetic quality of photographs using generic image descriptors , 2011, 2011 International Conference on Computer Vision.

[35]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[36]  Vicente Ordonez,et al.  High level describable attributes for predicting aesthetics and interestingness , 2011, CVPR 2011.

[37]  Jianxiong Xiao,et al.  What makes an image memorable? , 2011, CVPR 2011.

[38]  Jianxiong Xiao,et al.  Memorability of Image Regions , 2012, NIPS.

[39]  Karl Stratos,et al.  Understanding and predicting importance in images , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[40]  Naila Murray,et al.  AVA: A large-scale database for aesthetic visual analysis , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[41]  Aude Oliva,et al.  Establishing a Database for Studying Human Face Photograph Memory , 2012, CogSci.

[42]  Wilma A. Bainbridge,et al.  The intrinsic memorability of face photographs. , 2013, Journal of experimental psychology. General.

[43]  Timothy F. Brady,et al.  Real-world objects are not represented as bound units: independent forgetting of different object details from visual memory. , 2013, Journal of experimental psychology. General.

[44]  F. Craik,et al.  Depth, Elaboration, and Distinctiveness , 2014 .