A Century of Portraits: A Visual Historical Record of American High School Yearbooks

Many details about our world are not captured in written records because they are too mundane or too abstract to describe in words. Fortunately, since the invention of the camera, an ever-increasing number of photographs capture much of this otherwise lost information. This plethora of artifacts documenting our "visual culture" is a treasure trove of knowledge as yet untapped by historians. We present a dataset of 37,921 frontal-facing American high school yearbook photos that allow us to use computation to glimpse into the historical visual record too voluminous to be evaluated manually. The collected portraits provide a constant visual frame of reference with varying content. We can therefore use them to consider issues such as a decade's defining style elements, or trends in fashion and social norms over time. We demonstrate that our historical image dataset may be used together with weakly-supervised data-driven techniques to perform scalable historical analysis of large image corpora with minimal human effort, much in the same way that large text corpora together with natural language processing revolutionized historians' workflow. Furthermore, we demonstrate the use of our dataset in dating grayscale portraits using deep learning methods.

[1]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[2]  J. M. Ragan Gender displays in portrait photographs , 1982 .

[3]  C. Goldin America's Graduation from High School: The Evolution and Spread of Secondary Schooling in the Twentieth Century , 1998, The Journal of Economic History.

[4]  E. Paluck,et al.  The contingent smile: a meta-analysis of sex differences in smiling. , 2003, Psychological bulletin.

[5]  Christina Kotchemidova Why We Say “Cheese”: Producing the Smile in Snapshot Photography , 2005 .

[6]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[7]  C. Goldin,et al.  The Race between Education and Technology: The Evolution of U.S. Educational Wage Differentials, 1890 to 2005 , 2007 .

[8]  Björn-Olav Dozo,et al.  Quantitative Analysis of Culture Using Millions of Digitized Books , 2010 .

[9]  Alexei A. Efros,et al.  What makes Paris look like Paris? , 2015, Commun. ACM.

[10]  Jitendra Malik,et al.  Discriminative Decorrelation for Clustering and Classification , 2012, ECCV.

[11]  C. Hélin Encyclopedia of hair : a cultural history , 2012 .

[12]  Alexei A. Efros,et al.  Dating Historical Color Images , 2012, ECCV.

[13]  Yong Jae Lee,et al.  Style-Aware Mid-level Representation for Discovering Visual Connections in Space and Time , 2013, 2013 IEEE International Conference on Computer Vision.

[14]  Fernando De la Torre,et al.  Supervised Descent Method and Its Applications to Face Alignment , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Alexei A. Efros,et al.  Mid-level Visual Element Discovery as Discriminative Mode Seeking , 2013, NIPS.

[16]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[17]  Wen-Huang Cheng,et al.  What are the Fashion Trends in New York? , 2014, ACM Multimedia.

[18]  J. Girard Automatic Detection and Intensity Estimation of Spontaneous Smiles , 2014 .

[19]  Alexander C. Berg,et al.  Hipster Wars: Discovering Elements of Fashion Styles , 2014, ECCV.

[20]  Shaun J. Canavan,et al.  BP4D-Spontaneous: a high-resolution spontaneous 3D dynamic facial expression database , 2014, Image Vis. Comput..

[21]  Connor Greenwell,et al.  Large-scale geo-facial image analysis , 2015, EURASIP J. Image Video Process..

[22]  Alexei A. Efros,et al.  Linking Past to Present: Discovering Style in Two Centuries of Architecture , 2015, 2015 IEEE International Conference on Computational Photography (ICCP).

[23]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[24]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.