Linking Past to Present: Discovering Style in Two Centuries of Architecture

With vast quantities of imagery now available online, researchers have begun to explore whether visual patterns can be discovered automatically. Here we consider the particular domain of architecture, using huge collections of street-level imagery to find visual patterns that correspond to semantic-level architectural elements distinctive to particular time periods. We use this analysis both to date buildings, as well as to discover how functionally-similar architectural elements (e.g. windows, doors, balconies, etc.) have changed over time due to evolving styles. We validate the methods by combining a large dataset of nearly 150,000 Google Street View images from Paris with a cadastre map to infer approximate construction date for each facade. Not only could our analysis be used for dating or geo- localizing buildings based on architectural features, but it also could give architects and historians new tools for confirming known theories or even discovering new ones.

[1]  Claudio Cioffi-Revilla,et al.  Computational social science , 2010 .

[2]  Erez Lieberman Aiden,et al.  Quantitative Analysis of Culture Using Millions of Digitized Books , 2010, Science.

[3]  Dirk Helbing,et al.  A network framework of cultural history , 2014, Science.

[4]  Frank Dellaert,et al.  4D Cities: Analyzing, Visualizing, and Interacting with Historical Urban Photo Collections , 2012, J. Multim..

[5]  Edward Courtney,et al.  2 = 4 M , 1993 .

[6]  A. Pentland,et al.  Computational Social Science , 2009, Science.

[7]  Luc Van Gool,et al.  Is There a Procedural Logic to Architecture? , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Simon DeDeo,et al.  The civilizing process in London’s Old Bailey , 2014, Proceedings of the National Academy of Sciences.

[9]  David G. Stork,et al.  Computer Vision and Computer Graphics Analysis of Paintings and Drawings: An Introduction to the Literature , 2009, CAIP.

[10]  Judy Pearsall,et al.  Oxford Dictionary of English , 2010 .

[11]  Jitendra Malik,et al.  Discriminative Decorrelation for Clustering and Classification , 2012, ECCV.

[12]  Marie-Thérèse Besse,et al.  ATELIER PARISIEN D'URBANISME , 2011 .

[13]  Seung-Woo Son,et al.  Large-Scale Quantitative Analysis of Painting Arts , 2014, Scientific Reports.

[14]  Alexei A. Efros,et al.  City Forensics: Using Visual Elements to Predict Non-Visual City Attributes , 2014, IEEE Transactions on Visualization and Computer Graphics.

[15]  Alexei A. Efros,et al.  What makes Paris look like Paris? , 2015, Commun. ACM.

[16]  Alexei A. Efros,et al.  Mid-level Visual Element Discovery as Discriminative Mode Seeking , 2013, NIPS.

[17]  Yll Haxhimusa,et al.  Architectural Style Classification of Building Facade Windows , 2011, ISVC.

[18]  Yong Jae Lee,et al.  Style-Aware Mid-level Representation for Discovering Visual Connections in Space and Time , 2013, 2013 IEEE International Conference on Computer Vision.

[19]  Mathieu Aubry,et al.  Painting-to-3D model alignment via discriminative visual elements , 2014, TOGS.

[20]  Luc Van Gool,et al.  Parameter-free/Pareto-driven procedural 3D reconstruction of buildings from ground-level sequences , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  D. Ruths,et al.  Social media for large studies of behavior , 2014, Science.

[22]  Bolei Zhou,et al.  Recognizing City Identity via Attribute Analysis of Geo-tagged Images , 2014, ECCV.

[23]  Yll Haxhimusa,et al.  Architectural Style Classification of Domes , 2012, ISVC.

[24]  Christian Früh,et al.  Google Street View: Capturing the World at Street Level , 2010, Computer.

[25]  Jitendra Malik,et al.  Parsing Images of Architectural Scenes , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[26]  D. Lazer,et al.  The Parable of Google Flu: Traps in Big Data Analysis , 2014, Science.

[27]  Caroline O. Buckee,et al.  Digital Epidemiology , 2012, PLoS Comput. Biol..

[28]  Pascal Fua,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence 1 Multiple Object Tracking Using K-shortest Paths Optimization , 2022 .

[29]  Jeremy Ginsberg,et al.  Detecting influenza epidemics using search engine query data , 2009, Nature.

[30]  Tomasz Malisiewicz,et al.  A Gaussian Approximation of Feature Space for Fast Image Similarity , 2012 .

[31]  Vicente Ordonez,et al.  Learning High-Level Judgments of Urban Perception , 2014, ECCV.

[32]  Junjie Wu,et al.  Architectural Style Classification Using Multinomial Latent Logistic Regression , 2014, ECCV.