Typeface Reveals Spatial Economical Patterns

Understanding the socioeconomic and demographic characteristics of an urban region is vital for policy-making, urban management, and urban planning. Auditing socioeconomic and demographic patterns traditionally entails producing a large portion of data by human-participant surveys, which are usually costly and time consuming. Even with newly developed computational methods, amenity characteristics such as typeface, color, and graphic element choices are still missing at the city scale. However, they have a huge impact on personalized preferences. Currently, researchers tend to use large-scale street view imagery to uncover physical and socioeconomic patterns. In this research, we first propose a framework that uses deep convolutional neural network to recognize the typeface from street view imagery in London. Second, we analyze the relationship between 11 typefaces and the average household income in 77 wards of London. The result show that the typefaces used in the neighborhood are highly correlated with economic and demographic factors. Typeface could be an alternative metric to evaluate economic and demographic status in large-scale urban regions. More generally, typeface can also act as a key visual characteristic of a city.

[1]  Jia Deng,et al.  A large-scale hierarchical image database , 2009, CVPR 2009.

[2]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[3]  William Alonso,et al.  Location and Land Use: Toward a General Theory of Land Rent , 1966 .

[4]  C'esar A. Hidalgo,et al.  Do we need another coffee house? The amenity space and the evolution of neighborhoods , 2015 .

[5]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Jonathan Krause,et al.  Using deep learning and Google Street View to estimate the demographic makeup of neighborhoods across the United States , 2017, Proceedings of the National Academy of Sciences.

[7]  Ankush Gupta,et al.  Synthetic Data for Text Localisation in Natural Images , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  J. Doyle,et al.  Font appropriateness and brand choice , 2004 .

[9]  Robert Bringhurst,et al.  The Elements of Typographic Style , 1992 .

[10]  Tony X. Han,et al.  Large-Scale Visual Font Recognition , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Hui Lin,et al.  Reflections and speculations on the progress in Geographic Information Systems (GIS): a geographic perspective , 2018, Int. J. Geogr. Inf. Sci..

[12]  Andrew Zisserman,et al.  Deep Features for Text Spotting , 2014, ECCV.

[13]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[14]  Ulrich R. Orth,et al.  Holistic Package Design and Consumer Brand Impressions , 2008 .

[15]  Yu Liu,et al.  Extracting human emotions at different places based on facial expressions and spatial clustering analysis , 2019, Trans. GIS.

[16]  Min Chen,et al.  Developing a data model for understanding geographical analysis models with consideration of their evolution and application processes , 2018, Trans. GIS.

[17]  R. Kirwan Location and Land Use: Toward a General Theory of Land Rent , 1966 .

[18]  Joseph A. Cote,et al.  Impression Management using Typeface Design , 2004 .

[19]  Thomas S. Huang,et al.  DeepFont: Identify Your Font from An Image , 2015, ACM Multimedia.

[20]  Dean Yager,et al.  High and low luminance letters, acuity reserve, and font effects on reading speed , 1998, Vision Research.

[21]  V. Cook The language of the street , 2013 .

[22]  Shuchang Zhou,et al.  EAST: An Efficient and Accurate Scene Text Detector , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Yves Zenou,et al.  Why is central Paris rich and downtown Detroit poor?: An amenity-based theory , 1999 .

[24]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Xiang Bai,et al.  An End-to-End Trainable Neural Network for Image-Based Sequence Recognition and Its Application to Scene Text Recognition , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Carlo Ratti,et al.  Discovering place-informative scenes and objects using social media photos , 2019, Royal Society Open Science.

[27]  Sang Michael Xie,et al.  Combining satellite imagery and machine learning to predict poverty , 2016, Science.

[28]  Guosheng Lin,et al.  Deep convolutional neural fields for depth estimation from a single image , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[30]  W. Wheaton,et al.  Income and Urban Residence: An Analysis of Consumer Demand for Location , 1974 .

[31]  Charless C. Fowlkes,et al.  Contour Detection and Hierarchical Image Segmentation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Michael L. Bernard,et al.  The effects of font type and size on the legibility and reading time of online text by older adults , 2001, CHI Extended Abstracts.

[33]  Weixing Zhang,et al.  Assessing street-level urban greenery using Google Street View and a modified green view index , 2015 .

[34]  Lun Wu,et al.  Social sensing from street-level imagery: A case study in learning spatio-temporal urban mobility patterns , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[35]  藤田 昌久,et al.  Urban economic theory : land use and city size , 1989 .

[36]  Carl Gutwin,et al.  Seeing things in the clouds: the effect of visual features on tag cloud selections , 2008, Hypertext.