Mapping and Visualizing Deep-Learning Urban Beautification

Information visualization has great potential to make sense of the increasing amount of data generated by complex machine-learning algorithms. We design a set of visualizations for a new deep-learning algorithm called FaceLift (goodcitylife.org/facelift). This algorithm is able to generate a beautified version of a given urban image (such as from Google Street View), and our visualizations compare pairs of original and beautified images. With those visualizations, we aim at helping practitioners understand what happened during the algorithmic beautification without requiring them to be machine-learning experts. We evaluate the effectiveness of our visualizations to do just that with a survey among practitioners. From the survey results, we derive general design guidelines on how information visualization makes complex machine-learning algorithms more understandable to a general audience.

[1]  Nadine Eberhardt Measuring Urban Design Metrics For Livable Places , 2016 .

[2]  Thomas Hofmann,et al.  TrueSkill™: A Bayesian Skill Rating System , 2007 .

[3]  Arthur E Stamps,et al.  Advances in Visual Diversity and Entropy , 2003 .

[4]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Hui Wang,et al.  A machine learning-based method for the large-scale evaluation of the qualities of the urban environment , 2017, Comput. Environ. Urban Syst..

[6]  Virgílio A. F. Almeida,et al.  Psychological maps 2.0: a web engagement enterprise starting in London , 2013, WWW.

[7]  Henriette Cramer,et al.  Aesthetic capital: what makes london look beautiful, quiet, and happy? , 2014, CSCW.

[8]  Niklas Elmqvist,et al.  Fluid interaction for information visualization , 2011, Inf. Vis..

[9]  Bolei Zhou,et al.  Learning Deep Features for Scene Recognition using Places Database , 2014, NIPS.

[10]  C. Ratti,et al.  Green streets − Quantifying and mapping urban trees with street-level imagery and computer vision , 2017 .

[11]  Thomas Brox,et al.  Synthesizing the preferred inputs for neurons in neural networks via deep generator networks , 2016, NIPS.

[12]  Jo Wood,et al.  Automated planning of leisure walks based on crowd-sourced photographic content , 2014 .

[13]  Tom Minka,et al.  TrueSkillTM: A Bayesian Skill Rating System , 2006, NIPS.

[14]  Ramesh Raskar,et al.  Streetscore -- Predicting the Perceived Safety of One Million Streetscapes , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[15]  Ramesh Raskar,et al.  Computer vision uncovers predictors of physical urban change , 2017, Proceedings of the National Academy of Sciences.

[16]  Evelyne de Leuw,et al.  Connecting the dots , 1999, Nature Genetics.

[17]  M. Sheelagh T. Carpendale,et al.  Critical InfoVis: exploring the politics of visualization , 2013, CHI Extended Abstracts.

[18]  Reid Ewing,et al.  Measuring Urban Design: Metrics for Livable Places , 2013 .

[19]  Gerhard Schmitt,et al.  Cognitive computing for urban planning , 2018 .

[20]  Morgan M. Larson,et al.  The Architecture of Happiness , 2018 .