Streetscape augmentation using generative adversarial networks: insights related to health and wellbeing

Deep learning using neural networks has provided advances in image style transfer, merging the content of one image (e.g., a photo) with the style of another (e.g., a painting). Our research shows this concept can be extended to analyse the design of streetscapes in relation to health and wellbeing outcomes. An Australian population health survey (n=34,000) was used to identify the spatial distribution of health and wellbeing outcomes, including general health and social capital. For each outcome, the most and least desirable locations formed two domains. Streetscape design was sampled using around 80,000 Google Street View images per domain. Generative adversarial networks translated these images from one domain to the other, preserving the main structure of the input image, but transforming the `style' from locations where self-reported health was bad to locations where it was good. These translations indicate that areas in Melbourne with good general health are characterised by sufficient green space and compactness of the urban environment, whilst streetscape imagery related to high social capital contained more and wider footpaths, fewer fences and more grass. Beyond identifying relationships, the method is a first step towards computer-generated design interventions that have the potential to improve population health and wellbeing.

[1]  Lawrence D. Frank,et al.  The Built Environment and Human Activity Patterns: Exploring the Impacts of Urban Form on Public Health , 2001 .

[2]  Alexei A. Efros,et al.  Context Encoders: Feature Learning by Inpainting , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Organización Internacional para las Migraciones World Migration Report 2015. Migrants and cities: new partnerships to manage mobility , 2016 .

[4]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  S. Galea,et al.  Are neighbourhood characteristics associated with depressive symptoms? A review of evidence , 2008, Journal of Epidemiology & Community Health.

[6]  Jan Kautz,et al.  Unsupervised Image-to-Image Translation Networks , 2017, NIPS.

[7]  拓海 杉山,et al.  “Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks”の学習報告 , 2017 .

[8]  Leon A. Gatys,et al.  Image Style Transfer Using Convolutional Neural Networks , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Robert A Verheij,et al.  Vitamin G: effects of green space on health, well-being, and social safety , 2006, BMC public health.

[10]  P. Groenewegen,et al.  Streetscape greenery and health: stress, social cohesion and physical activity as mediators. , 2013, Social science & medicine.

[11]  B. Giles-Corti,et al.  The built environment, neighborhood crime and constrained physical activity: an exploration of inconsistent findings. , 2008, Preventive medicine.

[12]  Thomas L. Saaty,et al.  Compact city;: A plan for a liveable urban environment , 1973 .

[13]  Michael W. Mehaffy,et al.  The “neighborhood unit” on trial: a case study in the impacts of urban morphology , 2015 .

[14]  Alexei A. Efros,et al.  Toward Multimodal Image-to-Image Translation , 2017, NIPS.

[15]  Minh N. Do,et al.  Semantic Image Inpainting with Deep Generative Models , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Matthew Carmona,et al.  Public Places - Urban Spaces : the dimensions of urban design, Second Edition , 2003 .

[17]  Leonidas Anthopoulos,et al.  Eco-cities: An integrated system dynamics framework and a concise research taxonomy , 2015 .

[18]  E. Howard Garden Cities Of To-Morrow , 1903 .

[19]  G. Tiwari,et al.  Land use, transport, and population health: estimating the health benefits of compact cities , 2016, The Lancet.

[20]  Christian Früh,et al.  Google Street View: Capturing the World at Street Level , 2010, Computer.

[21]  Ayyoob Sharifi From Garden City to Eco-urbanism: The quest for sustainable neighborhood development , 2016 .

[22]  Michael R. Lyu,et al.  High-Resolution Deep Convolutional Generative Adversarial Networks , 2017, ArXiv.

[23]  R. Fishman Urban utopias in the twentieth century , 1977 .

[24]  Jaakko Lehtinen,et al.  Few-Shot Unsupervised Image-to-Image Translation , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[25]  H. Frumkin Urban Sprawl and Public Health , 2002, Public health reports.

[26]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[27]  Simon Joss,et al.  Towards the ‘ubiquitous eco-city’: An analysis of the internationalisation of eco-city policy and practice , 2013 .

[28]  K. Leyden Social capital and the built environment: the importance of walkable neighborhoods. , 2003, American journal of public health.

[29]  Ramesh Raskar,et al.  Streetscore -- Predicting the Perceived Safety of One Million Streetscapes , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[30]  Kevin Lynch,et al.  The Image of the City , 1960 .

[31]  Billie Giles-Corti,et al.  Increasing density in Australia: maximising the health benefits and minimising harm , 2012 .

[32]  Brian Finch,et al.  The built environment and collective efficacy. , 2008, Health & place.

[33]  Michelle C. Kondo,et al.  Effect of Greening Vacant Land on Mental Health of Community-Dwelling Adults , 2018, JAMA network open.

[34]  F. Celaschi,et al.  La ville radieuse , 2005 .

[35]  A. Kaźmierczak,et al.  Promoting ecosystem and human health in urban areas using Green Infrastructure: A literature review , 2007 .

[36]  C. Ratti,et al.  Green streets − Quantifying and mapping urban trees with street-level imagery and computer vision , 2017 .

[37]  W. Greene,et al.  Streetscape Features Related to Pedestrian Activity , 2016 .

[38]  Gavin Pereira,et al.  The association between neighborhood greenness and cardiovascular disease: an observational study , 2012, BMC Public Health.

[39]  Jillian Anable,et al.  Performance, importance and user disgruntlement: a six-step method for measuring satisfaction with travel modes. , 2007 .

[40]  Elizabeth Plater-Zyberk,et al.  Identifying Streetscape Features Significant to Well-Being , 2007, Architectural science review.

[41]  Bolei Zhou,et al.  Recognizing City Identity via Attribute Analysis of Geo-tagged Images , 2014, ECCV.

[42]  Alexei A. Efros,et al.  What makes Paris look like Paris? , 2015, Commun. ACM.

[43]  E. Lozano Community Design and the Culture of Cities: The Crossroad and the Wall , 1990 .

[44]  B. Giles-Corti,et al.  Can the built environment reduce health inequalities? A study of neighbourhood socioeconomic disadvantage and walking for transport. , 2013, Health & place.

[45]  Christian Ledig,et al.  Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[46]  M. Townsend,et al.  ‘Dig In’ to Social Capital: Community Gardens as Mechanisms for Growing Urban Social Connectedness , 2006 .

[47]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[48]  A. Pullin,et al.  Urban greening to cool towns and cities: a systematic review of the empirical evidence. , 2010 .

[49]  Carrie M. Geremia,et al.  Is Your Neighborhood Designed to Support Physical Activity? A Brief Streetscape Audit Tool , 2015, Preventing chronic disease.

[50]  P. Aspinall,et al.  More green space is linked to less stress in deprived communities: Evidence from salivary cortisol patterns , 2012 .

[51]  Zhenxin Wang,et al.  Measuring visual enclosure for street walkability: Using machine learning algorithms and Google Street View imagery , 2016 .

[52]  Yosef Jabareen,et al.  Sustainable Urban Forms , 2006 .

[53]  N. Owen,et al.  Associations of neighbourhood greenness with physical and mental health: do walking, social coherence and local social interaction explain the relationships? , 2008, Journal of Epidemiology & Community Health.

[54]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[55]  P. Groenewegen,et al.  Social contacts as a possible mechanism behind the relation between green space and health. , 2009, Health & place.

[56]  P. Groenewegen,et al.  EVIDENCE BASED PUBLIC HEALTH POLICY AND PRACTICE Green space, urbanity, and health: how strong is the relation? , 2006 .

[57]  Michelle C. Kondo,et al.  Nature-Based Strategies for Improving Urban Health and Safety , 2015, Journal of Urban Health.

[58]  Benny Bing Assessing and Enhancing Video Quality , 2015 .

[59]  Claire L. Smith,et al.  Designing urban spaces and buildings to improve sustainability and quality of life in a warmer world , 2008 .

[60]  Jinhua Zhao,et al.  C-IMAGE: city cognitive mapping through geo-tagged photos , 2016 .

[61]  Lucas Theis,et al.  Amortised MAP Inference for Image Super-resolution , 2016, ICLR.

[62]  Weixing Zhang,et al.  Urban Forestry & Urban Greening , 2015 .

[63]  Frank Lloyd Wright,et al.  The disappearing city , 1933 .

[64]  César A. Hidalgo,et al.  The Collaborative Image of The City: Mapping the Inequality of Urban Perception , 2013, PloS one.

[65]  Doan Nguyen,et al.  Evidence of the Impacts of Urban Sprawl on Social Capital , 2010 .

[66]  P. Groenewegen,et al.  Natural Environments—Healthy Environments? An Exploratory Analysis of the Relationship between Greenspace and Health , 2003 .

[67]  Michelle C. Kondo,et al.  Urban Blight Remediation as a Cost-Beneficial Solution to Firearm Violence. , 2016, American journal of public health.

[68]  W. Sullivan,et al.  The Fruit of Urban Nature , 2004 .

[69]  Ramesh Raskar,et al.  Deep Learning the City: Quantifying Urban Perception at a Global Scale , 2016, ECCV.

[70]  Derlie Mateo-Babiano,et al.  Healthy places, active transport and path dependence: a review of the literature. , 2014, Health promotion journal of Australia : official journal of Australian Association of Health Promotion Professionals.

[71]  R. Fishman Urban utopias in the twentieth century : Ebenezer Howard, Frank Lloyd Wright, and Le Corbusier , 1979 .

[72]  Jan Kautz,et al.  Multimodal Unsupervised Image-to-Image Translation , 2018, ECCV.