Visualizing the Consequences of Climate Change Using Cycle-Consistent Adversarial Networks

We present a project that aims to generate images that depict accurate, vivid, and personalized outcomes of climate change using Cycle-Consistent Adversarial Networks (CycleGANs). By training our CycleGAN model on street-view images of houses before and after extreme weather events (e.g. floods, forest fires, etc.), we learn a mapping that can then be applied to images of locations that have not yet experienced these events. This visual transformation is paired with climate model predictions to assess likelihood and type of climate-related events in the long term (50 years) in order to bring the future closer in the viewers mind. The eventual goal of our project is to enable individuals to make more informed choices about their climate future by creating a more visceral understanding of the effects of climate change, while maintaining scientific credibility by drawing on climate model projections.

[1]  S. O'Neill,et al.  An iconic approach for representing climate change , 2009 .

[2]  Christian Früh,et al.  Google Street View: Capturing the World at Street Level , 2010, Computer.

[3]  E. Weber,et al.  Public Understanding of Climate Change in the United States Scientific Understanding of Climate Change These Assess- Ments Support the following Conclusions with High Or , 2011 .

[4]  N. Pidgeon,et al.  Public understanding of, and attitudes to, climate change: UK and international perspectives and policy , 2012 .

[5]  S. Sheppard.  Visualizing Climate Change: A Guide to Visual Communication of Climate Change and Developing Local Solutions , 2012 .

[6]  G. Giannachi.  Representing, Performing and Mitigating Climate Change in Contemporary Art Practice , 2012, Leonardo.

[7]  Scott McQuade,et al.  Climate Informatics: Accelerating Discovering in Climate Science with Machine Learning , 2013, Computing in Science & Engineering.

[8]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[9]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  L. Feyen,et al.  Development and evaluation of a framework for global flood hazard mapping , 2016 .

[11]  Prabhat,et al.  A Physics-Based Approach to Unsupervised Discovery of Coherent Structures in Spatiotemporal Systems , 2017, 1709.03184.

[12]  S. E. Haupt,et al.  Using Artificial Intelligence to Improve Real-Time Decision-Making for High-Impact Weather , 2017 .

[13]  Luca Antiga,et al.  Automatic differentiation in PyTorch , 2017 .

[14]  L. Joppa.  The case for technology investments in the environment , 2017, Nature.

[15]  Andrew Stuart,et al.  Earth System Modeling 2.0: A Blueprint for Models That Learn From Observations and Targeted High‐Resolution Simulations , 2017, 1709.00037.

[16]  Alexei A. Efros,et al.  Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[17]  Nagiza F. Samatova,et al.  Theory-Guided Data Science: A New Paradigm for Scientific Discovery from Data , 2016, IEEE Transactions on Knowledge and Data Engineering.

[18]  拓海 杉山,et al.  “Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks”の学習報告 , 2017 .

[19]  Prabhat,et al.  ExtremeWeather: A large-scale climate dataset for semi-supervised detection, localization, and understanding of extreme weather events , 2016, NIPS.

[20]  Pierre Gentine,et al.  Deep learning to represent subgrid processes in climate models , 2018, Proceedings of the National Academy of Sciences.

[21]  M. Vousdoukas,et al.  Global probabilistic projections of extreme sea levels show intensification of coastal flood hazard , 2018, Nature Communications.

[22]  Prabhat,et al.  Exascale Deep Learning for Climate Analytics , 2018, SC18: International Conference for High Performance Computing, Networking, Storage and Analysis.

[23]  Anuj Karpatne,et al.  Machine Learning for the Geosciences: Challenges and Opportunities , 2017, IEEE Transactions on Knowledge and Data Engineering.

[24]  Karl Pfeiffer,et al.  Improving Subseasonal Forecasting in the Western U.S. with Machine Learning , 2018, KDD.

[25]  Chris North,et al.  Intelligent systems for geosciences , 2018, Communications of the ACM.

[26]  P. Forster,et al.  Current fossil fuel infrastructure does not yet commit us to 1.5 °C warming , 2019, Nature Communications.