Physics guided neural networks for spatio-temporal super-resolution of turbulent flows

Direct numerical simulation (DNS) of turbulent flows is computationally expensive and is not practical for simulating flows at high Reynolds numbers. Low-resolution large eddy simulation (LES) is a pragmatic alternative, but its success depends on modeling of the small scale flow dynamics. Reconstructing DNS from low-resolution LES is critical for many scientific and engineering disci-plines, but it poses many challenges to existing super-resolution methods due to the complexity of turbulent flows and computational cost of generat-ing frequent LES data. In this work, we propose a physics-guided neural network for reconstructing frequent DNS from sparse LES data by enhancing its spatial resolution and temporal frequency. Our proposed method consists of a partial differential equation (PDE)-based recurrent unit for capturing underlying temporal processes and a physics-guided super-resolution model that incorporates additional physical constraints. We demonstrate the effectiveness of both components in reconstructing the data generated by simulating the Taylor-Green Vortex sparse LES data. Moreover, we show that the proposed recurrent unit can preserve the physical characteristics of turbulent flows by leveraging the physical relationships in the Navier-Stokes equation.

[1]  Shuhang Gu,et al.  MFAGAN: A Compression Framework for Memory-Efficient On-Device Super-Resolution GAN , 2021, SSRN Electronic Journal.

[2]  X. Jia,et al.  Integrating Scientific Knowledge with Machine Learning for Engineering and Environmental Systems , 2020, ACM Comput. Surv..

[3]  Taylor T. Johnson,et al.  Partial Differential Equation Driven Dynamic Graph Networks for Predicting Stream Water Temperature , 2021, 2021 IEEE International Conference on Data Mining (ICDM).

[4]  Byeungwoo Jeon,et al.  A Fast and Efficient Super-Resolution Network Using Hierarchical Dense Residual Learning , 2021, 2021 IEEE International Conference on Image Processing (ICIP).

[5]  Joseph P. Yurko,et al.  Reconstructing High-resolution Turbulent Flows Using Physics-Guided Neural Networks , 2021, 2021 IEEE International Conference on Big Data (Big Data).

[6]  Abhinav Vishnu,et al.  SURFNet: Super-Resolution of Turbulent Flows with Transfer Learning using Small Datasets , 2021, 2021 30th International Conference on Parallel Architectures and Compilation Techniques (PACT).

[7]  Rajat Srivastava,et al.  A comparative study of various Deep Learning techniques for spatio-temporal Super-Resolution reconstruction of Forced Isotropic Turbulent flows , 2021, Volume 10: Fluids Engineering.

[8]  Michael S. Steinbach,et al.  Physics-Guided Recurrent Graph Model for Predicting Flow and Temperature in River Networks , 2021, SDM.

[9]  Andrew Glaws,et al.  Adversarial super-resolution of climatological wind and solar data , 2020, Proceedings of the National Academy of Sciences.

[10]  Kai Fukami,et al.  Machine-learning-based spatio-temporal super resolution reconstruction of turbulent flows , 2020, Journal of Fluid Mechanics.

[11]  Xi-yun Lu,et al.  Deep learning methods for super-resolution reconstruction of turbulent flows , 2020, Physics of Fluids.

[12]  Yingzheng Liu,et al.  Super-resolution reconstruction of turbulent velocity fields using a generative adversarial network-based artificial intelligence framework , 2019 .

[13]  Yu Qiao,et al.  RankSRGAN: Generative Adversarial Networks With Ranker for Image Super-Resolution , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[14]  Shu-Tao Xia,et al.  Second-Order Attention Network for Single Image Super-Resolution , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Suyash P. Awate,et al.  Robust Super-Resolution Gan, with Manifold-Based and Perception Loss , 2019, 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019).

[16]  K. Taira,et al.  Super-resolution reconstruction of turbulent flows with machine learning , 2018, Journal of Fluid Mechanics.

[17]  Anuj Karpatne,et al.  Physics Guided RNNs for Modeling Dynamical Systems: A Case Study in Simulating Lake Temperature Profiles , 2018, SDM.

[18]  Yu Qiao,et al.  ESRGAN: Enhanced Super-Resolution Generative Adversarial Networks , 2018, ECCV Workshops.

[19]  Yun Fu,et al.  Image Super-Resolution Using Very Deep Residual Channel Attention Networks , 2018, ECCV.

[20]  Chao Dong,et al.  Recovering Realistic Texture in Image Super-Resolution by Deep Spatial Feature Transform , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[21]  Kyung-Ah Sohn,et al.  Fast, Accurate, and, Lightweight Super-Resolution with Cascading Residual Network , 2018, ECCV.

[22]  Yun Fu,et al.  Residual Dense Network for Image Super-Resolution , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[23]  Nils Thürey,et al.  tempoGAN: A Temporally Coherent, Volumetric GAN for Super-resolution Fluid Flow , 2018, ACM Trans. Graph..

[24]  Arash Nouri Gheimassi Self-Contained Filtered Density Function , 2018 .

[25]  Jian Yang,et al.  FSRNet: End-to-End Learning Face Super-Resolution with Facial Priors , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[26]  Jaakko Lehtinen,et al.  Progressive Growing of GANs for Improved Quality, Stability, and Variation , 2017, ICLR.

[27]  Tareq Abed Mohammed,et al.  Understanding of a convolutional neural network , 2017, 2017 International Conference on Engineering and Technology (ICET).

[28]  Jian Yang,et al.  Image Super-Resolution via Deep Recursive Residual Network , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Christian Ledig,et al.  Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Xiaoou Tang,et al.  Learning a Deep Convolutional Network for Image Super-Resolution , 2014, ECCV.

[31]  John C. Butcher,et al.  Runge-Kutta methods , 2007, Scholarpedia.

[32]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[33]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[34]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[35]  Steven A. Orszag,et al.  The Taylor-Green vortex and fully developed turbulence , 1984 .