A Point-Cloud Deep Learning Framework for Prediction of Fluid Flow Fields on Irregular Geometries

We present a novel deep learning framework for flow field predictions in irregular domains when the solution is a function of the geometry of either the domain or objects inside the domain. Grid vertices in a computational fluid dynamics (CFD) domain are viewed as point clouds and used as inputs to a neural network based on the PointNet architecture, which learns an end-to-end mapping between spatial positions and CFD quantities. Using our approach, (i) the network inherits desirable features of unstructured meshes (e.g., fine and coarse point spacing near the object surface and in the far field, respectively), which minimizes network training cost; (ii) object geometry is accurately represented through vertices located on object boundaries, which maintains boundary smoothness and allows the network to detect small changes between geometries; and (iii) no data interpolation is utilized for creating training data; thus accuracy of the CFD data is preserved. None of these features are achievable by extant methods based on projecting scattered CFD data into Cartesian grids and then using regular convolutional neural networks. Incompressible laminar steady flow past a cylinder with various shapes for its cross section is considered. The mass and momentum of predicted fields are conserved. For the first time, our network generalizes the predictions to multiple objects as well as an airfoil, even though only single objects and no airfoils are observed during training. The network predicts the flow fields hundreds of times faster than our conventional CFD solver, while maintaining excellent to reasonable accuracy.

[1]  A. Chorin Numerical solution of the Navier-Stokes equations , 1968 .

[2]  R. Temam Sur l'approximation de la solution des équations de Navier-Stokes par la méthode des pas fractionnaires (II) , 1969 .

[3]  A. D. Gosman,et al.  Two calculation procedures for steady, three-dimensional flows with recirculation , 1973 .

[4]  G. Karniadakis Numerical simulation of forced convection heat transfer from a cylinder in crossflow , 1988 .

[5]  Rainald Löhner Adaptive remeshing for transient problems , 1989 .

[6]  S. Mittal,et al.  Incompressible flow past a circular cylinder: dependence of the computed flow field on the location of the lateral boundaries , 1995 .

[7]  S. Balachandar,et al.  Direct Numerical Simulation of Flow Past Elliptic Cylinders , 1996 .

[8]  Murli M. Gupta,et al.  A Compact Multigrid Solver for Convection-Diffusion Equations , 1997 .

[9]  Jun Zhang Fast and High Accuracy Multigrid Solution of the Three Dimensional Poisson Equation , 1998 .

[10]  Hrvoje Jasak,et al.  A tensorial approach to computational continuum mechanics using object-oriented techniques , 1998 .

[11]  Parviz Moin,et al.  B-Spline Method and Zonal Grids for Simulations of Complex Turbulent Flows , 1997 .

[12]  Karlin R. Roth,et al.  High-Lift Optimization Design Using Neural Networks on a Multi-Element Airfoil , 1999 .

[13]  William Gropp,et al.  High-performance parallel implicit CFD , 2001, Parallel Comput..

[14]  P. Moin,et al.  A numerical method for large-eddy simulation in complex geometries , 2004 .

[15]  C. Shu,et al.  Simulation of incompressible viscous flows past a circular cylinder by hybrid FD scheme and meshless least square-based finite difference method , 2004 .

[16]  Michael M. Resch,et al.  High performance computing in science and engineering , 2005, 17th International Symposium on Computer Architecture and High Performance Computing (SBAC-PAD'05).

[17]  Amaresh Dalal,et al.  Numerical simulation of unconfined flow past a triangular cylinder , 2006 .

[18]  Jie Shen,et al.  An overview of projection methods for incompressible flows , 2006 .

[19]  Stephan M. Hitzel,et al.  Parallel remeshing of unstructured volume grids for CFD applications , 2007 .

[20]  Christophe Geuzaine,et al.  Gmsh: A 3‐D finite element mesh generator with built‐in pre‐ and post‐processing facilities , 2009 .

[21]  Eftychios Sifakis,et al.  A parallel multigrid Poisson solver for fluids simulation on large grids , 2010, SCA '10.

[22]  Rupak Biswas,et al.  High performance computing using MPI and OpenMP on multi-core parallel systems , 2011, Parallel Comput..

[23]  Nicolas Gourdain,et al.  High performance parallel computing of flows in complex geometries , 2011 .

[24]  Sanjay Mittal,et al.  Flow past a square cylinder at low Reynolds numbers , 2011 .

[25]  Vincent Moureau,et al.  Design of a massively parallel CFD code for complex geometries , 2011 .

[26]  C. K. Filelis-Papadopoulos,et al.  On the numerical modeling of convection-diffusion problems by finite element multigrid preconditioning methods , 2014, Adv. Eng. Softw..

[27]  Eric Forsta Thacher Solar Racer—Concept Generation and Selection , 2015 .

[28]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[29]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[30]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[31]  Wei Li,et al.  Convolutional Neural Networks for Steady Flow Approximation , 2016, KDD.

[32]  Timo Aila,et al.  Interactive reconstruction of Monte Carlo image sequences using a recurrent denoising autoencoder , 2017, ACM Trans. Graph..

[33]  Shahab D. Mohaghegh,et al.  Data Driven Smart Proxy for CFD: Application of Big Data Analytics & Machine Learning in Computational Fluid Dynamics, Part One: Proof of Concept; NETL-PUB-21574; NETL Technical Report Series; U.S. Department of Energy, National Energy Technology Laboratory: Morgantown, WV, 2017. , 2017 .

[34]  Omer San,et al.  A neural network approach for the blind deconvolution of turbulent flows , 2017, Journal of Fluid Mechanics.

[35]  T. P. Miyanawala,et al.  An Efficient Deep Learning Technique for the Navier-Stokes Equations: Application to Unsteady Wake Flow Dynamics , 2017, 1710.09099.

[36]  Leonidas J. Guibas,et al.  PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space , 2017, NIPS.

[37]  Ken Perlin,et al.  Accelerating Eulerian Fluid Simulation With Convolutional Networks , 2016, ICML.

[38]  Charles Meneveau,et al.  Turbulence in the Era of Big Data: Recent Experiences with Sharing Large Datasets , 2017 .

[39]  Md. Quamrul Islam,et al.  Simulation of wind flow over square, pentagonal and hexagonal cylinders in a staggered form , 2017 .

[40]  Leonidas J. Guibas,et al.  PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[41]  Yao Zhang,et al.  Application of Convolutional Neural Network to Predict Airfoil Lift Coefficient , 2017, ArXiv.

[42]  T. P. Miyanawala,et al.  A Novel Deep Learning Method for the Predictions of Current Forces on Bluff Bodies , 2018, Volume 2: CFD and FSI.

[43]  Shahab D. Mohaghegh,et al.  Data Driven Smart Proxy for CFD Application of Big Data Analytics & Machine Learning in Computational Fluid Dynamics, Part Three: Model Building at the Layer Level , 2018 .

[44]  Ali Kashefi,et al.  A finite-element coarse-grid projection method for incompressible flow simulations , 2018, Adv. Comput. Math..

[45]  Leonidas J. Guibas,et al.  Frustum PointNets for 3D Object Detection from RGB-D Data , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[46]  Nils Thuerey,et al.  Deep Learning Methods for Reynolds-Averaged Navier–Stokes Simulations of Airfoil Flows , 2018, AIAA Journal.

[47]  Prakash Vedula,et al.  Subgrid modelling for two-dimensional turbulence using neural networks , 2018, Journal of Fluid Mechanics.

[48]  Vaibhav Joshi,et al.  Data-Driven Computing With Convolutional Neural Networks for Two-Phase Flows: Application to Wave-Structure Interaction , 2018, Volume 2: CFD and FSI.

[49]  Hui Li,et al.  Prediction model of velocity field around circular cylinder over various Reynolds numbers by fusion convolutional neural networks based on pressure on the cylinder , 2018 .

[50]  Nicolas Jacques,et al.  A two-dimensional analytical model of vertical water entry for asymmetric bodies with flow separation , 2019, Applied Ocean Research.

[51]  T. P. Miyanawala,et al.  A Low-Dimensional Learning Model via Convolutional Neural Networks for Unsteady Wake-Body Interaction , 2018, 1807.09591.

[52]  Andreas Geiger,et al.  Occupancy Flow: 4D Reconstruction by Learning Particle Dynamics , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[53]  Gang Chen,et al.  A novel spatial-temporal prediction method for unsteady wake flows based on hybrid deep neural network , 2019, Physics of Fluids.

[54]  Lu Deng,et al.  Flow past a rectangular cylinder close to a free surface , 2019, Ocean Engineering.

[55]  Boo Cheong Khoo,et al.  Fast flow field prediction over airfoils using deep learning approach , 2019, Physics of Fluids.

[56]  Leonidas J. Guibas,et al.  KPConv: Flexible and Deformable Convolution for Point Clouds , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[57]  K. Taira,et al.  Super-resolution reconstruction of turbulent flows with machine learning , 2018, Journal of Fluid Mechanics.

[58]  C. Qi,et al.  FlowNet3D: Learning Scene Flow in 3D Point Clouds , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[59]  Nagel,et al.  High Performance Computing in Science and Engineering ' 18 , 2019 .

[60]  Wenming Yang,et al.  Integrated analysis of CFD simulation data with K-means clustering algorithm for soot formation under varied combustion conditions , 2019, Applied Thermal Engineering.

[61]  Jing Liu,et al.  Reduced Order Model for Unsteady Fluid Flows via Recurrent Neural Networks , 2019, Volume 2: CFD and FSI.

[62]  Ali Kashefi,et al.  Coarse Grid Projection Methodology: A Partial Mesh Refinement Tool for Incompressible Flow Simulations , 2018, Bulletin of the Iranian Mathematical Society.

[63]  Markus H. Gross,et al.  Deep Fluids: A Generative Network for Parameterized Fluid Simulations , 2018, Comput. Graph. Forum.

[64]  Steffen Müthing,et al.  Matrix-free multigrid block-preconditioners for higher order Discontinuous Galerkin discretisations , 2018, J. Comput. Phys..

[65]  Karthik Duraisamy,et al.  Turbulence Modeling in the Age of Data , 2018, Annual Review of Fluid Mechanics.

[66]  Claus-Dieter Munz,et al.  Deep Neural Networks for Data-Driven Turbulence Models , 2018, J. Comput. Phys..

[67]  Heng Xiao,et al.  Flows over periodic hills of parameterized geometries: A dataset for data-driven turbulence modeling from direct simulations , 2019, Computers & Fluids.

[68]  Paris Perdikaris,et al.  Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations , 2019, J. Comput. Phys..

[69]  Richard A. Newcombe,et al.  DeepSDF: Learning Continuous Signed Distance Functions for Shape Representation , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[70]  Yue Wang,et al.  Dynamic Graph CNN for Learning on Point Clouds , 2018, ACM Trans. Graph..

[71]  Leonidas J. Guibas,et al.  Deep Hough Voting for 3D Object Detection in Point Clouds , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[72]  Karthik Duraisamy,et al.  Prediction of aerodynamic flow fields using convolutional neural networks , 2019, Computational Mechanics.

[73]  Leonidas J. Guibas,et al.  FlowNet3D: Learning Scene Flow in 3D Point Clouds , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[74]  T. Poinsot,et al.  Training convolutional neural networks to estimate turbulent sub-grid scale reaction rates , 2018, Combustion and Flame.

[75]  Ali Kashefi,et al.  A coarse-grid projection method for accelerating incompressible MHD flow simulations , 2020, Engineering with Computers.

[76]  Hui Wang,et al.  A Novel CNN-Based Poisson Solver for Fluid Simulation , 2020, IEEE Transactions on Visualization and Computer Graphics.

[77]  Vinayak R. Krishnamurthy,et al.  Generalizability of Convolutional Encoder–Decoder Networks for Aerodynamic Flow-Field Prediction Across Geometric and Physical-Fluidic Variations , 2020, Journal of Mechanical Design.

[78]  G. Karniadakis,et al.  Physics-informed neural networks for high-speed flows , 2020, Computer Methods in Applied Mechanics and Engineering.

[79]  L. Dal Negro,et al.  Physics-informed neural networks for inverse problems in nano-optics and metamaterials. , 2019, Optics express.

[80]  Siheng Chen,et al.  Unsteady reduced-order model of flow over cylinders based on convolutional and deconvolutional neural network structure , 2020 .

[81]  Thomas Funkhouser,et al.  Local Implicit Grid Representations for 3D Scenes , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[82]  Changhoon Lee,et al.  Prediction of turbulent heat transfer using convolutional neural networks , 2019, Journal of Fluid Mechanics.

[83]  Junqiang Bai,et al.  Fast pressure distribution prediction of airfoils using deep learning , 2020 .

[84]  Leonidas J. Guibas,et al.  Predicting the Physical Dynamics of Unseen 3D Objects , 2020, 2020 IEEE Winter Conference on Applications of Computer Vision (WACV).

[85]  Allan Ross Magee,et al.  Deep Convolutional Recurrent Autoencoders for Flow Field Prediction , 2020, Volume 8: CFD and FSI.

[86]  Koji Fukagata,et al.  CNN-LSTM based reduced order modeling of two-dimensional unsteady flows around a circular cylinder at different Reynolds numbers , 2020, Fluid Dynamics Research.

[87]  Levent Burak Kara,et al.  Deep Learning for Stress Field Prediction Using Convolutional Neural Networks , 2018, J. Comput. Inf. Sci. Eng..

[88]  A. Kashefi,et al.  A coarse-grid incremental pressure projection method for accelerating low Reynolds number incompressible flow simulations , 2018, Iran J. Comput. Sci..

[89]  G. Karniadakis,et al.  Conservative physics-informed neural networks on discrete domains for conservation laws: Applications to forward and inverse problems , 2020 .

[90]  Ali Kashefi,et al.  A Coarse Grid Projection Method for Accelerating Free and Forced Convection Heat Transfer Computations , 2020 .

[91]  Cihat Duru,et al.  CNNFOIL: convolutional encoder decoder modeling for pressure fields around airfoils , 2020, Neural Computing and Applications.