PhyNet: Physics Guided Neural Networks for Particle Drag Force Prediction in Assembly

Physics-based simulations are often used to model and understand complex physical systems in domains like fluid dynamics. Such simulations although used frequently, often suffer from inaccurate or incomplete representations either due to their high computational costs or due to lack of complete physical knowledge of the system. In such situations, it is useful to employ machine learning to fill the gap by learning a model of the complex physical process directly from simulation data. However, as data generation through simulations is costly, we need to develop models being cognizant of data paucity issues. In such scenarios it is helpful if the rich physical knowledge of the application domain is incorporated in the architectural design of machine learning models. We can also use information from physics-based simulations to guide the learning process using aggregate supervision to favorably constrain the learning process. In this paper, we propose PhyNet , a deep learning model using physics-guided structural priors and physics-guided aggregate supervision for modeling the drag forces acting on each particle in a Computational Fluid Dynamics-Discrete Element Method (CFD-DEM). We conduct extensive experiments in the context of drag force prediction and showcase the usefulness of including physics knowledge in our deep learning formulation. PhyNet has been compared to several state-ofthe-art models and achieves a significant performance improvement of 8.46% on average . The source code has been made available and the dataset used is detailed in [1, 2].

[1]  Chong Fu,et al.  Convolutional neural networks combined with Runge–Kutta methods , 2018, Neural Comput. Appl..

[2]  Stefano Ermon,et al.  Label-Free Supervision of Neural Networks with Physics and Domain Knowledge , 2016, AAAI.

[3]  Joel Z. Leibo,et al.  View-Tolerant Face Recognition and Hebbian Learning Imply Mirror-Symmetric Neural Tuning to Head Orientation , 2016, Current Biology.

[4]  Yaser S. Abu-Mostafa,et al.  Learning from hints in neural networks , 1990, J. Complex..

[5]  Firdaus Janoos,et al.  Multi-scale Graphical Models for Spatio-Temporal Processes , 2014, NIPS.

[6]  Kai Wang,et al.  Accounting for linkage disequilibrium in genome-wide association studies: A penalized regression method. , 2013, Statistics and its interface.

[7]  R. D. Felice,et al.  The voidage function for fluid-particle interaction systems , 1994 .

[8]  J.A.M. Kuipers,et al.  Gas-particle interactions in dense gas-fluidised beds , 2003 .

[9]  Andrew J. Majda,et al.  FUNDAMENTAL LIMITATIONS OF AD HOC LINEAR AND QUADRATIC MULTI-LEVEL REGRESSION MODELS FOR PHYSICAL SYSTEMS , 2012 .

[10]  Snigdhansu Chatterjee,et al.  Sparse Group Lasso: Consistency and Climate Applications , 2012, SDM.

[11]  Alex Goodall,et al.  The guide to expert systems , 1985 .

[12]  Yan Liu,et al.  Differentiable Physics-informed Graph Networks , 2019, ArXiv.

[13]  Risi Kondor,et al.  On the Generalization of Equivariance and Convolution in Neural Networks to the Action of Compact Groups , 2018, ICML.

[14]  Linwei Wang,et al.  Robust Transmural Electrophysiological Imaging: Integrating Sparse and Dynamic Physiological Models into ECG-Based Inference , 2015, MICCAI.

[15]  Pengcheng Shi,et al.  Active Model with Orthotropic Hyperelastic Material for Cardiac Image Analysis , 2009, FIMH.

[16]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[17]  Stefano Ermon,et al.  Learning with Weak Supervision from Physics and Data-Driven Constraints , 2018, AI Mag..

[18]  Danesh K. Tafti,et al.  Evaluation of drag correlations using particle resolved simulations of spheres and ellipsoids in assembly , 2017 .

[19]  C. Wen Mechanics of Fluidization , 1966 .

[20]  Danesh K. Tafti,et al.  A supervised machine learning approach for predicting variable drag forces on spherical particles in suspension , 2019, Powder Technology.

[21]  J. Templeton,et al.  Reynolds averaged turbulence modelling using deep neural networks with embedded invariance , 2016, Journal of Fluid Mechanics.

[22]  Andrew J. Majda,et al.  Physics constrained nonlinear regression models for time series , 2012 .

[23]  Nagiza F. Samatova,et al.  Theory-Guided Data Science: A New Paradigm for Scientific Discovery from Data , 2016, IEEE Transactions on Knowledge and Data Engineering.

[24]  Risi Kondor,et al.  Cormorant: Covariant Molecular Neural Networks , 2019, NeurIPS.

[25]  David Duvenaud,et al.  Neural Ordinary Differential Equations , 2018, NeurIPS.

[26]  S. Tenneti,et al.  Drag law for monodisperse gas–solid systems using particle-resolved direct numerical simulation of flow past fixed assemblies of spheres , 2011 .

[27]  Yani Ioannou,et al.  Structural priors in deep neural networks , 2018 .