Molecular Property Prediction: A Multilevel Quantum Interactions Modeling Perspective

Predicting molecular properties (e.g., atomization energy) is an essential issue in quantum chemistry, which could speed up much research progress, such as drug designing and substance discovery. Traditional studies based on density functional theory (DFT) in physics are proved to be time-consuming for predicting large number of molecules. Recently, the machine learning methods, which consider much rule-based information, have also shown potentials for this issue. However, the complex inherent quantum interactions of molecules are still largely underexplored by existing solutions. In this paper, we propose a generalizable and transferable Multilevel Graph Convolutional neural Network (MGCN) for molecular property prediction. Specifically, we represent each molecule as a graph to preserve its internal structure. Moreover, the well-designed hierarchical graph neural network directly extracts features from the conformation and spatial information followed by the multilevel interactions. As a consequence, the multilevel overall representations can be utilized to make the prediction. Extensive experiments on both datasets of equilibrium and off-equilibrium molecules demonstrate the effectiveness of our model. Furthermore, the detailed results also prove that MGCN is generalizable and transferable for the prediction.

[1]  Xiao-Ming Wu,et al.  Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learning , 2018, AAAI.

[2]  Xiaohui Xie,et al.  Co-Occurrence Feature Learning for Skeleton Based Action Recognition Using Regularized Deep LSTM Networks , 2016, AAAI.

[3]  N. Handy,et al.  A new hybrid exchange–correlation functional using the Coulomb-attenuating method (CAM-B3LYP) , 2004 .

[4]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[5]  Fei-Fei Li,et al.  Large-Scale Video Classification with Convolutional Neural Networks , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  P. Hohenberg,et al.  Inhomogeneous Electron Gas , 1964 .

[7]  Klaus-Robert Müller,et al.  SchNet: A continuous-filter convolutional neural network for modeling quantum interactions , 2017, NIPS.

[8]  Danna Zhou,et al.  d. , 1934, Microbial pathogenesis.

[9]  Alán Aspuru-Guzik,et al.  Automatic Chemical Design Using a Data-Driven Continuous Representation of Molecules , 2016, ACS central science.

[10]  Pavlo O. Dral,et al.  Quantum chemistry structures and properties of 134 kilo molecules , 2014, Scientific Data.

[11]  Raghunathan Ramakrishnan,et al.  Many Molecular Properties from One Kernel in Chemical Space. , 2015, Chimia.

[12]  Nicholas Jing Yuan,et al.  XiaoIce Band: A Melody and Arrangement Generation Framework for Pop Music , 2018, KDD.

[13]  Jason Weston,et al.  A unified architecture for natural language processing: deep neural networks with multitask learning , 2008, ICML '08.

[14]  Wouter Boomsma,et al.  Spherical convolutions and their application in molecular modelling , 2017, NIPS.

[15]  Paul L A Popelier,et al.  Machine Learning of Dynamic Electron Correlation Energies from Topological Atoms. , 2018, Journal of chemical theory and computation.

[16]  Vijay S. Pande,et al.  Molecular graph convolutions: moving beyond fingerprints , 2016, Journal of Computer-Aided Molecular Design.

[17]  Enhong Chen,et al.  Question Difficulty Prediction for READING Problems in Standard Tests , 2017, AAAI.

[18]  H. Zou,et al.  Regularization and variable selection via the elastic net , 2005 .

[19]  K. Müller,et al.  Machine Learning Predictions of Molecular Properties: Accurate Many-Body Potentials and Nonlocality in Chemical Space , 2015, The journal of physical chemistry letters.

[20]  Tingjun Hou,et al.  Application of molecular dynamics simulations in molecular property prediction II: Diffusion coefficient , 2011, J. Comput. Chem..

[21]  Andreas Ziehe,et al.  Learning Invariant Representations of Molecules for Atomization Energy Prediction , 2012, NIPS.

[22]  Abhinav Vishnu,et al.  ChemNet: A Transferable and Generalizable Deep Neural Network for Small-Molecule Property Prediction , 2017, ArXiv.

[23]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  J Behler,et al.  Representing potential energy surfaces by high-dimensional neural network potentials , 2014, Journal of physics. Condensed matter : an Institute of Physics journal.

[25]  Roman Garnett,et al.  Active Search in Intensionally Specified Structured Spaces , 2017, AAAI.

[26]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[27]  Samuel S. Schoenholz,et al.  Neural Message Passing for Quantum Chemistry , 2017, ICML.

[28]  Chérif F. Matta,et al.  The Quantum theory of atoms in molecules : from solid state to DNA and drug design , 2007 .

[29]  O. A. von Lilienfeld,et al.  Communication: Understanding molecular representations in machine learning: The role of uniqueness and target similarity. , 2016, The Journal of chemical physics.

[30]  Jean-Louis Reymond,et al.  Enumeration of 166 Billion Organic Small Molecules in the Chemical Universe Database GDB-17 , 2012, J. Chem. Inf. Model..

[31]  Pierre Vandergheynst,et al.  Geometric Deep Learning: Going beyond Euclidean data , 2016, IEEE Signal Process. Mag..

[32]  W. Kohn,et al.  Self-Consistent Equations Including Exchange and Correlation Effects , 1965 .

[33]  George E. Dahl,et al.  Prediction Errors of Molecular Machine Learning Models Lower than Hybrid DFT Error. , 2017, Journal of chemical theory and computation.

[34]  D. Thouless The Quantum Mechanics of Many-Body Systems , 2013 .

[35]  Yoshua Bengio,et al.  Convolutional networks for images, speech, and time series , 1998 .

[36]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[37]  D. Broomhead,et al.  Radial Basis Functions, Multi-Variable Functional Interpolation and Adaptive Networks , 1988 .

[38]  Jinfeng Yi,et al.  Edge Attention-based Multi-Relational Graph Convolutional Networks , 2018, ArXiv.

[39]  Peter A. Kollman,et al.  Theory of complex molecular interactions: computer graphics, distance geometry, molecular mechanics, and quantum mechanics , 1985 .

[40]  W. F. Lawless,et al.  Information density functional theory: A quantum approach to intent , 2002 .

[41]  Ekin D. Cubuk,et al.  Representations in neural network based empirical potentials. , 2017, The Journal of chemical physics.

[42]  Enhong Chen,et al.  Finding Similar Exercises in Online Education Systems , 2018, KDD.

[43]  Alexandre Tkatchenko,et al.  Quantum-chemical insights from deep tensor neural networks , 2016, Nature Communications.