Non-Autoregressive Electron Redistribution Modeling for Reaction Prediction

Reliably predicting the products of chemical reactions presents a fundamental challenge in synthetic chemistry. Existing machine learning approaches typically produce a reaction product by sequentially forming its subparts or intermediate molecules. Such autoregressive methods, however, not only require a pre-defined order for the incremental construction but preclude the use of parallel decoding for efficient computation. To address these issues, we devise a non-autoregressive learning paradigm that predicts reaction in one shot. Leveraging the fact that chemical reactions can be described as a redistribution of electrons in molecules, we formulate a reaction as an arbitrary electron flow and predict it with a novel multipointer decoding network. Experiments on the USPTO-MIT dataset show that, our approach has established a new state-of-the-art top-1 accuracy and achieves at least 27 times inference speedup over the state-of-the-art methods. Also, our predictions are easier for chemists to interpret owing to predicting the electron flows.

[1]  Stanislaw Jastrzebski,et al.  Molecule Edit Graph Attention Network: Modeling Chemical Reactions as Sequences of Graph Edits , 2020, J. Chem. Inf. Model..

[2]  Wenbing Huang,et al.  GROVER: Self-supervised Message Passing Transformer on Large-scale Molecular Data , 2020, ArXiv.

[3]  Regina Barzilay,et al.  Current and Future Roles of Artificial Intelligence in Medicinal Chemistry Synthesis , 2020, Journal of medicinal chemistry.

[4]  Jian Tang,et al.  A Graph to Graphs Framework for Retrosynthesis Prediction , 2020, ICML.

[5]  Wesley Wei Qian,et al.  Integrating Deep Neural Networks and Symbolic Inference for Organic Reactivity Prediction , 2020 .

[6]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.

[7]  Christopher A. Hunter,et al.  Molecular Transformer: A Model for Uncertainty-Calibrated Chemical Reaction Prediction , 2018, ACS central science.

[8]  Jure Leskovec,et al.  Position-aware Graph Neural Networks , 2019, ICML.

[9]  Svetha Venkatesh,et al.  Graph Transformation Policy Network for Chemical Reaction Prediction , 2018, KDD.

[10]  Connor W. Coley,et al.  A graph-convolutional neural network model for the prediction of chemical reactivity , 2018, Chemical science.

[11]  Matt J. Kusner,et al.  A Generative Model For Electron Paths , 2018, ICLR.

[12]  Max Welling,et al.  Modeling Relational Data with Graph Convolutional Networks , 2017, ESWC.

[13]  Regina Barzilay,et al.  Predicting Organic Reaction Outcomes with Weisfeiler-Lehman Network , 2017, NIPS.

[14]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[15]  Marwin H. S. Segler,et al.  Neural-Symbolic Machine Learning for Retrosynthesis and Reaction Prediction. , 2017, Chemistry.

[16]  Regina Barzilay,et al.  Prediction of Organic Reaction Outcomes Using Machine Learning , 2017, ACS central science.

[17]  Alán Aspuru-Guzik,et al.  Neural Networks for the Prediction of Organic Chemistry Reactions , 2016, ACS central science.

[18]  Honglak Lee,et al.  Learning Structured Output Representation using Deep Conditional Generative Models , 2015, NIPS.

[19]  R. Herges Coarctate and Pseudocoarctate Reactions: Stereochemical Rules. , 2015, The Journal of organic chemistry.

[20]  Navdeep Jaitly,et al.  Pointer Networks , 2015, NIPS.

[21]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[22]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[23]  Daniel M. Lowe Extraction of chemical structures and reactions from the literature , 2012 .

[24]  Pierre Baldi,et al.  A Machine Learning Approach to Predict Chemical Reactions , 2011, NIPS.

[25]  Rainer Herges,et al.  Coarctate transition states: the discovery of a reaction principle , 1994, J. Chem. Inf. Comput. Sci..

[26]  David Weininger,et al.  SMILES, a chemical language and information system. 1. Introduction to methodology and encoding rules , 1988, J. Chem. Inf. Comput. Sci..

[27]  E J Corey,et al.  Computer-assisted design of complex organic syntheses. , 1969, Science.