There has been a recent surge of interest in using machine learning across chemical space in order to predict properties of molecules or design molecules and materials with desired properties. Most of this work relies on defining clever feature representations, in which the chemical graph structure is encoded in a uniform way such that predictions across chemical space can be made. In this work, we propose to exploit the powerful ability of deep neural networks to learn a feature representation from low-level encodings of a huge corpus of chemical structures. Our model borrows ideas from neural machine translation: it translates between two semantically equivalent but syntactically different representations of molecular structures, compressing the meaningful information both representations have in common in a low-dimensional representation vector. Once the model is trained, this representation can be extracted for any new molecule and utilized as descriptor. In fair benchmarks with respect to various human-engineered molecular fingerprints and graph-convolution models, our method shows competitive performance in modelling quantitative structure-activity relationships in all analyzed datasets. Additionally, we show that our descriptor significantly outperforms all baseline molecular fingerprints in two ligand-based virtual screening tasks. Overall, our descriptors show the most consistent performances over all experiments. The continuity of the descriptor space and the existence of the decoder that permits to deduce a chemical structure from an embedding vector allows for exploration of the space and opens up new opportunities for compound optimization and idea generation.
[1]
Jürgen Schmidhuber,et al.
Long Short-Term Memory
,
1997,
Neural Computation.
[2]
Yoshua Bengio,et al.
Gradient Flow in Recurrent Nets: the Difficulty of Learning Long-Term Dependencies
,
2001
.
[3]
Geoffrey E. Hinton,et al.
ImageNet classification with deep convolutional neural networks
,
2012,
Commun. ACM.
[4]
Sereina Riniker,et al.
Open-source platform to benchmark fingerprints for ligand-based virtual screening
,
2013,
Journal of Cheminformatics.
[5]
Yoshua Bengio,et al.
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
,
2014,
ArXiv.
[6]
Jimmy Ba,et al.
Adam: A Method for Stochastic Optimization
,
2014,
ICLR.
[7]
Yann Dauphin,et al.
Convolutional Sequence to Sequence Learning
,
2017,
ICML.