A hybrid quantum regression model for the prediction of molecular atomization energies

Quantum machine learning is a relatively new research field that aims to combine the dramatic performance advantage offered by quantum computing and the ability of machine learning algorithms to learn complex distributions of high-dimensional data. The primary focus of this domain is the implementation of classical machine learning algorithms in the quantum mechanical domain and study of the speedup due to quantum parallelism, which could enable the development of novel techniques for solving problems such as quantum phase recognition and quantum error correction optimization. In this paper, we propose a hybrid quantum machine learning pipeline for predicting the atomization energies of various molecules using the nuclear charges and atomic positions of the constituent atoms. Firstly, we will be using a deep convolutional auto-encoder model for the feature extraction of data constructed from the eigenvalues and eigenvector centralities of the pairwise distance matrix calculated from atomic positions and the unrolled upper triangle of each Coulomb matrix calculated from nuclear charges, and we will then be using a quantum regression algorithm such as quantum linear regression, quantum radial basis function neural network and, a quantum neural network for estimating the atomization energy. The hybrid quantum neural network models do not seem to provide any speedup over their classical counterparts. Before implementing a quantum algorithm, we will also be using state-of-the-art classical machine learning and deep learning models such as XGBoost, multilayer perceptron, deep convolutional neural network, and a long short-term memory network to study the correlation between the extracted features and corresponding atomization energies of molecules.

[1]  Vijay S. Pande,et al.  MoleculeNet: a benchmark for molecular machine learning , 2017, Chemical science.

[2]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[3]  M. Schuld,et al.  Prediction by linear regression on a quantum computer , 2016, 1601.07823.

[4]  Andrew W. Senior,et al.  Long Short-Term Memory Based Recurrent Neural Network Architectures for Large Vocabulary Speech Recognition , 2014, ArXiv.

[5]  Mohsen Guizani,et al.  Deep Feature Learning for Medical Image Analysis with Convolutional Autoencoder Neural Network , 2017, IEEE Transactions on Big Data.

[6]  Julio J. Valdés,et al.  Prediction of the Atomization Energy of Molecules Using Coulomb Matrix and Atomic Composition in a Bayesian Regularized Neural Networks , 2019, ICANN.

[7]  Dermot Diamond,et al.  A survey on Big Data and Machine Learning for Chemistry , 2019, ArXiv.

[8]  Sebastian Ruder,et al.  An overview of gradient descent optimization algorithms , 2016, Vestnik komp'iuternykh i informatsionnykh tekhnologii.

[9]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[10]  Ewin Tang,et al.  Quantum-inspired classical algorithms for principal component analysis and supervised clustering , 2018, ArXiv.

[11]  Fionn Murtagh,et al.  Multilayer perceptrons for classification and regression , 1991, Neurocomputing.

[12]  Iordanis Kerenidis,et al.  q-means: A quantum algorithm for unsupervised machine learning , 2018, NeurIPS.

[13]  Changpeng Shao,et al.  Data classification by quantum radial-basis-function networks , 2020 .

[14]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[15]  Davide Anguita,et al.  Quantum optimization for training support vector machines , 2003, Neural Networks.

[16]  Lorenz C. Blum,et al.  970 million druglike small molecules for virtual screening in the chemical universe database GDB-13. , 2009, Journal of the American Chemical Society.

[17]  Gavin E. Crooks,et al.  Gradients of parameterized quantum gates using the parameter-shift rule and gate decomposition , 2019, 1905.13311.

[18]  Guoming Wang Quantum Algorithm for Linear Regression , 2017 .

[19]  Dan Ventura,et al.  Training a Quantum Neural Network , 2003, NIPS.

[20]  Kuldip K. Paliwal,et al.  Bidirectional recurrent neural networks , 1997, IEEE Trans. Signal Process..

[21]  Franco Nori,et al.  QuTiP 2: A Python framework for the dynamics of open quantum systems , 2012, Comput. Phys. Commun..

[22]  F. Petruccione,et al.  An introduction to quantum machine learning , 2014, Contemporary Physics.

[23]  C-Y Lu,et al.  Entanglement-based machine learning on a quantum computer. , 2015, Physical review letters.

[24]  Klaus-Robert Müller,et al.  Assessment and Validation of Machine Learning Methods for Predicting Molecular Atomization Energies. , 2013, Journal of chemical theory and computation.

[25]  M. Newman Mathematics of networks , 2018, Oxford Scholarship Online.

[26]  Jacob biamonte,et al.  Quantum machine learning , 2016, Nature.

[27]  Jürgen Schmidhuber,et al.  Stacked Convolutional Auto-Encoders for Hierarchical Feature Extraction , 2011, ICANN.

[28]  Jenni A. M. Sidey-Gibbons,et al.  Machine learning in medicine: a practical introduction , 2019, BMC Medical Research Methodology.

[29]  K. Müller,et al.  Fast and accurate modeling of molecular atomization energies with machine learning. , 2011, Physical review letters.

[30]  Tobias J. Osborne,et al.  Training deep quantum neural networks , 2020, Nature Communications.

[31]  S. Lloyd,et al.  Quantum algorithms for supervised and unsupervised machine learning , 2013, 1307.0411.

[32]  Houshang Darabi,et al.  Insights Into LSTM Fully Convolutional Networks for Time Series Classification , 2019, IEEE Access.

[33]  Arit Kumar Bishwas,et al.  An investigation on support vector clustering for big data in quantum paradigm , 2018, Quantum Information Processing.

[34]  Seth Lloyd,et al.  Quantum random access memory. , 2007, Physical review letters.

[35]  Robert Gardner,et al.  Quantum generalisation of feedforward neural networks , 2016, npj Quantum Information.

[36]  Ewin Tang,et al.  A quantum-inspired classical algorithm for recommendation systems , 2018, Electron. Colloquium Comput. Complex..

[37]  Bin Li,et al.  Applications of machine learning in drug discovery and development , 2019, Nature Reviews Drug Discovery.

[38]  Stacey Jeffery,et al.  The power of block-encoded matrix powers: improved regression techniques via faster Hamiltonian simulation , 2018, ICALP.

[39]  Andreas Ziehe,et al.  Learning Invariant Representations of Molecules for Atomization Energy Prediction , 2012, NIPS.

[40]  K. Borgwardt,et al.  Machine Learning in Medicine , 2015, Mach. Learn. under Resour. Constraints Vol. 3.

[41]  Shouvanik Chakrabarti,et al.  Quantum Wasserstein Generative Adversarial Networks , 2019, NeurIPS.

[42]  Stefan Güttel,et al.  Time Series Forecasting Using LSTM Networks: A Symbolic Approach , 2020, ArXiv.

[43]  Tianqi Chen,et al.  XGBoost: A Scalable Tree Boosting System , 2016, KDD.

[44]  Soonwon Choi,et al.  Quantum convolutional neural networks , 2018, Nature Physics.

[45]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[46]  Maria Schuld,et al.  Quantum Machine Learning in Feature Hilbert Spaces. , 2018, Physical review letters.

[47]  Marc'Aurelio Ranzato,et al.  Large Scale Distributed Deep Networks , 2012, NIPS.

[48]  Changjun Zhou,et al.  Forecasting stock prices with long-short term memory neural network based on attention mechanism , 2020, PloS one.

[49]  Bhiksha Raj,et al.  On the Origin of Deep Learning , 2017, ArXiv.

[50]  Jiro Katto,et al.  Deep Convolutional AutoEncoder-based Lossy Image Compression , 2018, 2018 Picture Coding Symposium (PCS).