Bayesian machine learning for Boltzmann machine in quantum-enhanced feature spaces

Bayesian learning is ubiquitous for implementing classification and regression tasks, however, it is accompanied by computationally intractable limitations when the feature spaces become extremely large. Aiming to solve this problem, we develop a quantum bayesian learning framework of the restricted Boltzmann machine in the quantum-enhanced feature spaces. Our framework provides the encoding phase to map the real data and Boltzmann weight onto the quantum feature spaces and the training phase to learn an optimal inference function. Specifically, the training phase provides a physical quantity to measure the posterior distribution in quantum feature spaces, and this measure is utilized to design the quantum maximum a posterior (QMAP) algorithm and the quantum predictive distribution estimator (QPDE). It is shown that both quantum algorithms achieve exponential speed-up over their classical counterparts. Furthermore, it is interesting to note that our framework can figure out the classical bayesian learning tasks, i.e. processing the classical data and outputting corresponding classical labels. And a simulation, which is performed on an open-source software framework for quantum computing, illustrates that our algorithms show almost the same classification performance compared to their classical counterparts. Noting that the proposed quantum algorithms utilize the shallow circuit, our work is expected to be implemented on the noisy intermediate-scale quantum (NISQ) devices, and is one of the promising candidates to achieve quantum supremacy.

[1]  G. Brassard,et al.  Quantum Amplitude Amplification and Estimation , 2000, quant-ph/0005055.

[2]  Peter Wittek,et al.  Bayesian deep learning on a quantum computer , 2018, Quantum Machine Intelligence.

[3]  M. Schuld,et al.  Prediction by linear regression on a quantum computer , 2016, 1601.07823.

[4]  Lov K. Grover A fast quantum mechanical algorithm for database search , 1996, STOC '96.

[5]  J. Gambetta,et al.  Hardware-efficient variational quantum eigensolver for small molecules and quantum magnets , 2017, Nature.

[6]  Kristan Temme,et al.  Supervised learning with quantum-enhanced feature spaces , 2018, Nature.

[7]  Yang Liu,et al.  Fast quantum algorithms for least squares regression and statistic leverage scores , 2017, Theor. Comput. Sci..

[8]  A. Harrow,et al.  Quantum Supremacy through the Quantum Approximate Optimization Algorithm , 2016, 1602.07674.

[9]  Peter W. Shor Polynomial-Time Algorithms for Prime Factorization and Discrete Logarithms on a Quantum Computer , 1999 .

[10]  Nir Friedman,et al.  Bayesian Network Classifiers , 1997, Machine Learning.

[11]  Chao-Hua Yu,et al.  An Improved Quantum Algorithm for Ridge Regression , 2017, IEEE Transactions on Knowledge and Data Engineering.

[12]  Su-Juan Qin,et al.  Asymptotic quantum algorithm for the Toeplitz systems , 2016, Physical Review A.

[13]  Maria Schuld,et al.  A quantum hardware-induced graph kernel based on Gaussian Boson Sampling , 2019, 1905.12646.

[14]  E. Farhi,et al.  A Quantum Approximate Optimization Algorithm , 2014, 1411.4028.

[15]  S. Lloyd,et al.  Quantum principal component analysis , 2013, Nature Physics.

[16]  Alán Aspuru-Guzik,et al.  A variational eigenvalue solver on a photonic quantum processor , 2013, Nature Communications.

[17]  Keisuke Fujii,et al.  Quantum circuit learning , 2018, Physical Review A.

[18]  Charles H. Bennett,et al.  Optimal Simulation of Two-Qubit Hamiltonians Using General Local Operations , 2001, quant-ph/0107035.

[19]  R. Cleve,et al.  Quantum fingerprinting. , 2001, Physical review letters.

[20]  Blake R. Johnson,et al.  Unsupervised Machine Learning on a Hybrid Quantum Computer , 2017, 1712.05771.

[21]  Chao-Hua Yu,et al.  Quantum algorithms for ridge regression , 2017 .

[22]  Justus H. Piater,et al.  Towards Sparsity and Selectivity: Bayesian Learning of Restricted Boltzmann Machine for Early Visual Features , 2014, ICANN.

[23]  M. Schuld,et al.  Measuring the similarity of graphs with a Gaussian boson sampler , 2020, Physical Review A.

[24]  Andrew M. Childs,et al.  Simulating Hamiltonian dynamics with a truncated Taylor series. , 2014, Physical review letters.

[25]  Maria Schuld,et al.  Quantum Machine Learning in Feature Hilbert Spaces. , 2018, Physical review letters.

[26]  Roger Melko,et al.  Quantum Boltzmann Machine , 2016, 1601.02036.

[27]  Seth Lloyd,et al.  Quantum algorithm for data fitting. , 2012, Physical review letters.

[28]  Jacob biamonte,et al.  Quantum machine learning , 2016, Nature.

[29]  Masoud Mohseni,et al.  Quantum support vector machine for big feature and big data classification , 2013, Physical review letters.

[30]  J. Spall Multivariate stochastic approximation using a simultaneous perturbation gradient approximation , 1992 .

[31]  Peter J. Love,et al.  A variational eigenvalue solver on a quantum processor , 2018 .

[32]  S. Lloyd,et al.  Quantum algorithms for supervised and unsupervised machine learning , 2013, 1307.0411.

[33]  Jingbo B. Wang,et al.  Quantum Fourier transform in computational basis , 2015, Quantum Information Processing.

[34]  Leslie Ann Goldberg,et al.  The Complexity of Approximating complex-valued Ising and Tutte partition functions , 2014, computational complexity.

[35]  Anmer Daskin Quantum Principal Component Analysis , 2015 .

[36]  Patrick J. Coles,et al.  Variational quantum state diagonalization , 2018, npj Quantum Information.

[37]  A. Harrow,et al.  Quantum algorithm for linear systems of equations. , 2008, Physical review letters.

[38]  L. Wossnig,et al.  Quantum Linear System Algorithm for Dense Matrices. , 2017, Physical review letters.

[39]  Qiaoyan Wen,et al.  Quantum Conditional Random Field , 2019, 1901.01027.